Methods, devices, equipment and program products for interface interaction
By presenting corresponding expressions of connecting elements and media content fragments in the creation area, the problem of confusion between the expression of media content and timeline fragments is solved, and the operational efficiency and accuracy of the creation area are improved.
Patent Information
- Application Number
- CN202611284076.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-08-21
- Publication Date
- 2026-11-17
AI Technical Summary
Existing technologies struggle to efficiently represent the correspondence between media content and timeline segments within the creative area, leading to confusion and repetitive operations during the creation of media content.
By presenting connecting elements between the first and second components in the creation area and displaying corresponding media content fragments in the track of the second component, the corresponding expression between media content and timeline fragments is achieved, reducing repetitive operations and confusion.
It improves the efficiency and accuracy of media content creation, reduces the need for repeated updates of irrelevant components and segments, and simplifies the media content arrangement process.
Smart Images

Figure CN123114313A_ABST
Abstract
Description
Technical Field
[0001] The examples in this article generally relate to the field of computer science, and in particular to methods, devices, equipment, and program products for user interface interaction. Background Technology
[0002] With the development of computer technology, more and more media content editing applications have integrated media content generation functions, allowing users to generate media content. Media content generation technology enables users to create multi-dimensional creative works based on single image or video materials, greatly lowering the barrier to entry for media content creation. Summary of the Invention
[0003] In a first aspect, a method for interface interaction is provided, comprising: presenting a first component in a creation area, the first component presenting first media content; in response to receiving a first operation, presenting a first element, the first element connecting the first component and a second component in the creation area; and presenting a first segment on a first track of the second component, the first segment corresponding to the first media content.
[0004] In a second aspect, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present a first component in a creation area, the first component presenting first media content; a second presentation module configured to present a first element in response to receiving a first operation, the first element connecting the first component and a second component in the creation area; and a third presentation module configured to present a first segment on a first track of the second component, the first segment corresponding to the first media content.
[0005] In a third aspect, an electronic device is provided. The device includes at least one processor; at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, causing the electronic device to perform the method according to the first aspect.
[0006] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.
[0007] In a fifth aspect, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect. In this way, it is possible to form corresponding expressions between media sources, component connections, and timeline segments within a creative area, allowing media content to enter corresponding tracks in fragment form.
[0008] It should be understood that the content described in this section is not intended to limit the key or important features of the examples in this article, nor is it intended to restrict the scope of the solution. Other features will become readily apparent from the following description. Attached Figure Description
[0009] The above and other features, advantages, and aspects of the various examples herein will become more apparent when taken in conjunction with the accompanying drawings and the following detailed description. In the accompanying drawings, the same or similar reference numerals denote the same or similar elements, wherein: Figure 1 A schematic diagram of an example environment for implementing the interface interaction method is shown; Figures 2A to 2H Example interfaces for some scenarios are shown; Figures 3A to 3E Example interfaces for other scenarios are shown; Figure 4 The flowcharts show example processes for methods used in interface interaction in some scenarios; Figure 5 Block diagrams of devices for interface interaction in several scenarios are shown; and Figure 6 A block diagram of an electronic device capable of implementing multiple illustrative scenarios is shown. Detailed Implementation
[0010] The examples in this document will now be described in more detail with reference to the accompanying drawings. While some examples are shown in the drawings, it should be understood that solutions can be implemented in various forms and should not be construed as limited to the examples presented herein. Rather, these examples are provided to provide a more thorough and complete understanding of the solutions. It should be understood that the drawings and examples in this document are for illustrative purposes only and are not intended to limit the scope of protection of the solutions.
[0011] It should be noted that the headings of any section / subsection provided herein are not restrictive. Various examples are described throughout this document, and examples of any type may be included under any section / subsection. Furthermore, examples described in any section / subsection may be combined in any way with any other examples described in the same section / subsection and / or different sections / subsections.
[0012] In the description of the examples in this document, the term "including" and similar terms should be understood as open inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "an example" or "the example" should be understood as "at least one example". The term "some examples" should be understood as "at least some examples". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.
[0013] The examples in this document may involve user data, data acquisition, and / or use. All of these aspects comply with relevant laws, regulations, and rules. In the examples, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, when implementing each example, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained through appropriate means, in accordance with relevant laws and regulations. The specific methods of notification and / or authorization can vary depending on the actual situation and application scenario; the scope of the solution is not limited in this regard.
[0014] In this document and the examples provided, any processing of personal information will be conducted only on a legal basis (e.g., with the consent of the data subject, or as necessary for the performance of a contract) and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information beyond what is necessary for basic functions will not affect their use of those basic functions.
[0015] The term "creation area" as used in this article refers to the interface area used to house and organize interactive components. It can be a panning or scalable canvas area, or a limited work area.
[0016] The term "component" as used in this article refers to an interface object in the creation area that can be presented or manipulated individually, which may include media components for presenting media content, timeline components for carrying clips, and output components for presenting output content.
[0017] The term "media content" as used in this article refers to content that can be presented in an interface or arranged in a timeline, and may include at least one of images, videos and audio, or may include media results formed by one or more segments.
[0018] As mentioned above, source media is best presented as individual components, while timeline content is best presented as a continuous track. When these two types of objects are organized in different ways, the interface needs to provide a way to express relationships across component and track layers.
[0019] The source media may also be replaced, have its duration adjusted, or be deleted after the clip is created. If the timeline clip cannot change synchronously along the source relationship, the clip status displayed on the interface may be inconsistent with the source content.
[0020] The timeline component needs to occupy a small space within the creation area so that multiple media components can be viewed simultaneously. A larger track area is required when users perform fine-grained editing, therefore the timeline content and editing results need to be shared between the compact and expanded display states.
[0021] A user interface interaction scheme is proposed. According to this scheme, the electronic device presents a first component containing first media content in the creation area, and in response to a first operation, presents a first element connecting the first component and a second component. The electronic device also presents a first fragment corresponding to the first media content in a first track of the second component.
[0022] Using the above approach, users can identify the relationship between media sources and timeline components along visual connections and locate media segments within the corresponding tracks. Once a connection is formed, electronic devices can draw connection elements and display corresponding segments based on the shared source relationship, thus avoiding the need to create separate, unrelated interface objects.
[0023] Example Environment Figure 1 A schematic diagram of example environment 100 is shown. (e.g.) Figure 1 As shown, example environment 100 may include electronic device 110.
[0024] In example environment 100, electronic device 110 can run application 120 that supports user interface interaction. User 140 can interact with application 120 via electronic device 110 or its attached devices.
[0025] When application 120 is active, electronic device 110 can use application 120 to present interface 150 for media organization and timeline arrangement. Interface 150 may include features described below. Figures 2A to 3E The description of the creation area and interface objects.
[0026] In some cases, electronic device 110 communicates with server 130 to obtain support for material storage, media processing, compositing, or output. Interface presentation and reception of user operations can still be completed at electronic device 110.
[0027] Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, virtual reality (VR) / augmented reality (AR) devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some cases, electronic device 110 may also support any type of user-facing interface (such as "wearable" circuitry).
[0028] Server 130 can be a single physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support user interface interaction in electronic devices 110.
[0029] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection can include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections. In some cases, server 130 and electronic device 110 can exchange signaling information through their communication connection.
[0030] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of the scheme.
[0031] The examples will continue to be described with reference to the accompanying drawings. The examples described herein can be implemented on electronic device 110. It should be noted that in the following descriptions of the various example interfaces, all interactive operations can be received and executed by electronic device 110. Operations described relative to electronic device 110 can be performed by a relevant application 120 running on electronic device 110. Interfaces described relative to electronic device 110 can be provided by application 120; for example, electronic device 110 presents the corresponding interface by running application 120. Furthermore, some operations described relative to electronic device 110 may require the assistance of server 130 to complete. For example, the generation and processing of relevant media content (such as media content generation, regeneration, audio separation, etc.) can be implemented by electronic device 110 with the assistance of server 130.
[0032] Example Interaction In some cases, the electronic device 110 can present a first component in the creation area, and the first component presents first media content. The first component may include media nodes for presenting the media content, such as... Figure 2A The video or audio node shown in the diagram. The first media content may include at least one of image content, video content, or audio content, and may be referenced by the timeline component to form a corresponding editable segment. See below for reference. Figures 2A to 2H It describes the continuous process of media content access, segment arrangement, and result output.
[0033] Figure 2A A schematic diagram of the initial interface 200A for the media component and timeline component according to some scenarios is shown. The initial interface 200A can be provided by the electronic device 110. (As...) Figure 2A As shown, the electronic device 110 presents a first component 202, a third component (e.g., component 204 and component 206), and a second component 208 in the creation area of the interface 200A. The first component 202 is used to present a first media content in video form, the third component (e.g., component 204) is used to present a second media content in video form, the third component (e.g., component 206) is used to present a second media content in audio form, and the second component 208 is used to carry timeline segments.
[0034] like Figure 2A As shown, the second component 208 can be specifically represented as a timeline component, and... Figure 2AThe timeline component is currently in a node view before any clips have been added. The node view refers to the state where the timeline component is presented as compact nodes within the creation area. This state can display previews, the main track, audio display lines, and frequently used access points. The timeline component can directly receive media content of image, video, and audio types. A timeline component is a container component that carries one or more clips according to their temporal relationship. It can be presented in a node view within the creation area, or switched to a focused or expanded display state. The expanded display state refers to the state where the display area of the timeline component is expanded or focused. This can include a full-screen view and can display the complete main track, multiple audio tracks, and the media management area. A clip is an editable representation of media content within the timeline component. It can maintain a reference relationship with the source media content and has at least one attribute: track position, time position, or duration.
[0035] The node view provides a compact timeline thumbnail display within the creation area. This view can present the main track and audio display lines, and supports adding or deleting clips, adjusting clip boundaries, splitting clips, and dragging clips to change their order. A track refers to the logical hierarchy within the timeline component used to hold clips; it can include a main track for holding image or video clips and one or more audio tracks for holding audio clips.
[0036] The node view also supports playback or pause, output, entering expanded display mode, and zooming the timeline. Output refers to the processing of segments in the timeline component into usable results, which can include creating media content, creating structured edit descriptions, and packaging edit descriptions together with referenced materials.
[0037] In some scenarios, the creation area can display multiple timeline components simultaneously, each maintaining its own segment arrangement. Multiple timeline components can reference the same source media or different source media, allowing users to compare different combinations of segments within the same creation area.
[0038] Figure 2A This provides a common starting point for subsequent interface states. After the user initiates a connection operation from the first component 202, the interface changes... Figure 2A Entering the disconnected state Figure 2B The connection formation state is shown.
[0039] Figure 2B A schematic diagram of interface 200B is shown, illustrating how a connection operation is initiated from the first component under certain circumstances. Interface 200B follows... Figure 2AThe first component 202 and the second component 208 are presented, and the first control 212 and the first element 210 in the formation process are further presented. An element is a visual object used to express the relationship between different components, which can be represented as a straight line, a curve or other connecting graphic. The first element, the second element and the third element are used to distinguish different connection relationships.
[0040] In some cases, electronic device 110 may present a first control 212 associated with the first component 202. In response to a triggering operation on the first control 212, electronic device 110 uses the first component 202 as the connection origin and presents a first element 210 with its first end connected to the first component 202. The other end of the first element 210 remains movable to receive a second operation connecting that end to the second component 208. In this way, the user can initiate a connection from the first control 212, which has a clear visual entry point, and can identify the source of the connection before the connection is complete. Electronic device 110 only enters the connection processing state after the first control 212 is triggered; subsequent position input is handled by this state, thereby avoiding connection drawing for ordinary movement input unrelated to the connection.
[0041] In some cases, the electronic device 110 can display an indicator in the creation area to indicate the operation position, and the second end of the first element 210 moves with the indicator. The indicator is an interface object used to indicate the current operation position, and can be implemented by a mouse pointer, touch position marker, focus marker, or other positional feedback object. A second operation moves the indicator to a first area corresponding to the second component 208. The first area is a target area corresponding to the second component and capable of receiving the connection end of the first element; it can coincide with or surround the visible area of the second component. Within the first area, the electronic device 110 can stop moving the indicator and update the second end of the first element 210 according to continuous position input, forming a target position. Figure 2B The connection points are indicated in the diagram. In this way, users can continuously observe the relative position of the connection point and the target component during dragging and correct the target before the connection is complete. The electronic device 110 updates the local connection diagram based on the current operating position, eliminating the need to generate fragments every time the position changes, thereby reducing the creation of invalid fragments and the corresponding interface rollback processing.
[0042] In some cases, the second component 208 may be presented in the creation area according to the first style before the indicator reaches the first area. A style refers to the perceptible presentation state of an interface object, which can be distinguished by at least one visual attribute among line width, brightness, color, border, background, or transparency. In response to the indicator moving to the first area, the electronic device 110 switches the second component 208 to the second style. For example, changes in border, background, or outline may indicate that the second component can receive the current connection. Figure 2AThe normal state and Figure 2C The access status in the images demonstrates the specific behavior of both styles. This allows users to confirm the target area before releasing the connection, reducing the need to connect media content to the wrong component. Electronic device 110 first updates the display properties of the target component and then generates the fragment after the connection is confirmed, thus avoiding media referencing and track updates for unconfirmed targets.
[0043] In some cases, in response to receiving a first operation, the electronic device 110 presents a first element. The first element connects the first component and the second component of the creation area. The first element may be, for example, a connecting line, used to visually associate the first component with the second component, prompting the user that media content in the first component will be incorporated into the second component to form a corresponding segment. Figure 2B As shown, after the user completes the second operation in the first area, the electronic device 110 is connected to the second component 208 through the second end of the first element 210. Thus, Figure 2B intermediate state enter Figure 2C The connection is complete as shown, providing the component relationship basis for the presentation of the first segment.
[0044] Figure 2C A schematic diagram of the interface 200C after the first component is connected to the timeline component according to some scenarios is shown. For example... Figure 2C As shown, in response to the completion of the first operation, the electronic device 110 maintains the first element 210 between the first component 202 and the second component 208, and presents the first segment 214 on the first track of the second component 208. The first segment 214 corresponds to the first media content presented by the first component 202, and the connecting element and the segment thus express the same source relationship from the component layer and the track layer, respectively. In this way, the user can locate from the first component 202 to the second component 208 along the first element 210 and can directly identify the corresponding segment in the first track. The electronic device 110 can present the connecting element and the first segment 214 according to the same source relationship, so that the two interface objects update together with the associated state.
[0045] In some cases, a persistent referencing relationship exists between the first segment 214 and the first media content presented by the first component 202. Specifically, the first segment 214 may not be a copy of the first media content; the electronic device 110 can reference the first media content to present the first segment 214 corresponding to the first media content in the second component 208. When the media presented by the first component 202 is replaced, its duration is adjusted, or the first component 202 is deleted, the electronic device 110 can update the media pointer, displayed content, or duration of the downstream first segment 214 along this referencing relationship.
[0046] The reverse operation does not change the individual existence of the source component. When the user deletes the first segment 214 from the second component 208, the electronic device 110 removes the corresponding timeline representation, but the first component 202 and its first media content can still remain in the creation area.
[0047] The clip addition control 216 can serve as another entry point in the node view. When a user selects a media component in the authoring area using this control, subsequent processing can proceed along... Figures 2B to 2C The path shown establishes a connection; when the user selects content from local media or a collection of media resources, the electronic device 110 can directly generate a segment in the track.
[0048] If content in local media or a collection of media resources does not have a corresponding creation area component, the electronic device 110 will not display the connection element used to connect to the source component. This direct entry path and the path established through the source component can coexist, allowing the timeline component to receive both canvas media and media content that has not been nodeized.
[0049] Figure 2D A schematic diagram of an interface 200D is shown, illustrating how multiple video components can be accessed from the same timeline component under various conditions. This interface... Figure 2C A third component (e.g., component 204), a second element 218, a second fragment 220, and a preview component 222 are added to the first connection.
[0050] In some cases, a third component (e.g., component 204) can present second media content, and a second element 218 can be used to connect the third component (e.g., component 204) and the second component 208. The electronic device 110 also presents a second segment 220 corresponding to the second media content in the second component 208, and a preview of the current timeline content is presented by the preview component 222. In this way, users can aggregate media content from multiple components within a single timeline component and identify the source of each segment through different connection elements. The electronic device 110 updates the first segment 214 and the second segment 220 according to their source relationships, avoiding confusion regarding segment correspondences caused by multiple media sources sharing a single timeline component.
[0051] In some cases, based on the fact that the first type of the first media content is the same as the second type of the second media content, the electronic device 110 can present the second segment on the first track.
[0052] like Figure 2DAs shown, the first media content presented in the first component 202 and the second media content presented in the third component (e.g., component 204) are both video content. Accordingly, the electronic device 110 sequentially presents the first segment 214 and the second segment 220 on the first track, allowing segments of the same type to share the same time base and track operation area. In this way, the user can directly adjust the order and connection position of segments of the same type within the same track. The electronic device 110 can complete the time position update of two segments within a single track layout, thereby avoiding the need for unnecessary additional tracks and cross-track position calculations for content of the same type.
[0053] In some cases, the first element 210 and the second element 218 can be formed through separate connection operations or through a single batch operation. After the user selects the first component 202 and the third component (e.g., component 204), the first operation is triggered. The electronic device 110 reads the set of selected components and presents multiple elements for the two components in the set. These multiple elements include the first element 210 and the second element 218. In this way, the user can establish multiple source relationships with a single selection and a single association operation, reducing the repetitive steps of connecting media components one by one. The electronic device 110 can complete the presentation of multiple connection elements and corresponding segments within the same selection process, thereby reducing repetitive input event distribution and selection state switching.
[0054] In some cases, the second component may include a segment rendering area for presenting associated segments. The electronic device 110 can render the first and second segments in this area according to a first positional relationship, which is derived based on reference information associated with the first and third components. The reference information refers to information used to determine the positional relationship between multiple segments, and may indicate at least one of the spatial positional relationship between source components, selection order, or creation order. Figure 2D In a specific implementation, the segment rendering area can be provided by the first track of the second component 208, corresponding to the association information of the first component 202. In this way, users can obtain an arrangement result with a defined order when segments are added, reducing the need for re-sorting after the initial addition. The electronic device 110 uses reference information already associated with the source component to determine the segment order, thereby avoiding the segment position being determined solely by the asynchronous rendering sequence.
[0055] Reference information can indicate the second positional relationship between the first component 202 and the third component (e.g., component 204) in the creation area, or it can indicate the selection order or creation order of the two components. Taking spatial position as an example, the electronic device 110 can arrange the corresponding segments according to the relative order of the source components from left to right or from top to bottom; taking selection order or creation order as an example, the electronic device 110 can arrange the first segment 214 and the second segment 220 in the corresponding order.
[0056] In this way, the order of segments can be consistent with the component positions or operation order that the user has already perceived, reducing misunderstandings about the order. Electronic device 110 directly uses existing information in the component positions, selection states, or creation order to determine the arrangement result, thus eliminating the need for additional analysis of media screen content for the initial sorting.
[0057] Figure 2E A schematic diagram of an interface 200E is shown, illustrating how different types of media content are accessed via different tracks depending on various circumstances. This interface... Figure 2D A third element 224 is added to connect the third component (e.g., component 206), and a second segment 226 is added to the second component 208.
[0058] In some cases, based on the fact that the first type of the first media content is different from the second type of the second media content, the electronic device 110 can present the second segment on the second track of the second component.
[0059] like Figure 2E As shown, the video content presented by the first component 202 and the audio content presented by the third component (e.g., component 206) each correspond to different types of media content. The electronic device 110 can retain the first segment 214 on the first track and present the second segment 226 on the second track, depending on the media type. The second track can be an audio track, and the first track can be the main track. The second component 208 can present only the main track and the audio display line in the node view to maintain a compact appearance.
[0060] In this way, users can directly distinguish video and audio clips from their track positions and perform editing suitable for each type of content. Electronic device 110 assigns clips to corresponding tracks according to media type, ensuring that different types of clips do not have to share the same track layout and operating rules.
[0061] In some cases, electronic device 110 may receive a fifth operation to delete the first segment. In response to the second component no longer including a segment corresponding to the first media content, electronic device 110 may stop displaying the first element in the creation area.
[0062] Figure 2F A schematic diagram of interface 200F is shown, illustrating how it updates connection relationships after deleting partial fragments based on certain scenarios. Figure 2E In contrast, the video clips and connection elements corresponding to the third component (e.g., component 204) have stopped being displayed, while the first clip 214, the second clip 226, and their corresponding connection relationships are retained.
[0063] In a one-to-one relationship, one source component corresponds to only one segment in the second component 208. After receiving a fifth operation to delete the segment, the electronic device 110 removes the segment and stops presenting the corresponding connection element when the second component 208 no longer includes the segment of the corresponding source media.
[0064] In a one-to-many relationship, a source component can correspond to multiple segments within the same timeline component or different timeline components. After deleting one segment, the electronic device 110 checks whether any segments referencing the same source media still exist; the electronic device 110 only stops displaying the connection elements between the source component and the corresponding timeline component after all related segments have been deleted.
[0065] Deleting a downstream segment will not delete the upstream source component. Figure 2F The third component (e.g., component 204) can thus remain in the creation area. Conversely, when an upstream source component is deleted or its media content is changed, the electronic device 110 can delete or update all related downstream segments along the referencing relationship to keep the segment status consistent with the available sources.
[0066] In this way, users can adjust the timeline arrangement individually without losing the source media due to the deletion of segments. Electronic device 110 determines the visibility status of connected elements based on whether related segments still exist, avoiding the erroneous removal of still valid source hints when deleting only one segment in a one-to-many relationship.
[0067] In some cases, electronic device 110 may receive a fourth operation associated with the second component. In response to receiving the fourth operation, electronic device 110 may present fourth media content in the creation area. The fourth media content may be derived based on at least one segment of the second component, and the at least one segment may include the first segment.
[0068] Figure 2G A schematic diagram of an interface 200G is shown, illustrating output options for the timeline component based on various scenarios. This interface inherits... Figure 2F The fragment state is further presented on the side of the second component 208, and the output menu 228 is further presented.
[0069] After receiving the fourth operation associated with the second component 208, the electronic device 110 presents an output menu 228 and reads at least one segment from the second component 208. The electronic device 110 forms fourth media content based on the segments, including the first segment 214. This formation process can be performed locally by the electronic device 110 or assisted by the server 130 based on timeline descriptions and media references. In this way, users can directly form media results from the current arrangement of the timeline components without having to reselect and arrange the same media. The electronic device 110 reuses the segment order, track relationships, and media references in the timeline to initiate processing, thereby reducing the need for repeatedly constructing editing descriptions and repeatedly reading material relationships during the output stage.
[0070] In some cases, the fourth action can be triggered from the output entry point in the node view or from the output entry point in the expanded display state. Both entry points point to the same timeline content, allowing users to continue outputting content after completing a quick review or detailed editing.
[0071] The output of a single timeline component can be a media file or an archive of structured edit descriptions and referenced footage. The output can also include batch archives of referenced footage in the current timeline, or a chain of edit descriptions that can be parsed by compatible processing tools. The output methods are implemented using neutral data structures and compatible parsing relationships, independent of the name of any specific editing tool.
[0072] Multiple timeline components can also be selected for batch output. Batch output can generate multiple media files by default, or it can generate separate edit descriptions and material archives for each timeline component, making the results of multiple timelines distinguishable.
[0073] In some cases, electronic device 110 can present a fourth component and a third element in the creation area. The fourth component is used to present fourth media content, and the third element is used to connect the second and fourth components.
[0074] Figure 2H A schematic diagram is shown of an interface 200H formed by a timeline component to output media components according to certain scenarios. This interface represents... Figure 2G After the output operation is completed, the creation area further presents the state of the fourth component 230.
[0075] Electronic device 110 presents a fourth component 230 and a third element connecting the second component 208 and the fourth component 230 in the creation area. The fourth component 230 presents fourth media content derived from at least one segment of the second component 208, and the third element visually connects the timeline arrangement to the source relationship of the output result. In this way, the user can simultaneously see the timeline component and the media result formed by the timeline in the creation area and can confirm the source of the result along the third element. Electronic device 110 associates the output result with the second component 208, enabling the result state to be presented in the same creation area without having to jump to a result page that is disconnected from the source relationship.
[0076] In some cases, the fourth media content can also be presented in the preview component 222, instead of forming a separate fourth component 230. Figure 2H A specific example of nodeing the results and establishing visual source relationships is given. The preview rendering and the rendering of the result components can be adopted respectively according to the output purpose.
[0077] In some cases, electronic device 110 may present the first element in a third style and, upon receiving a sixth operation, present the first element in a fourth style. This processing can be used to switch another connecting element associated with the current operation target from a regular style to a highlighted style, thereby indicating the target relationship among multiple source relationships.
[0078] In some cases, the sixth operation may include at least one of the following: a trigger operation on the first component, a trigger operation on the second component, and a hover operation on the first element.
[0079] The following is for reference. Figures 3A to 3E This describes the process of viewing, highlighting, hiding, or focusing on the relationships between components based on existing relationships.
[0080] Figure 3A A schematic diagram of an interface 300A is shown, highlighting the connection relationships in response to the operation of the first component according to certain situations. The interface 300A presents a first component 302, a third component 304, an audio component 306, a first element 310, a second element 316, a first segment 312, a second segment 318, a segment addition control 314, and a preview component 320.
[0081] exist Figure 3A In the specific example shown, in response to a trigger operation on the first component 302, the electronic device 110 switches the first element 310 connected to the first component 302 to the fourth style. The first element 310 can be highlighted by increasing the line width, increasing the brightness, or changing the visual hierarchy, while connected elements not identified as targets retain the third style.
[0082] In this way, users can quickly identify the connection path associated with the component being operated on among multiple connection relationships. Electronic device 110 can update only the style state of the target connection element and continue to use the already maintained relationship information, thus without having to regenerate the connection element or reread the media content.
[0083] Figure 3B A schematic diagram of interface 300B is shown, which highlights connections in response to hovering over a first element, depending on certain circumstances. This interface follows... Figure 3A The components, fragments, and connection elements are indicated by a pointer to the first element 310, which is not individually numbered.
[0084] In such Figure 3B In the example shown, electronic device 110 can determine the first element 310 based on the indicator's position and switch the first element 310 to a highlighted style. After the indicator leaves the first element 310, electronic device 110 can revert to the normal style, ensuring the highlighted state aligns with the current operation target. In this way, users can view relationships by triggering components or hovering over connected elements, without relying on a single input path. Electronic device 110 maps different trigger inputs to style updates of connection relationships, enabling multiple input methods to reuse the same relationship lookup and local rendering processing.
[0085] Figure 3C A schematic diagram of an interface 300C is shown, which highlights multiple connections in response to an operating timeline component under certain circumstances. The electronic device 110 determines the source component connected to it based on the triggered timeline component, and switches the first element 310 and the second element 316 together to a highlighted style, while the reference relationship between the first segment 312 and the second segment 318 and the source media remains unchanged.
[0086] In some cases, electronic device 110 may receive a seventh operation, which configures the creation area to a first display mode. In response to receiving the seventh operation, electronic device 110 may stop displaying one or more elements connecting different components. One or more elements are used to connect different nodes in the creation area. In some cases, one or more elements may include the first element. The display mode refers to the interface layout state of the creation area or timeline components, and may include a mode that retains components and hides connecting elements, or a mode that highlights the preview area and track area.
[0087] Figure 3D A schematic diagram of an interface 300D is shown, in which the connecting elements are hidden in the first display mode according to certain situations.
[0088] like Figure 3DAs shown, the elements that stop being presented include the first element 310, and may also include the second element 316; the electronic device 110 still maintains the reference relationship corresponding to the connected elements so that the display can be restored after exiting the mode.
[0089] In this way, users can reduce the obstruction of media content and track areas by connecting lines when there are many components, without losing established relationships. In the first display mode, electronic device 110 omits the drawing of connecting graphics and retains relationship information, thereby reducing the number of graphical rendering objects on the current interface and eliminating the need to re-establish connections upon restoration.
[0090] Figure 3E A schematic diagram of interface 300E is shown, showing the timeline component in a focused or expanded display state depending on certain conditions.
[0091] exist Figure 3E In the specific example, the electronic device 110 prominently displays the preview component 320, the first segment 312, the second segment 318, and the segment addition control 314. The source media component may not be displayed, but this interface presentation is merely a form of focused layout; the first display mode does not require stopping the presentation of the source media component.
[0092] Once the timeline component is expanded, it displays the full main track and multiple audio tracks. Image and video clips can be added to the main track, while audio clips are added to the first audio track by default or can be moved to other audio tracks by the user.
[0093] In the expanded display state, the electronic device 110 can respond to operations by adding or deleting segments, adjusting segment boundaries, splitting segments, and dragging segments to change their order. The electronic device 110 can also respond to play or pause, timeline zoom, segment snapping and alignment, track mute, and undo or redo operations, and update the processing results to the current timeline data.
[0094] Playback allows the preview component 320 to present media content in the order of clips, while pause preserves the current playback position. Timeline scaling changes the time scale and clip display width, but does not alter the actual time relationship between clips; clip snapping and alignment allow moved clips to be placed closer to existing clip boundaries or time positions.
[0095] Track muting can change the participation status of the corresponding audio track during preview or output. Undo and redo can switch between editing states. Electronic device 110 can save each undo-enabled operation as a timeline state change and restore the corresponding segment position, boundary, or track state when performing undo or redo.
[0096] The expanded display also provides a media management area, where media sources can include media already referenced in the current timeline and media components in the creation area. When selecting media from the current timeline, users can locate existing clips; when selecting media from the creation area, they can generate new clips along existing component relationships or choose a direct ingress path.
[0097] The node view and the expanded display state use the same timeline content, and switching states does not require copying segments. After the user completes adding, deleting, splitting, sorting, or adjusting tracks in the expanded display state, the electronic device 110 re-presents the compact tracks based on the updated timeline content when returning to the node view.
[0098] Figure 3E The output entry and exit point in the text can also trigger the preceding text. Figure 2G Describes single or batch output, and can form Figure 2H The fourth component, 230, is shown. Therefore, after the timeline node is expanded, it not only supports detailed editing but also allows for subsequent operations such as previewing, media management, and result output.
[0099] Figure 4 A flowchart of an example process 400 for interface interaction is shown, based on some scenarios. Process 400 can be implemented at electronic device 110. See below for reference. Figure 4 To describe process 400.
[0100] like Figure 4 As shown, in box 410, electronic device 110 presents a first component in the creation area, and the first component presents the first media content. Its interactive presentation can be found above. Figure 2A The example described.
[0101] In frame 420, the electronic device 110, in response to receiving the first operation, presents a first element, which connects the first component and the second component of the creation area. Its interactive presentation can be seen above. Figure 2B and Figure 2C The example described.
[0102] In box 430, electronic device 110 presents a first segment on the first track of the second component, the first segment corresponding to the first media content. Its interactive presentation can be found above. Figure 2C The example described.
[0103] In this way, users can identify media sources, component relationships, and track clips within the same creation area and locate corresponding clips along connecting elements. Connecting elements and clips are presented together based on source relationships, enabling the electronic device 110 to update relevant interface objects in a targeted manner when relationships change. This reduces source verification steps and avoids repeated refreshes of unrelated components and clips.
[0104] In some scenarios, electronic device 110 can display a first control associated with the first component and, in response to a trigger operation, display a first element whose first end is connected to the first component. Electronic device 110 can also receive a second operation and connect the second end of the first element to a second component. For specific interactive presentation details, please refer to the above. Figure 2B and Figure 2C The example described illustrates this. In this way, the user is able to initiate a connection from a clearly defined entry point and identify the connection origin. The electronic device 110 processes connection movement input only after the entry point is triggered, thereby reducing connection drawing caused by irrelevant movement input.
[0105] In some cases, the electronic device 110 may display an indicator in the creation area to indicate the operation position, and cause the second end of the first element to move with the indicator. The electronic device 110 may also receive a second operation to move the indicator to a first area, which corresponds to the second component. Specific interactive presentations can be found above. Figure 2B The example described illustrates this. In this way, the user can continuously observe the location of the connection point and correct the target. The electronic device 110 updates the local connection graph based on the location input, thereby avoiding the generation of invalid segments before connection confirmation.
[0106] In some cases, the electronic device 110 may first present the second component in a first style, and then present the second component in a second style after the indicator moves to the first area. For specific interactive presentation details, please refer to the above. Figures 2A to 2C The example described illustrates this. In this way, users can confirm whether the second component is the current target before completing the connection, reducing erroneous connections. Electronic device 110 first updates the display properties of the target component and generates a fragment after connection confirmation, thereby reducing the creation and undoing of invalid fragments.
[0107] In some cases, electronic device 110 can present a second element connecting the third component and the second component, with the third component presenting second media content. Electronic device 110 can also present a second segment corresponding to the second media content within the second component. For specific interactive presentation details, please refer to the above. Figure 2D and Figure 2E The example described illustrates this. In this way, users can organize multiple source media within a single timeline component and identify the source of each segment individually. Electronic device 110 updates corresponding connection elements and segments according to source relationships, thereby reducing association confusion when multiple sources coexist.
[0108] In some cases, the first type of the first media content can be the same as the second type of the second media content. The electronic device 110 can present the second segment on the first track, placing the first and second segments on the same track. For specific interactive presentation details, please refer to the above. Figure 2DThe example described illustrates this. In this way, users can adjust segments of the same type within the same timeframe. Electronic device 110 can reuse a single track layout to update two segments, thereby reducing additional track objects and cross-track position calculations.
[0109] In other cases, the first type of the first media content may differ from the second type of the second media content. The electronic device 110 may present the second segment on the second track of the second component. For specific interactive presentation details, please refer to the above. Figure 2E The example described illustrates this. In this way, users can distinguish different types of media segments based on their track position and perform corresponding edits accordingly. The electronic device 110 presents segments by type on separate tracks, thereby reducing conflicting judgments between different media processing rules on the same track.
[0110] In some cases, electronic device 110 can receive a third operation for selecting both the first and third components. The electronic device can also present multiple elements in response to the first operation. These multiple elements may include a first element and a second element. In this way, the user can establish multiple connections with a single selection and association operation. Electronic device 110 can generate multiple relationship objects within a single selection process, thereby reducing repetitive event distribution and selection state switching.
[0111] In some cases, the electronic device 110 can present a first segment and a second segment in the segment presentation area of the second component according to a first positional relationship. The first positional relationship can be obtained based on reference information associated with the first and third components. As a specific implementation, the segment presentation area can be associated with a first track of the second component. Specific interactive presentation details can be found above. Figure 2D The example described illustrates this. In this way, the user can obtain a definite order when fragments are added. The electronic device 110 sets the fragment positions according to the associated reference information, thereby avoiding fragment swapping caused by asynchronous rendering.
[0112] In some cases, reference information can indicate at least one of the following: the secondary positional relationship between the first and third components in the creation area, the selection order of the two components, or the creation order of the two components. For specific interactive presentation details, please refer to the above text. Figure 2D The example described illustrates this. In this way, the arrangement of segments can be consistent with the spatial location or operational sequence already perceived by the user. Electronic device 110 uses existing component information to determine the arrangement result, thus eliminating the need for additional analysis of media screen content for the initial sorting.
[0113] In some cases, electronic device 110 can receive a fourth operation associated with the second component and present fourth media content. The fourth media content can be obtained based on at least one segment of the second component, and at least one segment includes the first segment. Specific interactive presentation can be found above. Figure 2G and Figure 2H The example described illustrates this. In this way, users can directly create media results from the current timeline. Electronic device 110 reuses segment order, track relationships, and media references to initiate processing, thereby reducing the need for repetitive construction of edit descriptions at the output stage.
[0114] In some scenarios, electronic device 110 can present a fourth component and a third element within the creation area. The fourth component presents fourth media content, and the third element connects the second and fourth components. For specific interactive presentation details, please refer to the above. Figure 2H The example described illustrates this. In this way, users can simultaneously view the timeline and output results within the creation area and confirm the source of the result along a third element. The electronic device 110 presents the source relationship within the same interface state, thereby reducing page switching and reloading of the relationship context.
[0115] In some cases, electronic device 110 can receive a fifth operation to delete the first segment. In response to the second component not containing a segment corresponding to the first media content, electronic device 110 stops presenting the first element; if the corresponding segment still exists, electronic device 110 continues to present the first element. For specific interactive presentation details, please refer to the above. Figure 2E and Figure 2F The example described illustrates this. In this way, when a user deletes a downstream fragment, the source component is not deleted, and the one-to-many relationship does not prematurely lose its visual connection. Electronic device 110 determines the state of the connection element based on the remaining references, thereby avoiding unnecessary connection rebuilding.
[0116] In some cases, electronic device 110 can present the first element in a third style and, in response to a sixth operation, present the first element in a fourth style. The target connected element can also be determined as the first element based on the current operation object, or as multiple elements associated with the same timeline component. For specific interactive presentation details, please refer to the above. Figures 3A to 3C The example described illustrates this. In this way, users can identify the currently relevant path among multiple links. Electronic device 110 only updates the style state of the target element, thus avoiding the need to regenerate link objects and media previews.
[0117] In some cases, the sixth action may include at least one of the following: a trigger action on the first component, a trigger action on the second component, or a hover action on the first element. For specific interaction rendering, please refer to the above text. Figures 3A to 3CThe example described illustrates this. In this way, users can access relationship viewing states through components or connecting elements, without being limited to a single input entry point. Electronic device 110 maps different trigger inputs to the same relationship query and style update process, thereby reducing repetitive interactive state processing.
[0118] In some cases, electronic device 110 may receive a seventh operation for configuring the creation area to a first display mode. Electronic device 110 then stops displaying one or more elements connecting different nodes, including the first element. For specific interactive presentation details, please refer to the above. Figure 3D and Figure 3E The example described illustrates this. In this way, users can reduce the occlusion of connecting elements on component and track content while preserving existing relationships. Electronic device 110 omits the current drawing of the connecting graph and preserves relationship information, thereby reducing the number of rendered objects and avoiding the need to re-establish connections when the display resumes.
[0119] A corresponding apparatus for implementing the above methods or processes is also provided.
[0120] Figure 5 A block diagram of a user interface interaction device 500 is shown for some scenarios. Device 500 can be implemented as or included in electronic device 110. The various modules in device 500 can be implemented by hardware, software, firmware, or any combination thereof.
[0121] like Figure 5 As shown, the device 500 includes a first presentation module 510, a second presentation module 520, and a third presentation module 530. The first presentation module 510 is configured to present a first component in the creation area, the second presentation module 520 is configured to present a first element connecting the first component and the second component in response to a first operation, and the third presentation module 530 is configured to present a first segment corresponding to the first media content on a first track of the second component.
[0122] In some cases, the second presentation module 520 may also be configured to present a first control associated with the first component and to present a first element in response to the triggering of the first control. The second presentation module 520 may also be configured to receive a second operation and connect a second end of the first element to the second component.
[0123] In some cases, the second presentation module 520 may also be configured to present an indicator in the creation area and move the second end of the first element with the indicator. The second presentation module 520 may also be configured to receive a second operation for moving the indicator to a first area, which corresponds to the second component.
[0124] In some cases, the second presentation module 520 can also be configured to present the second component in a first style. In response to an indicator moving to the first area, the second presentation module 520 can also be configured to present the second component in a second style.
[0125] In some cases, the first presentation module 510 can also be configured to present a third component, which presents the second media content. The second presentation module 520 can also be configured to present a second element connecting the third component and the second component, and the third presentation module 530 can also be configured to present a second segment corresponding to the second media content in the second component.
[0126] In some cases, the first type of the first media content can be the same as the second type of the second media content. The third presentation module 530 can also be configured to present the second segment on the first track.
[0127] In other cases, the first type of the first media content may differ from the second type of the second media content. The third presentation module 530 may also be configured to present the second segment on the second track of the second component.
[0128] In some cases, the second presentation module 520 may also be configured to receive a third operation for selecting the first component and the third component. The second presentation module 520 may also be configured to present multiple elements in response to the first operation, including the first element and the second element.
[0129] In some cases, the third presentation module 530 may also be configured to present the first and second segments in the segment presentation area of the second component according to a first positional relationship. The first positional relationship is obtained based on reference information associated with the first and third components, and the segment presentation area may be associated with a first track of the second component.
[0130] In some cases, reference information may indicate at least one of the following: the second positional relationship between the first and third components in the creation area, the selection order of the two components, or the creation order of the two components.
[0131] In some cases, the first presentation module 510 may also be configured to present fourth media content in response to a fourth operation associated with the second component. The fourth media content is derived based on at least one segment from the second component, the at least one segment including the first segment.
[0132] In some cases, the first presentation module 510 can also be configured to present a fourth component in the creation area, the fourth component presenting fourth media content. The second presentation module 520 can also be configured to present a third element connecting the second and fourth components.
[0133] In some cases, the third presentation module 530 can also be configured to delete the first segment in response to a fifth operation. In response to the second component not including a segment corresponding to the first media content, the second presentation module 520 can also be configured to stop presenting the first element.
[0134] In some cases, the second presentation module 520 can also be configured to present the first element in a third style. In response to receiving a sixth operation, the second presentation module 520 can also be configured to present the first element in a fourth style.
[0135] In some cases, the sixth operation may include at least one of a trigger operation on the first component, a trigger operation on the second component, or a hover operation on the first element.
[0136] In some cases, the second presentation module 520 can also be configured to configure the creation area to the first display mode in response to the seventh operation. The second presentation module 520 can also be configured to stop presenting one or more elements connecting different nodes, including the first element.
[0137] The modules included in device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some cases, one or more modules can be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 500 can be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard parts (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and so on.
[0138] Figure 6 A block diagram of an electronic device 600 in which one or more examples may be implemented is shown. It should be understood that... Figure 6 The electronic device 600 shown is merely exemplary and should not be construed as limiting the functionality and scope of the examples described herein. Figure 6 The illustrated electronic device 600 can be used to implement the electronic device 110 discussed above.
[0139] like Figure 6 As shown, electronic device 600 is in the form of a general-purpose electronic device. Components of electronic device 600 may include, but are not limited to, one or more processing units or processors 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processor 610 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 620. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 600.
[0140] Electronic device 600 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 620 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof). Storage device 630 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 600.
[0141] Electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 6 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 620 may include computer program product 625 having one or more program modules configured to perform various methods or actions of various examples.
[0142] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 600 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 600 can operate in a networked environment using logical connections to one or more other servers, networked personal computers, or another network node.
[0143] Input device 650 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 660 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 600 can also communicate with one or more external devices (not shown) via communication unit 640 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 600, or with any device that enables electronic device 600 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via an input / output (I / O) interface (not shown).
[0144] A computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. A computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.
[0145] The flowcharts and / or block diagrams of the methods, apparatus, devices, and computer program products referred to herein describe various aspects. It should be understood that each block of the flowcharts and / or block diagrams, as well as combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer-readable program instructions.
[0146] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0147] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0148] The flowcharts and block diagrams in the accompanying figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products under various scenarios. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the figures. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0149] Various examples have been described above. The foregoing descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.
Claims
1. A method for interface interaction, comprising: The first component is presented in the creation area, and the first component presents the first media content; In response to receiving a first operation, a first element is presented, the first element connecting the first component and a second component of the creation area; as well as In the first track of the second component, a first segment is presented, the first segment corresponding to the first media content.
2. The method of claim 1, wherein presenting the first element comprises: Present a first control, which is associated with the first component; In response to a trigger operation on the first control, the first element is rendered, and the first end of the first element is connected to the first component; as well as Receive a second operation, the second operation being used to connect a second end of the first element to the second component.
3. The method of claim 2, wherein receiving the second operation comprises: In the creation area, an indicator is presented to indicate the operation position, and the second end of the first element moves with the indicator; as well as The second operation is received, which is used to move the indicator to a first region, the first region corresponding to the second component.
4. The method according to claim 3, further comprising: The second component is presented in the first style; as well as In response to the indicator moving to the first area, the second component is presented in a second style.
5. The method according to claim 1, further comprising: In the creation area, a second element is presented, which connects the third component and the second component, and the third component presents the second media content; as well as In the second component, a second segment is presented, which corresponds to the second media content.
6. The method of claim 5, wherein the first type of the first media content is the same as the second type of the second media content, and the presentation of the second segment comprises: The second segment is presented on the first track.
7. The method of claim 5, wherein the first type of the first media content is different from the second type of the second media content, and the presentation of the second segment comprises: The second segment is presented on the second track of the second component.
8. The method of claim 5, wherein presenting the second element comprises: Receive a third operation, the third operation being used to select the first component and the third component; as well as In response to receiving the first operation, multiple elements are presented, including the first element and the second element.
9. The method according to claim 8, further comprising: In the second component, the first segment and the second segment are presented according to a first positional relationship, wherein the first positional relationship is obtained based on reference information associated with the first component and the third component.
10. The method of claim 9, wherein the reference information indicates at least one of the following: The second positional relationship is the positional relationship between the first component and the third component in the creative area; The selection order of the first component and the third component; The order in which the first component and the third component were created.
11. The method of claim 1, further comprising: Receive a fourth operation, which is associated with the second component; as well as A fourth media content is presented, which is derived from at least one segment of the second component, the at least one segment including the first segment.
12. The method of claim 11, wherein presenting the fourth media content comprises: In the creation area, a fourth component and a third element are presented. The fourth component presents the fourth media content, and the third element is used to connect the second component and the fourth component.
13. The method of claim 1, further comprising: Receive a fifth operation, the fifth operation being used to delete the first segment; as well as In response to the second component not including a segment corresponding to the first media content, the rendering of the first element is stopped.
14. The method of claim 1, further comprising: The first element is presented in a third style; as well as In response to receiving the sixth operation, the first element is rendered in the fourth style.
15. The method of claim 14, wherein the sixth operation comprises at least one of the following: Triggering operation on the first component; Triggering operation on the second component; Hover operation on the first element.
16. The method of claim 1, further comprising: Receive a seventh operation, the seventh operation being used to configure the creation area as a first display mode; as well as Stop displaying one or more elements in the creation area, the one or more elements being used to connect different nodes in the creation area, the one or more elements including the first element.
17. A device for interface interaction, comprising: The first presentation module is configured to present a first component in the creation area, and the first component presents first media content. The second presentation module is configured to present a first element in response to receiving a first operation, the first element connecting the first component and the second component of the creation area; as well as A third presentation module is configured to present a first segment on a first track of the second component, the first segment corresponding to the first media content.
18. An electronic device, comprising: At least one processor; as well as At least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processor.
19. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 16.
20. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 16.
