Interface interaction method and apparatus, and device, storage medium and program product

Abstract

According to the embodiments of the present disclosure, provided are an interface interaction method and apparatus, and a device, a storage medium and a program product. The method comprises: presenting an editing interface for media content, wherein the editing interface at least comprises a video track and a first element associated with a first media resource, the first element is associated with a scope of action of the first media resource, a start point of the scope of action corresponds to a first position in the video track, and an end point of the scope of action corresponds to a second position in the video track; in response to having received a first instruction, moving the video track in the editing interface; and in response to the first position being outside a first area of the editing interface and the second position being within the first area thereof, maintaining the display of the first element in the second area of the editing interface without moving with the video track.

Description

Methods, apparatus, devices, storage media, and program products for user interface interaction

[0001] This application claims priority to Chinese Patent Application No. 202411747200.3, filed on November 29, 2024, entitled "Method, Apparatus, Device, Storage Medium and Program Product for Interface Interaction", the entire contents of which are incorporated herein by reference. Technical Field

[0002] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatuses, devices, computer-readable storage media, and computer program products for interface interaction. Background Technology

[0003] With the development of computer technology, more and more users are creating and sharing media content through internet platforms. During the creation of media content, various types of media resources (such as special effects, filters, video animations, subtitles, and stickers) can assist users in creating richer media content and improving the overall quality of the content. Summary of the Invention

[0004] In a first aspect of this disclosure, a method for interface interaction is provided. The method includes: presenting an editing interface for media content, wherein the editing interface includes at least a video track and a first element associated with a first media resource, the first element being associated with a scope of the first media resource, the starting point of the scope corresponding to a first position in the video track, and the ending point of the scope corresponding to a second position in the video track; moving the video track in the editing interface in response to receiving a first instruction; and maintaining the first element displayed in a second area of ​​the editing interface, without moving with the video track, in response to the first position being outside a first area of ​​the editing interface and the second position being within a first area.

[0005] In a second aspect of this disclosure, an apparatus for interface interaction is provided. The apparatus includes: a first presentation module configured to present an editing interface of media content, wherein the editing interface includes at least a video track and a first element associated with a first media resource, the first element being associated with a range of influence of the first media resource, the start point of the range corresponding to a first position in the video track, and the end point of the range corresponding to a second position in the video track; a first movement module configured to move the video track in the editing interface in response to receiving a first instruction; and a first display module configured to maintain the first element displayed in a second area of ​​the editing interface, without moving with the video track, in response to the first position being outside a first area of ​​the editing interface and the second position being within the first area.

[0006] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. When executed by the at least one processor, the instructions cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores computer-executable instructions that can be executed by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of this disclosure, a computer program product is provided. The computer program product is tangibly stored in a computer storage medium and includes computer-executable instructions that, when executed by a device, cause the device to perform the method of the first aspect.

[0009] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0010] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0011] Figure 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0012] Figure 2 shows a schematic diagram of an example interactive interface according to some embodiments of the present disclosure;

[0013] Figures 3A and 3B show schematic diagrams illustrating elements according to some embodiments of the present disclosure;

[0014] Figures 4A and 4B show schematic diagrams illustrating another element display according to some embodiments of the present disclosure;

[0015] Figure 5 shows a schematic diagram of a multi-element display according to some embodiments of the present disclosure;

[0016] Figure 6 illustrates a schematic diagram of a multi-element holding display according to some embodiments of the present disclosure;

[0017] Figure 7 illustrates a schematic diagram of the synchronous movement of multiple elements according to some embodiments of the present disclosure;

[0018] Figures 8A and 8B show schematic diagrams of element selection according to some embodiments of the present disclosure;

[0019] Figure 9 illustrates a flowchart of a user interface interaction process according to some embodiments of the present disclosure;

[0020] Figure 10 shows a schematic structural block diagram of a device for interface interaction according to certain embodiments of the present disclosure;

[0021] Figure 11 shows a block diagram of an electronic device capable of implementing several embodiments of the present disclosure. Detailed Implementation

[0022] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0023] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0024] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0025] The embodiments of this disclosure may involve user data, data acquisition, and / or use. All of these aspects comply with applicable laws, regulations, and relevant provisions. In the embodiments of this disclosure, all data collection, acquisition, processing, manipulation, forwarding, and use are conducted with the user's knowledge and confirmation. Accordingly, in implementing the embodiments of this disclosure, the type, scope of use, and usage scenarios of any data or information that may be involved should be communicated to the user and their authorization obtained in accordance with relevant laws and regulations through appropriate means. The specific methods of notification and / or authorization may vary depending on the actual situation and application scenario, and the scope of this disclosure is not limited in this respect.

[0026] In this specification and the embodiments, any processing of personal information will be carried out only under the premise of legality (such as obtaining the consent of the personal information subject, or being necessary for the performance of a contract), and will only be carried out within the scope stipulated or agreed upon. A user's refusal to process personal information other than that necessary for basic functions will not affect the user's use of basic functions.

[0027] As described above, electronic devices can typically generate better-quality media content based on user editing operations on media content and media resources within the editing interface. For example, users can select media resources provided by the electronic device to assist in editing media content. It should be understood that media resources can be used to create digital content, including but not limited to audio, video animation, subtitles, sticker elements, picture-in-picture, special effects, and other types of resources.

[0028] In some scenarios, users will interact with the interface in an editing interface that includes multiple tracks, such as the main track indicating video, the video animation track indicating video animation, the audio track indicating audio, etc. Users can adjust each track individually to adjust the appearance time and duration of the media content / media resources indicated by each track.

[0029] To improve creative results, users often need to frequently adjust various tracks, which severely impacts the efficiency of editing media content / resources. Furthermore, manual operation increases the likelihood of problems such as illogical pacing and poor image quality due to the inherent errors.

[0030] Therefore, traditional technologies still face significant challenges in terms of editing efficiency and accuracy when editing media content.

[0031] In view of this, embodiments of the present disclosure propose a user interface interaction scheme. According to this scheme, an editing interface for media content can be presented, wherein the editing interface includes at least a video track and a first element associated with a first media resource. The video track corresponds to the image information of the media content, and the first element is associated with the scope of the first media resource, the scope corresponding to a first position and a second position in the video track. Further, in response to receiving a first instruction, the video track in the editing interface can be moved. Further, in response to the first position being outside a first area of ​​the editing interface and the second position being within a first area, the first element can be displayed in a second area of ​​the editing interface without moving with the video track.

[0032] Based on this approach, embodiments of this disclosure can associate the first element associated with the first media resource with the video track, thereby ensuring synchronization between the first media resource and the media content and more accurately perceiving the scope of the media resource. Furthermore, embodiments of this disclosure, when the first position corresponding to the scope of the first media resource exceeds a first area of ​​the editing interface, and the second position does not exceed that first area, maintain the first element associated with the first media resource displayed in the media interface. This allows the editing interface to more accurately present the scope and identification information of the first media resource, thereby improving the efficiency of information retrieval in the editing interface and the efficiency of editing operations related to the media resource.

[0033] Therefore, embodiments of this disclosure can more accurately perceive the scope of a media resource based on the presentation of a first element associated with it. Furthermore, by controlling the display state of the first element, embodiments of this disclosure can also improve the efficiency of editing operations related to media resources.

[0034] Example Environment

[0035] Figure 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in Figure 1, the example environment 100 may include an electronic device 110.

[0036] In this example environment 100, an application 120 is installed on an electronic device 110. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices. The application 120 can be an application that supports editing media content, such as a video editing application, or any other suitable application.

[0037] In environment 100 of Figure 1, if application 120 is active, application 120 can provide a presentation interface 150 for user 140.

[0038] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0039] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 that support content presentation in electronic devices 110.

[0040] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus, and Wi-Fi connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0041] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0042] The following description will continue with reference to the accompanying drawings, which will provide some exemplary embodiments of this disclosure.

[0043] Example interactive interface

[0044] The following description refers to FIG2, which illustrates an example interaction process according to an embodiment of the present disclosure. FIG2 shows a schematic diagram of an example interactive interface 200 according to some embodiments of the present disclosure, which may be provided, for example, by the electronic device 110 shown in FIG1.

[0045] As shown in Figure 2, the electronic device 110 may present an interactive interface 200 (media content editing interface). For ease of understanding, this disclosure uses video as an example of media content and picture-in-picture material as an example of media resources for illustrative purposes.

[0046] Based on this, the interactive interface 200 can display a video preview area 210. The preview area 210 displays, for example, videos uploaded by the user, videos selected from video footage, videos edited from video footage, etc. The interactive interface 200 can also display a video editing track, i.e., a video track 220. For example, the video track 220 can contain video thumbnails corresponding to the videos displayed in the preview area 210. The electronic device 110 can move the video track based on the user's sliding operations on the video track, playback operations on media content, etc., allowing the user to view media content (e.g., video frames) at various moments.

[0047] The interactive interface 200 can also display a first element 231 associated with the first media resource 211211, and the first element 231 is associated with the scope of the first media resource 211. For example, as shown in Figure 2, the first media resource 211 operates at a first position 241 (00:02) and a second position 242 (00:06) of the video track 220, and the first element 231 can be attached to the first position 241 of the video track 220 and displayed.

[0048] In some embodiments, the electronic device 110 may also present an indicator element 232 corresponding to such a scope of action. It should be understood that the shape, style, size, etc., of specific elements in this disclosure can be reasonably set, and this disclosure does not limit this. For example, the first element can be drawn using a shape layer through a Bézier curve path, adding such a mask to a square image view and being drawn.

[0049] The interactive interface 200 may also include one or more controls for editing the video corresponding to the video track 220. For example, the interactive interface 200 may also include controls for "music", "text", "effects", "picture-in-picture", "filters", etc., or other implementable controls, such as controls indicating "color adjustment", controls indicating "rotation", etc.

[0050] The interactive interface 200 may also include a control 250 indicating "play" to control the playback of media content. Based on the playback of the media content, the electronic device can generate a first command to control the movement of the video track 220.

[0051] In some embodiments, a user can trigger a sliding operation on the video track 220 to slide it left or right. The electronic device 110 can then receive a corresponding first instruction to move the video track 220 in response to the user's sliding motion. The first element 231 and the indicator element 232 can be displayed in different display states based on the movement of the video track 220.

[0052] Example of keeping a single element displayed

[0053] For ease of description, the process of maintaining the display of example elements according to embodiments of the present disclosure is described below with reference to Figures 3A and 3B. Figures 3A and 3B show schematic diagrams of element display according to some embodiments of the present disclosure, and the schematic diagrams 300A and 300B shown in Figures 3A and 3B may be part of the content of the interactive interface 200.

[0054] As shown in Figure 3A, the video track 220 is moved to the left. The first position 241 is moved to the point of exceeding the first area of ​​the interactive interface 200, while the second position 242 does not exceed the first area of ​​the interactive interface 200. Based on this, the electronic device 110 can keep the first element 231 displayed in the second area of ​​the interactive interface 200.

[0055] As examples, a first region may indicate a location within the interactive interface 200. For instance, if a first position is located within the first region, the first element 231 corresponding to the first position may be within the interactive interface 200 and may not touch the boundary of the interactive interface 200. A second region may indicate a boundary region of the interactive interface 200. For instance, if the first element 231 is located within the second region, the first element may touch the boundary of the interactive interface 200.

[0056] As shown in Figure 3B, the video track 220 is further moved to the left, the first position 241 is moved beyond the first area of ​​the interactive interface 200, while the second position 242 does not exceed the first area of ​​the interactive interface 200. Based on this, the electronic device 110 continues to display the first element 231 in the second area of ​​the interactive interface 200.

[0057] In some embodiments, maintaining the display of the first element can be achieved through a layout manager. Specifically, the electronic device 110 can obtain media resource information from the interactive interface 200. The electronic device 110 uses a layout calculator to calculate the position and size of each media resource and caches such layout information. Further, the electronic device constructs a corresponding media resource view for each media resource. Thus, the electronic device 110 can set a first priority if the left boundary of the element view of the first element 231 in the media resource view is greater than or equal to the left boundary box of the interactive interface 200. Based on the triggering of the first priority, the electronic device 110 can maintain the display of the first element 231 in the first area.

[0058] Example of synchronized movement of a single element

[0059] The process of synchronous movement of elements according to embodiments of the present disclosure is described below with reference to Figures 4A and 4B. Figures 4A and 4B show schematic diagrams of another element display according to some embodiments of the present disclosure, and the schematic diagrams 400A and 400B shown in Figures 4A and 4B may be part of the content of the interactive interface 200.

[0060] In some embodiments, as shown in FIG4A, during the process of the video track 220 being moved to the left, the first position 241 does not exceed the first area of ​​the interactive interface 200. Based on this, the electronic device 110 can synchronously move the video track and the first element 231 according to the aforementioned first instruction, so that the first element 231 can correspond to the first position 241.

[0061] In some embodiments, as shown in FIG4B, during the process of the video track 220 being moved to the left, both the first position 241 and the second position 242 are close to exceeding / exceeding the first area of ​​the interactive interface. Based on this, the electronic device 110 can also synchronously move the video track and the first element 231 according to the aforementioned first instruction, so that the first element 231 can correspond to the second position 242. Furthermore, the electronic device 110 can stop displaying the portion of the first element 231 that exceeds the editing interface.

[0062] In some embodiments, the synchronous movement of the first element can also be achieved through a layout manager. Specifically, following the example above, the electronic device 110 can set a second priority for the case where the right boundary of the element view of the first element 231 does not exceed the right border of the media resource video. The second priority is higher than the first priority. Thus, based on the triggering of the second priority, the electronic device 110 can synchronously move the video track and the first element 231 so that the first element 231 corresponds to the second position 242.

[0063] Example of multiple elements overlapping display

[0064] In some embodiments, when there is no overlapping area, each of the multiple elements associated with multiple media resources can be displayed / moved synchronously in accordance with the specific implementation of the single element described above. When there is an overlapping area, the multiple elements can be displayed with reference to at least the hierarchy of the multiple elements.

[0065] The following description refers to FIG5 to illustrate the display state of multiple elements corresponding to multiple media resources according to embodiments of the present disclosure. FIG5 shows a schematic diagram of the display of multiple elements according to some embodiments of the present disclosure, and the schematic diagram 500 shown in FIG5 may be a part of the content of the interactive interface 200.

[0066] As shown in Figure 5, the interactive interface 200 can display a second element 261 associated with the second media resource. The first element 231 and the second element 261 overlap at least partially. Thus, the electronic device 110 can compare the hierarchy of the first media resource in the media content and the size relationship between the hierarchical levels of the first media resource in the media content.

[0067] For example, as shown in Figure 5, taking the first media resource as having a higher hierarchy as an example, the electronic device 110 can hide the overlapping portion of the second element 261 with the first element 231, while the first element 231 is displayed normally. Thus, users can more conveniently obtain the hierarchy of the first and second media resources within the media content from the interactive interface.

[0068] Example of keeping multiple elements displayed

[0069] In some embodiments, the electronic device 110 can determine the number of elements in the editing interface that are kept in the display state; and based on such a number, determine the offset of the second region from a preset boundary of the editing interface. In this way, embodiments of the present disclosure can still present a portion of the content of each element even when multiple elements are kept in the display state, thereby further improving the efficiency of the user obtaining information from the interactive interface.

[0070] The process of maintaining the display of multiple elements corresponding to multiple media resources according to embodiments of the present disclosure is described below with reference to FIG6. FIG6 shows a schematic diagram of maintaining the display of multiple elements according to some embodiments of the present disclosure. The schematic diagram 600 shown in FIG6 can be the principle of part of the content of the interactive interface 200.

[0071] As shown in Figure 6, taking the first element 231 as an example, based on the above embodiment, the electronic device 110 determines that the second element 261, the third element 271, and the fourth element 281 have been maintained at the boundary position of the interactive interface 200.

[0072] Therefore, based on the number 3 elements already displayed in the interactive interface 200, the electronic device 110 can determine the offset of the second area to be displayed by the first element 231 from the left boundary (preset boundary, taking the left boundary as an example) of the editing interface as 3*x. As an example, x can be the offset of the second area corresponding to each element, and this disclosure does not limit the specific value of this value.

[0073] In some embodiments, the electronic device 110 can also sort and display multiple elements based on the hierarchy of media resources corresponding to the elements, with higher levels closer to the preset boundaries of the interactive interface. As an example, still as shown in Figure 6, the hierarchy order of the media resources corresponding to the first element 231, the second element 261, the third element 271, and the fourth element 281 is first element 231 < second element 261 < third element 271 < fourth element 281. Thus, the electronic device 110 can present these elements based on this hierarchical order.

[0074] In some embodiments, the implementation of such sustained display of multiple elements can also be based on a layout manager. Specifically, the electronic device 110 can acquire the media resource views presented in the interactive interface 200 at the current time and position during the track sliding process. Further, the electronic device 110 can filter out the media resource views that are currently in a sustained display state from the media resource views presented in the interactive interface 200. Moreover, the electronic device 110 can sort according to the hierarchy of the corresponding media resources, thereby determining the display position of multiple elements in the interactive interface 200 that are sustained display based on the hierarchical order, so as to display these elements.

[0075] Example of synchronized movement of multiple elements

[0076] In some embodiments, when multiple elements are kept on display, the video track 220 is moved continuously. Taking the first element 231 as an example, in response to the second position 241 corresponding to the first element 231 being moved to the second area, the electronic device 110 can cancel the kept display state of the first element and move the video track 220 and the first element 231 simultaneously to stop displaying the part of the first element 231 that exceeds the editing interface.

[0077] As examples, the process of synchronous movement of at least one element among multiple elements corresponding to multiple media resources according to embodiments of the present disclosure is described below with reference to FIG7. FIG7 shows a schematic diagram of synchronous movement of multiple elements according to some embodiments of the present disclosure, and the schematic diagram 700 shown in FIG7 can be the principle of part of the content of the interactive interface 200.

[0078] As shown in Figure 7, in response to the second position 241 in the second region, that is, the second position 241 outside the first region, the video track 220 and the first element 231 are moved synchronously to correspond the first element 231 to such a second position.

[0079] In some embodiments, the first element 231 can still present the display style during the movement process based on the hierarchical relationship between the first element 291 and the first element 231, that is, the overlapping area with the element 291 is not displayed.

[0080] Therefore, the embodiments of this disclosure can more accurately present the synchronization relationship between the video track and various media resources, thereby further improving the efficiency of obtaining information from the interactive interface 200.

[0081] Example element selected

[0082] The following description refers to Figures 8A and 8B to illustrate an example element selection process according to an embodiment of the present disclosure. Figures 8A and 8B show schematic diagrams of element selection according to some embodiments of the present disclosure, and processes 800A and 800B can be the selection principle of a portion of the content of the interactive interface 200.

[0083] As shown in Figure 8A, when there is only one element corresponding to region 810, electronic device 110 determines the element 821 corresponding to region 810 based on the selected region 810, without considering the hierarchy of each element. When there are multiple elements corresponding to region 810, electronic device 110 can determine the element to be selected based on the hierarchy of each element.

[0084] Furthermore, the size of the interactive area is larger than the display size of the first element. As an example, as shown in Figure 8B, the size 831 of the response area (interactive area) corresponding to element 821 can be larger than the display size 841 of element 821. Therefore, the electronic device 110 can reduce the difficulty of selecting elements and further improve the efficiency of user interaction with the interface.

[0085] Based on this approach, embodiments of this disclosure can associate the first element associated with the first media resource with the video track, thereby ensuring synchronization between the first media resource and the media content and more accurately perceiving the scope of the media resource. Furthermore, embodiments of this disclosure, when the first position corresponding to the scope of the first media resource exceeds a first area of ​​the editing interface, and the second position does not exceed that first area, maintain the first element associated with the first media resource displayed in the media interface. This allows the editing interface to more accurately present the scope and identification information of the first media resource, thereby improving the efficiency of information retrieval in the editing interface and the efficiency of editing operations related to the media resource.

[0086] Therefore, embodiments of this disclosure can more accurately perceive the scope of a media resource based on the presentation of a first element associated with it. Furthermore, by controlling the display state of the first element, embodiments of this disclosure can also improve the efficiency of editing operations related to media resources.

[0087] Example process

[0088] Figure 9 shows a flowchart of an example process 900 of interface interaction according to some embodiments of the present disclosure. Process 900 can be implemented at electronic device 110. Process 900 is described below with reference to Figure 1.

[0089] In frame 910, electronic device 110 presents an editing interface for media content, wherein the editing interface includes at least a video track and a first element associated with a first media resource. The first element is associated with the scope of the first media resource, the starting point of the scope corresponds to a first position in the video track, and the ending point of the scope corresponds to a second position in the video track.

[0090] In frame 920, electronic device 110, in response to receiving the first instruction, moves the video track in the editing interface.

[0091] In frame 930, in response to a first position outside a first area of ​​the editing interface and a second position within a first area, the electronic device 110 maintains the display of the first element in the second area of ​​the editing interface without moving with the video track.

[0092] In some embodiments, process 900 further includes: in response to the first position being within a first area of ​​the editing interface, synchronously moving the video track and the first element based on a first instruction, such that the first element corresponds to the first position.

[0093] In some embodiments, process 900 further includes: in response to both the first position and the second position being outside the first area of ​​the editing interface, moving the first element based on the second position to stop displaying the portion of the first element that extends beyond the editing interface.

[0094] In some embodiments, process 900 further includes: presenting an indicator element corresponding to the scope of application in the editing interface.

[0095] In some embodiments, process 900 further includes: presenting a second element associated with the second media resource in an editing interface; and, in response to the first element and the second element at least partially overlapping, determining the display style of the first element and the second element based on the hierarchy of the first media resource and the second media resource in the media content.

[0096] In some embodiments, process 900 further includes: determining the number of elements in the editing interface that are in a state of being kept displayed; and determining, based on the number, an offset of the second region from a preset boundary of the editing interface.

[0097] In some embodiments, determining the offset of the second region from the preset boundary of the editing interface based on the number includes: in response to the number being greater than a threshold, determining a set of elements in a state of being kept displayed; determining a first level of a set of media resources corresponding to the set of elements; and determining the offset of the second region from the preset boundary of the editing interface based on a comparison between the first level and a second level of the first media resources.

[0098] In some embodiments, process 900 further includes: receiving a trigger operation associated with a target location in an editing interface; and setting a first media resource to a selected state in response to the target location being within the interaction range associated with the first element.

[0099] In some embodiments, the size of the interactive area is larger than the display size of the first element.

[0100] In some embodiments, media resources include picture-in-picture material.

[0101] Example devices and equipment

[0102] Embodiments of this disclosure also provide corresponding apparatus for implementing the methods or processes described above. FIG10 shows a schematic structural block diagram of an apparatus 1000 for interface interaction according to certain embodiments of this disclosure. The apparatus 1000 may be implemented as or included in the electronic device 110 discussed above. The various modules / components in the apparatus 1000 may be implemented by hardware, software, firmware, or any combination thereof.

[0103] As shown in Figure 10, the device 1000 includes a first presentation module 1010 configured to present an editing interface for media content, wherein the editing interface includes at least a video track and a first element associated with a first media resource, the first element being associated with a range of influence of the first media resource, the starting point of the range corresponding to a first position in the video track, and the ending point of the range corresponding to a second position in the video track; a first movement module 1020 configured to move the video track in the editing interface in response to receiving a first instruction; and a first display module 1030 configured to maintain the first element displayed in a second area of ​​the editing interface in response to the first position being outside a first area of ​​the editing interface and the second position being within the first area, without moving with the video track.

[0104] In some embodiments, the device 1000 further includes a second moving module configured to: in response to a first position being within a first area of ​​the editing interface, synchronously move a video track and a first element based on a first instruction, such that the first element corresponds to the first position.

[0105] In some embodiments, the device 1000 further includes a third moving module configured to: in response to both the first position and the second position being outside the first area of ​​the editing interface, move the first element based on the second position to stop displaying the portion of the first element that extends beyond the editing interface.

[0106] In some embodiments, the device 1000 further includes a second presentation module configured to present an indicator element corresponding to the scope of application in the editing interface.

[0107] In some embodiments, the apparatus 1000 further includes a first determining module configured to: present a second element associated with a second media resource in an editing interface; and, in response to the first element and the second element at least partially overlapping, determine the display style of the first element and the second element based on the hierarchy of the first media resource and the second media resource in the media content.

[0108] In some embodiments, the apparatus 1000 further includes a second determining module configured to: determine the number of elements in the editing interface that are in a persistent display state; and based on the number, determine an offset of the second region from a preset boundary of the editing interface.

[0109] In some embodiments, the second determining module is further configured to: determine a set of elements in a sustained display state in response to the number being greater than a threshold; determine a first level of a set of media resources corresponding to the set of elements; and determine an offset of the second region from a preset boundary of the editing interface based on a comparison of the first level and a second level of the first media resources.

[0110] In some embodiments, the device 1000 further includes a setting module configured to: receive a trigger operation associated with a target location in an editing interface; and set a first media resource to a selected state in response to the target location being within the interaction range associated with a first element.

[0111] In some embodiments, the size of the interactive area is larger than the display size of the first element.

[0112] In some embodiments, media resources include picture-in-picture material.

[0113] The units included in device 1000 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units may be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 1000 may be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SoCs), complex programmable logic devices (CPLDs), and so on.

[0114] Figure 11 shows a block diagram of an electronic device 1100 in which one or more embodiments of the present disclosure may be implemented. It should be understood that the electronic device 1100 shown in Figure 11 is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. The electronic device 1100 shown in Figure 11 can be used to implement the electronic device 110 of Figure 1 or the apparatus 1000 of Figure 10.

[0115] As shown in Figure 11, electronic device 1100 is in the form of a general-purpose electronic device. Components of electronic device 1100 may include, but are not limited to, one or more processors 1110 or processing units, memory 1120, storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. Processor 1110 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 1120. In a multiprocessor system, multiple processors execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 1100.

[0116] Electronic device 1100 typically includes multiple computer storage media. Such media can be any available media accessible to electronic device 1100, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 1120 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 1130 can be removable or non-removable media and may include machine-readable media, such as flash drives, disks, or any other media capable of storing information and / or data and accessible within electronic device 1100.

[0117] Electronic device 1100 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG11, disk drives for reading or writing from removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading or writing from removable, non-volatile optical disks may be provided. In these cases, each drive may be connected to a bus (not shown) via one or more data media interfaces. Memory 1120 may include computer program product 1125 having one or more program modules configured to perform various methods or actions of various embodiments of the present disclosure.

[0118] Communication unit 1140 enables communication with other electronic devices via a communication medium. Additionally, the functionality of components of electronic device 1100 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, electronic device 1100 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0119] Input device 1150 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1160 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 1100 can also communicate with one or more external devices (not shown) via communication unit 1140 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 1100, or with any device that enables electronic device 1100 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0120] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0121] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0122] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0123] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0124] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0125] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for interface interaction, comprising: An editing interface for presenting media content, wherein the editing interface includes at least a video track and a first element associated with a first media resource, the first element being associated with the scope of the first media resource, the starting point of the scope corresponding to a first position in the video track, and the ending point of the scope corresponding to a second position in the video track; In response to receiving a first instruction, the video track in the editing interface is moved; as well as In response to the first position being outside the first area of ​​the editing interface and the second position being within the first area, the first element is maintained in the second area of ​​the editing interface without moving with the video track.

2. The method according to claim 1, further comprising: In response to the first position within the first area of ​​the editing interface, based on the first instruction, the video track and the first element are moved synchronously, such that the first element corresponds to the first position.

3. The method according to claim 1 or 2, further comprising: In response to both the first position and the second position being outside the first area of ​​the editing interface, the first element is moved based on the second position to stop displaying the portion of the first element that extends beyond the editing interface.

4. The method according to any one of claims 1 to 3, further comprising: The editing interface displays indicator elements corresponding to the scope of application.

5. The method according to any one of claims 1 to 4, further comprising: The editing interface displays a second element associated with the second media resource; as well as In response to the fact that the first element and the second element at least partially overlap, the display style of the first element and the second element is determined based on the hierarchy of the first media resource and the second media resource in the media content.

6. The method according to any one of claims 1 to 5, further comprising: Determine the number of elements in the editing interface that are kept on display; as well as Based on the number, the offset of the second region from the preset boundary of the editing interface is determined.

7. The method of claim 6, wherein determining the offset of the second region from the preset boundary of the editing interface based on the number comprises: In response to the number being greater than a threshold, a set of elements is determined to remain in the display state; Determine the first level of a set of media resources corresponding to the set of elements; as well as Based on the comparison between the first level and the second level of the first media resource, the offset of the second region from the preset boundary of the editing interface is determined.

8. The method according to any one of claims 1 to 7, further comprising: In the editing interface, a trigger operation associated with the target location is received; as well as In response to the target location being within the interaction range associated with the first element, the first media resource is set to a selected state.

9. The method according to claim 8, wherein the size of the interactive range is larger than the display size of the first element.

10. The method according to any one of claims 1 to 9, wherein the media resource includes picture-in-picture material.

11. A device for interface interaction, comprising: A first presentation module is configured to present an editing interface for media content, wherein the editing interface includes at least a video track and a first element associated with a first media resource, the first element being associated with the scope of the first media resource, the starting point of the scope corresponding to a first position in the video track, and the ending point of the scope corresponding to a second position in the video track. The first moving module is configured to move the video track in the editing interface in response to receiving a first instruction; as well as A first display module is configured to, in response to the first position being outside a first area of ​​the editing interface and the second position being within the first area, maintain the first element displayed in a second area of ​​the editing interface without moving with the video track.

12. An electronic device, comprising: At least one processor; as well as At least one memory, coupled to the at least one processor and storing instructions for execution by the at least one processor, which, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1 to 10.

13. A computer-readable storage medium having stored thereon computer-executable instructions that can be executed by a processor to implement the method according to any one of claims 1 to 10.

14. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1 to 10.

Images