Method, apparatus, device, and storage medium for content capture

Abstract

According to an embodiment of the present invention, a method, an apparatus, a device, and a storage medium for content shooting are provided. The method includes: in response to determining that at least a first type of first shooting material is selected, providing a plurality of material identifiers corresponding to at least a second type of multiple shooting materials, the plurality of shooting materials being associated with the first shooting material; determining a selected shooting material from the plurality of shooting materials based on a selection operation on a material identifier from the plurality of material identifiers; and in response to determining that a second shooting material from the plurality of shooting materials is selected, providing a first shooting preview including the first shooting material and the second shooting material. This allows a user to more conveniently and quickly select materials and create content, and improves the user's shooting experience.

Description

[Technical Field]

[0001] [Cross-Citation of Related Applications] This application claims priority to a Chinese invention patent application filed on June 28, 2022, entitled "Method, apparatus, device, and storage medium for content capture," with application number CN202210754280.X. [Technical field] FIELD Exemplary embodiments of the present invention relate generally to the field of multimedia processing, and more particularly to methods, apparatus, devices, and computer-readable storage media for content capture. [Background technology]

[0002] Currently, there are an increasing number of applications designed to provide various services to users. For example, content sharing applications allow users to view, comment on, and forward various content, such as multimedia content including videos, images, image collections, sounds, etc. Content sharing type applications also allow users to capture and share media content, such as photos, videos, animated graphics, etc. When capturing media content, applications provide a variety of captured materials from which users can select to create personalized media content. Summary of the Invention

[0003] In a first aspect of the present invention, there is provided a content capture method, the method including: in response to determining that at least a first type of first captured material has been selected, presenting a plurality of material identifiers corresponding to at least a second type of multiple captured material, the plurality of captured material being associated with the first captured material; determining a selected captured material from the plurality of captured materials based on a selection operation on a material identifier from the plurality of material identifiers; and in response to determining that a second captured material from the plurality of captured materials has been selected, presenting a first captured preview including the first captured material and the second captured material.

[0004] In a second aspect of the present invention, there is provided an apparatus for filming content, the apparatus comprising: a material presentation module for presenting a plurality of material identifiers corresponding to a plurality of filmed materials of at least a second type in response to determining that at least a first type of first filmed material has been selected, the plurality of filmed materials being associated with the first filmed material; a material selection module for determining a selected filmed material from the plurality of filmed materials based on a selection operation on a material identifier from the plurality of material identifiers; and a first preview presentation module for presenting a first filmed preview including the first filmed material and the second filmed material in response to determining that a second filmed material from the plurality of filmed materials has been selected.

[0005] In a third aspect of the present invention, there is provided an electronic device comprising at least one processing unit and at least one memory coupled to the at least one processing unit for storing instructions adapted to be executed by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the device to perform the method of the first aspect.

[0006] In a fourth aspect of the present invention, there is provided a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of the first aspect.

[0007] It should be understood that the contents described in the summary of the present invention are not intended to limit the main or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will be readily apparent from the following description. [Brief explanation of the drawings]

[0008] The above-mentioned and other features, advantages, and aspects of the embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the drawings, in which like or similar symbols indicate like or similar elements, and in which: [Figure 1] 1 shows a schematic diagram of an exemplary environment in which embodiments of the present invention may be implemented; [Figure 2] 1 illustrates a flowchart of a process for content capture according to some embodiments of the present invention; [Figure 3A] ~ [Figure 3D] 1 illustrates a schematic diagram of an exemplary page related to content capture according to some embodiments of the present invention; [Figure 4A] ~ [Figure 4D] 10A-10C illustrate schematic diagrams of exemplary pages related to content capture in accordance with some further embodiments of the present invention; [Figure 5A] ~ [Figure 5E] 10A-10C illustrate schematic diagrams of exemplary pages related to content capture in accordance with some further embodiments of the present invention; [Figure 6A] ~ [Figure 6B] 10A-10C illustrate schematic diagrams of exemplary pages related to content capture in accordance with some further embodiments of the present invention; [Figure 7A] ~ [Figure 7B] 10A-10C illustrate schematic diagrams of exemplary pages related to content capture in accordance with some further embodiments of the present invention; [Figure 8] FIG. 1 is a block diagram of an apparatus for content capture according to some embodiments of the present invention; [Figure 9] 1 illustrates an electronic device in which one or more embodiments of the present invention may be implemented. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the embodiments of the present invention will be described in more detail with reference to the drawings. Although the drawings show specific embodiments of the present invention, it should be understood that the present invention can be implemented in various forms and should not be construed as being limited to the embodiments described herein, but rather, these embodiments are provided for a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are for illustrative purposes and are not used to limit the protection scope of the present invention.

[0010] In describing embodiments of the present invention, the term "comprising" and similar terms are intended to be open-ended inclusions, including, but not limited to, the term "based on" should be understood as "based at least in part on." The terms "one embodiment" or "the embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicit and implicit definitions may be included below.

[0011] It is understood that data related to the present technical solution (including but not limited to the data itself, the acquisition of data, or the use of data) should comply with applicable laws and regulations and related specified requirements.

[0012] It is understood that before using the technical solutions disclosed in each embodiment of the present invention, the types, scope of use, and usage scenarios of personal information involved in the present invention should be notified to users in an appropriate manner in accordance with relevant laws and regulations, and consent from users should be obtained.

[0013] For example, in response to receiving an unsolicited request from a user, presentation information may be sent to the user to explicitly indicate to the user that the requested operation requires the acquisition and use of the user's personal information, allowing the user to independently choose whether or not to provide the personal information to software or hardware, such as an electronic device, application, server, or storage medium, that performs the operation of the technical solution of the present invention, based on the presentation information.

[0014] In an optional, non-limiting implementation, the method for sending the user the offered information in response to receiving the user's unsolicited request may be, for example, a method using a pop-up window in which the offered information can be displayed in text form, and the pop-up window may further include a selection control for the user to select "agree" or "disagree" to providing personal information to the electronic device.

[0015] It is understood that the notification and user authorization process described above is merely a general outline and is not intended to limit the implementation of the present invention, and that other methods that comply with relevant laws and regulations may also be applied to the implementation of the present invention.

[0016] 1 illustrates a schematic diagram of an exemplary environment 100 in which embodiments of the present invention can be implemented. In the exemplary environment 100, a terminal device 110 has an application 120 installed. A user 140 can interact with the application 120 via the electronic device 110 and / or a device connected to the electronic device 110. The application 120 may be a content-sharing type application and may provide the user 140 with various services related to multimedia content items, including viewing, commenting, transferring, creating (e.g., filming and / or editing), publishing, etc. As used herein, a "multimedia content item" includes one or more types of content, such as video, images, animated graphics, image collections, audio, text, etc.

[0017] 1 , when application 120 is active, terminal device 110 may present pages 150 of application 120. Pages 150 may include various pages that application 120 may provide, such as a multimedia content submission page, a content creation page, a content publishing page, a message page, a personal page, etc. Application 120 may provide content creation functionality for capturing and / or creating multimedia content items, allow users to edit captured or uploaded multimedia content, etc. Application 120 further has a publishing functionality that allows users 140 to publish created multimedia content.

[0018] In some embodiments, terminal device 110 communicates with server 130 to implement the provision of services to application 120. Terminal device 110 may be any type of mobile, fixed, or portable terminal, including a mobile cell phone, desktop computer, laptop computer, notebook computer, netbook computer, tablet computer, media computer, multimedia tablet, personal communication system (PCS) device, personal navigation device, assistant (PDA), audio / video player, digital camera / camcorder, positioning device, television receiver, radio receiver, e-book device, gaming device, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, terminal device 110 may also support any type of interface to a user (e.g., “wearable” circuitry). Server 130 may be any type of computing system / server capable of providing computing functionality, including, but not limited to, a mainframe, an edge computing node, a computing device in a cloud environment, etc.

[0019] It should be understood that the structure and function of each element in environment 100 is described for illustrative purposes only and does not imply any limitation on the scope of the present invention.

[0020] When shooting a multimedia content item such as a video or a photo, a user can set the footage to be used during shooting, such as background music, props, filters, stickers, and text to be applied to the video or photo. Currently, different portals related to various types of footage libraries are provided on the shooting start page. When these portals are triggered, different types of footage libraries are displayed, allowing the user to select from them. However, this process requires relatively complicated and time-consuming user operations. If a particular type of footage library contains a large amount of footage, the user must spend more time browsing to find the appropriate footage. Furthermore, when creating multimedia content, the user must spend more time combining different types of footage to create a satisfactory result. In some cases, if the portal or footage for a particular type of footage is located in a sufficiently inconspicuous location, the user may not realize that the particular footage is available.

[0021] Currently, some applications provide a function for capturing the same type of footage for existing multimedia content items, which allows a user to directly add one or more types of footage from the multimedia content items that the user is interested in to a new work that the user wants to capture. However, if the user is not satisfied with a certain type of footage or needs to add other types of footage, the user still needs to search for the corresponding type of footage from the footage library, which causes inconvenience to the user and reduces the user experience.

[0022] According to an embodiment of the present invention, an improved solution for content shooting is provided. In this solution, when a specific piece of footage of one type is selected, multiple pieces of footage of another type associated with the selected piece of footage are presented for selection. When a specific piece of footage of the presented multiple pieces of footage of the other type is also selected, a shooting preview including the selected piece of footage of the different type is presented. This solution allows a user to conveniently and flexibly select desired footage from a smaller group of footage of the other type, and also ensures that the selected pieces of footage of the multiple types are more relevant and have a higher degree of compatibility. This allows a user to more conveniently and quickly select footage and create content, improving the user's shooting experience.

[0023] Several exemplary embodiments of the present invention will now be described with continued reference to the drawings.

[0024] 2 shows a flowchart of a process 200 for content capture according to some embodiments of the present invention. The process 200 may be implemented in a terminal device 110. For ease of discussion, the process 200 will be described with reference to the environment 100 of FIG. 1.

[0025] In box 210, the terminal device 110 determines whether a first type of first captured material has been selected.

[0026] As used herein, "footage" refers to material that can be added to a multimedia content item to be shot, including visual and / or audio material. Footage is categorized into various types, and different types of footage can be applied simultaneously to the same multimedia content item to provide rich content in multiple dimensions. Examples of types of footage may include background audio, such as background music, background voice, or other types of audio. Types of footage may also include props, filters, text, stickers, special effects, shooting templates, and any other material that can be added to a multimedia content item.

[0027] Different types of footage may include multiple selectable footage. Prop-type footage may include a complete footage package for adding static or dynamic objects to the screen, providing interactive effects, changing the color contrast of the screen, character makeup, etc. Filter-type footage may be used to adjust the color curve of the screen to create different filter effects. Text-type footage may add text of various styles to the shooting screen, and sticker-type footage may add dynamic or static stickers of various styles to the shooting screen. Special effect-type footage may include video special effects and / or audio special effects, which can change the display effects of the screen and / or sound. Shooting template-type footage may control narrative effects for the video or image group being shot, such as cut and transition effects, screen textures, special effect styles, opening and ending control, and subtitles.

[0028] The above are just some examples of footage, and these footage can be categorized according to different application needs and placement rules, and more, fewer, or other types of footage can be submitted.

[0029] In some embodiments, the application 120 installed on the terminal device 110 may provide a photography function for photographing multimedia content items, such as videos, images, animated graphics, etc. When a photography request is triggered, the material to be photographed can be determined. In some embodiments, the application 120 may provide multiple portals for triggering a photography request, such as portals that trigger photography requests on various pages of the application. In some examples, the portals that trigger photography requests may include a start photography control, a same-type photography portal on a detail page of a particular multimedia content item or photography material, a common photography portal for a particular multimedia content item, etc. As needed, the portals that trigger photography requests can be configured on appropriate pages or page positions in the application.

[0030] To better understand the exemplary embodiment, the following description will be made with reference to an exemplary page of an application.

[0031] 3A illustrates an exemplary page 300 of application 120. Page 300 can be any page of application 120. In the example of FIG. 3A, page 300 is an information stream presentation page on which a multimedia content item 310 shared by a user is presented. In this example, the filmed material for multimedia content item 310 includes at least background music and props 330, which provide a rich visual and auditory experience. Page 300 also provides a details page portal 322 for the background music "Music A" used in multimedia content item 310. Page 300 includes a start filming control 320 for triggering the presentation of a start filming page to begin filming the multimedia content item.

[0032] It should be understood that page 300 of FIG. 3A and the pages of the other figures described below are merely example pages, and that a variety of actual page designs may exist. Each graphical element within a page may have a different arrangement and visual representation, one or more elements therein may be omitted or substituted, and one or more other elements may be present. Embodiments of the present invention are not limited in this respect. Furthermore, it should be understood that, in addition to example page 300, other pages of application 120 may present a start capture control and / or allow a start capture command to be initiated by other means.

[0033] In some cases, when a user is viewing a multimedia content item 310 and is interested in the background music "Music A" used therein, the user may trigger a detail page portal 322 for "Music A," for example, by clicking on the portal 322. In response to receiving a trigger instruction for the detail page portal 322, the terminal device 110 presents the detail page 301 for "Music A," as shown in FIG. 3B. It should be noted that in addition to entering the detail page 301 for "Music A" from page 310, the application 120 may provide various other means of entering the detail page 301.

[0034] The detail page 301 can provide more information related to "Music A", such as the cover, creator, number of users, etc. The detail page 301 can further provide a display interface 324 of multimedia content items with "Music A" as background music for users to query.

[0035] The "Music A" detail page 301 further presents a "Photograph of the Same Type" control 326 that the user can trigger to photograph the same type of content of the currently interested multimedia content item. When the user triggers the "Photograph of the Same Type" control 326, the terminal device 110 will detect a same type photograph request for the interested multimedia content item. In some embodiments, if the user enters the detail page 301 from the multimedia content item 310, it may be defaulted that the user is interested in the multimedia content item 310. In some embodiments, if it is detected that the user selects another multimedia content item within the detail page 301 and then triggers a same type photograph request, it may be determined that the user is interested in the selected multimedia content item.

[0036] If a same-type shooting request for a multimedia content item of interest is detected, a specific shooting material in the multimedia content item is selected by default for shooting. After a same-type shooting request is detected, the terminal device 110 presents the start shooting page 302, and as shown in Figure 3C, the background audio selection box 328 indicates that "Music A" is selected as the background audio.

[0037] In some embodiments, when a user triggers (e.g., clicks) the start shooting control 320 in the page 300 as shown in FIG. 4A , the terminal device 110 detects the start shooting command and presents the start shooting page 302 as shown in FIG. 4B . In the start shooting page 302 of FIG. 4B , the user can select background music for shooting, for example, by clicking a background audio selection box 328. After the background audio selection box 328 is clicked, a background audio selection interface, such as the background audio selection interface 430 as shown in FIG. 4C , can be presented, which lists multiple selectable background audios. When the user selects the background audio “Music A,” as shown in FIG. 4D , the background audio selection box 328 indicates that “Music A” has been selected as the background audio on the start shooting page 302.

[0038] In response to determining that at least a first type of first photographed material has been selected, terminal device 110 submits, at box 220, a plurality of material identifiers corresponding to at least a second type of plurality of photographed material associated with the previously selected first photographed material.

[0039] In some embodiments of the present invention, when a particular type of footage has already been selected, multiple related footage of other types are actively recommended for the user to select from. In some embodiments, the start shooting page allows the user to select various footage for shooting. Accordingly, footage identifiers corresponding to the multiple footage of other types may be presented on the start shooting page. As used herein, a "footage identifier" may be any form of identifier information, such as text, numbers, and / or icons, that can identify different footage.

[0040] In some embodiments, the second type of filmed material may be different from the first type of filmed material. For example, the first type of filmed material may be background audio, and the second type of filmed material may be props, filters, or other material. In some embodiments, multiple other types of filmed material (e.g., second and third types) associated with the already selected filmed material are presented, e.g., material identifiers corresponding to one or more props and one or more filters are presented together. In some embodiments, if multiple types of filmed material have already been selected by the user, e.g., if both the first and third types of filmed material have already been selected, another type of filmed material (e.g., second type) is recommended to the user, e.g., material identifiers corresponding to the other types of filmed material are presented.

[0041] In some embodiments, the presented second type of footage may be a subset of all available footage of the second type, which footage is considered to match the type of footage currently selected by the user.

[0042] For ease of explanation, in some examples herein, it is assumed that when background audio type footage is selected, prop type footage is recommended. However, it should be understood that the present specification is not limited to these types of footage and the selection order. In other embodiments, when it is determined that another type of footage (e.g., prop type or filter type) has been selected, other associated types of footage (e.g., footage suitable for multiple background audios of the currently selected prop or filter) are presented. These specific implementations can be configured as needed, and embodiments of the present invention are not limited in this respect.

[0043] In some embodiments, the first type may be configured as a particular type of photographic material, and / or the second type may also be configured as a particular type of photographic material, i.e., only if a particular or certain subset of types of photographic material is determined to be selected are other particular types of photographic material recommended for selection by the user. In some embodiments, such special configuration may not be required, and such an association may be established between each available type of photographic material, such that selection of any one type of photographic material may initiate the presentation of one or more other types of photographic material for selection by the user.

[0044] In some embodiments, if a particular filmed material of the second type and the currently selected filmed material of the first type are included in the same multimedia content item, the filmed material of the second type may be determined as candidate filmed material associated with the selected filmed material of the first type. In this manner, a set of candidate filmed material associated with the selected filmed material of the first type may be determined. In some embodiments, given that the interface for associated filmed material may be relatively limited, multiple filmed materials may be selected for presentation from the set of candidate filmed material of the second type.

[0045] In some embodiments, a plurality of filmed footage may be selected for presentation based on the popularity of the set of candidate filmed footage of the second type. In some examples, the popularity of the candidate filmed footage may be measured based on the number or frequency with which the candidate filmed footage has been used, or based on the number or frequency with which the candidate filmed footage has been used together with the currently selected first type of filmed footage. The more frequently or frequently the candidate filmed footage has been used, the more popular the candidate filmed footage. In some embodiments, a predetermined number of the most popular candidate filmed footage are selected for presentation.

[0046] In some embodiments, additionally or alternatively, a plurality of filmed footage may be selected for presentation based on user interaction behaviors associated with the set of candidate filmed footage of the second type. User interaction behaviors may include, for example, user favorites, likes, shares, comments, etc. For example, if a user favorites a particular candidate filmed footage or a multimedia content item that includes the candidate filmed footage, the candidate filmed footage may be selected for presentation. In examples that consider various interaction behaviors, the candidate filmed footage may be scored based on different interaction behaviors, and candidate filmed footage with higher scores may be presented. Because a higher number of interaction behaviors indicates a higher probability that a user will select the candidate filmed footage, selecting and presenting these filmed footage may improve the user's filming experience.

[0047] In some embodiments, the second plurality of filmed materials may be selected for presentation based simultaneously on the popularity of the candidate filmed materials and the associated user interaction activity, while in other embodiments, other factors may also be considered in determining the second plurality of filmed materials for presentation.

[0048] The presentation of the second type of filmed material will now be described with reference to an exemplary page.

[0049] 3C , if a user wishes to film new content that includes particular footage (e.g., background audio) in a multimedia content item of interest, in addition to indicating that the same background audio, “Music A,” has been selected on start filming page 302, the start filming page 302 also presents multiple footage of other types, including prop identifiers 343-1, 343-2, 343-3, 343-4, etc. (for ease of discussion, these may be collectively referred to as prop identifiers 343), corresponding to multiple props. The props indicated by these prop identifiers are considered to be associated with or match the currently selected “Music A.”

[0050] In some embodiments, multiple material identifiers corresponding to multiple recommended filmed materials of the second type may be presented in a sidebar of a page (e.g., the start filming page). Depending on the size and configuration of the page, one or more material identifiers may be hidden and presented based on user interaction. As shown in Figures 3C and 4D, multiple prop identifiers 343 are presented in the right sidebar of the start filming page 302. Of course, material identifiers may be presented in other sidebars or other locations on the page depending on the needs of the actual page design.

[0051] In some embodiments, the start shooting page may further present various shooting setting or footage selection interface portals related to the shoot. For example, as shown in Figures 3C and 4D, the start shooting page 302 may further present a filter selection interface portal 340 for triggering the display of a filter selection interface to display a plurality of selectable filters, a lens slip function 341 for switching the front or rear lens of the shooting camera, and a timer function 342 for setting a countdown to the shoot. The start shooting page 302 may also include a prop selection interface portal 354 for triggering the display of a prop selection interface to display a plurality of selectable props, and an album portal 356 for accessing multimedia content in local or other data sources for subsequent creation.

[0052] In some embodiments, the start shooting page 302 may further provide other controls for controlling content shooting. For example, in Figures 3C and 4D, the start shooting page 302 may further present a shooting control 352, and shooting may be started according to a trigger instruction on the shooting control 352.

[0053] In some examples, the start shooting page 302 corresponds to the shooting portal 350 and may further provide other camera-related function portals therein, such as the live streaming portal 351 shown in FIGS. 3C and 4D. When selection of the live streaming portal 351 is detected, the page switches to the live streaming page. In some embodiments, the start shooting page 302 may further provide different shooting modes for the shooting function, such as a video shooting mode 355, a photo shooting mode 357, and an animated graphics shooting mode 359. In FIGS. 3C and 4D, after entering the start shooting page 302, the video shooting mode 355 may be selected by default, and the user may also switch to other shooting modes.

[0054] It should be understood that the functionality illustrated herein is exemplary only, and that more, fewer, or different functionality may be provided on start shooting page 302, and embodiments of the present invention are not limited in this respect. For example, in addition to the prop selection interface portal and the filter selection interface portal, portals for other types of footage selection interfaces, such as text, stickers, etc., may also be provided.

[0055] In some embodiments, if the multimedia content items of interest of the same type that the user wishes to film contain at least a second type of filmed material, such as a prop type of filmed material, in addition to a first type of filmed material (e.g., background audio), the second type of filmed material may be determined as recommended filmed material of that type, and a material identifier for that material may also be presented. In some embodiments, the second type of filmed material included in the multimedia content items of interest is selected by default. As shown in FIG. 3C , because the multimedia content items of interest 310 contain not only “Music A” but also prop 330, prop identifier 343-2 corresponding to prop 330 is presented on page 302. Prop identifier 343-2 may also be presented in a selected state to indicate that the corresponding prop 330 has been selected.

[0056] In some embodiments, a shooting preview including the selected shooting material may also be provided. For example, in the example of Figure 3C, if "Music A" is selected and prop 330 is selected by default, a shooting preview 314 including "Music A" and prop 330 may be provided.

[0057] In some implementations, if the multimedia content item of interest does not include the second type of filmed material or if a default selection of the second type of filmed material has not been determined by other means, the filmed preview may not include the second type of filmed material by default. For example, in the example of Figures 4A-4D, after "Music A" is selected, no default selection of props is provided, and therefore the filmed preview 314 of Figure 4D does not include the prop type of filmed material.

[0058] In some embodiments, a disable function for disabling the use of the second type of filmed material may be further provided in association with the plurality of material identifiers. A trigger instruction for the disable function triggers the disable instruction for disabling the use of the second type of filmed material, such that the second type of filmed material is no longer used for filming. As shown in Figures 3C and 4D, a disable function 344 is provided to disable the use of the second type of filmed material, i.e., to indicate that the second type of filmed material has not been selected for filming. In the example of Figure 4D, after providing the prop identifiers 343 corresponding to the plurality of props, the disable function 344 is provided in a selected state because the scene does not have the second type of filmed material selected by default.

[0059] Continuing with process 200 of FIG. 2, in box 230, a selected piece of footage from the plurality of footage is determined based on a selection operation on a material identifier from the plurality of material identifiers.

[0060] The material identifiers corresponding to the presented second type of filmed material can be selected by the user for filming as needed. The filming start page can also provide portals for several types of filmed material selection interfaces (e.g., filters, props, etc.), but using these portals to trigger the filmed material selection interface requires more interactive operations and the user must spend more time searching for filmed material that meets their needs from a large amount of filmed material. According to an embodiment of the present invention, after at least a first type of filmed material is selected, material identifiers corresponding to at least a second type of associated filmed material are proactively presented for the user to select. This allows the user to more conveniently and flexibly select desired filmed material.

[0061] In some embodiments, a selection operation for multiple material identifiers may be performed through a predetermined type of interactive gesture. In some embodiments, the predetermined type of interactive gesture for material switching may include a slide gesture and / or a click gesture. In some examples, the type of slide gesture may include a leftward slide gesture, a rightward slide gesture, an upward slide gesture, a downward slide gesture, or a slide gesture with another specific trajectory. The type of slide gesture selected may be based on the arrangement of the material identifiers and may need to avoid conflict with interactive gestures used for other functions on the page. For example, in the examples of FIGS. 3C and 4D , an upward slide gesture and a downward slide gesture may be configured to select or switch between different material identifiers. In some examples, selecting or switching between corresponding material identifiers through a click gesture may also be supported.

[0062] In other embodiments, the selection operation for the plurality of material identifiers can also be performed through other types of interaction gestures supported by the terminal device, such as eye movement interaction gestures, facial gesture interaction gestures, etc.

[0063] In some implementations, certain types of interactive gestures may support selecting or switching between material identifiers corresponding to a plurality of second type of filmed material, and may also support triggering a disable function to disable use of the second type of filmed material. For example, in the examples of Figures 3C and 4D, upward and downward sliding gestures may be used to switch between a plurality of prop identifiers 343 and a disable function 344.

[0064] In some embodiments, guidance information regarding material switching may be provided to help a user understand how to select and switch between the presented material identifiers. As shown in FIG. 3D , a guidance mask layer is provided in the start shooting page 302, including text guidance information 360 and animated gesture guidance 362 to guide the user through prop switching. In some embodiments, such guidance information may be provided when a material identifier corresponding to a recommended filmed material is first submitted, or may be provided each time such a submission is made. The scope of embodiments of the present invention is not limited in this respect.

[0065] In some embodiments, after submitting a plurality of material identifiers corresponding to a plurality of second-type filmed materials, if a specific material identifier is currently selected (e.g., selected by default or manually selected by the user), the terminal device 110 can detect a predetermined type of interactive gesture for switching material. When the predetermined type of interactive gesture indicates switching from the currently selected material identifier to another material identifier, it can be determined that filmed material corresponding to the other material identifier has been selected, i.e., that a second type of "second filmed material" has been selected. This allows flexible switching between the plurality of material identifiers through the predetermined type of interactive gesture, thereby flexibly selecting or switching between different filmed materials.

[0066] As shown in FIG. 5A , in this example, assume that the prop 330 corresponding to prop identifier 343-2 is selected by default (e.g., the user is looking forward to capturing the same type of multimedia content item 310 of interest). When a user's upward sliding gesture 510 is detected, indicating switching from prop identifier 343-2 to adjacent prop identifier 343-3 below, it can be determined that the prop 332 corresponding to prop identifier 343-3 has been selected. As shown in FIG. 5B , prop identifier 343-3 is presented in a selected state. After sliding to switch material identifiers, material identifiers below to be hidden can be presented in order, and material identifiers above that have slid out of the display area can be hidden. For example, prop identifier 343-1 is hidden in FIG. 5B , and another prop identifier 343-5 arranged below prop identifier 343-4 is presented.

[0067] Continuing with process 200, if it is determined in box 240 that a second shot of the plurality of shots has been selected, the terminal device 110 presents a first shot preview including the selected first shot and second shots.

[0068] 5A, when it is detected that prop 332 corresponding to prop identifier 343-3 has been selected, a shooting preview 514 can be presented that includes the currently selected first type of filmed material, "Music A," and the second type of filmed material, prop 332. For example, in the shooting preview 514, "Music A" can be played, and the visual effect (or animation effect, if any) of prop 332 can be presented.

[0069] In some embodiments, once a particular filmed material is determined to be selected, a material identifier corresponding to the selected filmed material may be prominently displayed. As used herein, prominent display of a material identifier refers to a display of a selected material identifier that is more easily distinguishable than a display of an unselected material identifier. The material identifier may be prominently displayed in one or more different ways. In some embodiments, the more prominent display of a material identifier may be reflected in the display position and / or appearance of the material identifier. For example, a selected material identifier may be moved to a position among all the displayed material identifiers that is more easily visible to the user, such as the center of the list. Additionally or alternatively, the appearance of one or more aspects of the selected material identifier may be differentiated from other unselected material identifiers. For example, a separate visual design may be added to the selected material identifier, or the color, shape, texture, shading, size, etc., of the representation of the selected material may be changed. Furthermore, the selected material identifier may be prominently displayed by any other means.

[0070] For example, in the example of FIG. 5B, the selected prop identifier 343-3 is moved upward and enlarged, and is shaded to distinguish it from the other prop identifiers. In some examples, in addition to the material identifier selected by the user, the material identifier selected by default or the disable function that has been triggered may also be prominently displayed. For example, in the example of FIG. 5A, the default selected prop identifier 343-2 may also be prominently displayed, and in the example of FIG. 4D, the selected disable function 344 may also be prominently displayed.

[0071] In some cases, the user may switch between the second type of filmed material multiple times, for example, through a predetermined type of interactive gesture for switching material. Upon detecting that a material identifier corresponding to another filmed material of the second type has been selected, the corresponding material identifier may be prominently displayed, and the filmed preview may switch to one including the other filmed material. If the first filmed material of the first type remains selected, the switched filmed preview may continue to include the first filmed material of the first type.

[0072] For example, in FIG. 5B , when "MUSIC A" is still selected, if a user's downward sliding gesture 512 is detected, indicating a switch from the current prop identifier 343-3 to the adjacent prop identifier 343-2 above, it can be determined that the prop 330 corresponding to the prop identifier 343-2 has been reselected. As shown in FIG. 5C , the prop identifier 343-2 is presented in a selected state, and the shooting preview 514 of FIG. 5B is switched to a shooting preview 314 including "MUSIC A" and the prop 330. Of course, if the user's selection of another prop identifier is detected in FIG. 5B , the shooting preview 514 can be switched to a shooting preview including the other prop identifier and "MUSIC A."

[0073] If the second type of footage is not recommended, when the user switches or selects footage in the second type of footage selection interface, the identifier of the portal may dynamically change to the footage currently selected by the user. For example, in the examples of Figures 5A-5C, the icon of the portal 354 in the prop selection interface changes depending on the prop selected by the user in the prop selection interface, e.g., indicates the prop identifier corresponding to the currently selected prop. In embodiments of the present invention, when the second type of footage is separately presented, the identifier of the portal in the footage selection interface does not change even when the user switches or selects between prop identifiers 343, thereby avoiding user confusion and encouraging the user to pay attention to switching between prop identifiers 343.

[0074] In some embodiments, when a disable instruction to disable the use of the second type of filmed material is detected, a filming preview including the first type of selected filmed material and the second type of selected filmed material is switched to another filming preview that does not include the second type of filmed material but does include the first type of selected filmed material. For example, when a trigger instruction for the disable function 344 shown in Figure 5C is detected, a filming preview 314 of Figure 5C is switched to a filming preview 516 shown in Figure 5D, which still includes "Music A" but does not include the prop type of filmed material, i.e., the presentation of prop 330 is stopped.

[0075] In some embodiments, in addition to the material identifiers corresponding to the second type of filmed material and the disable function, a control for disabling the presentation of the material identifiers is also presented. For example, in the examples of FIGS. 3C, 4D, and 5A-5D, the start filming page 302 further includes a stop presentation control 345. Triggering the stop presentation control triggers a stop presentation instruction for the material identifiers. Triggering the stop presentation instruction indicates that the user is no longer attempting to switch or select between the recommended second type of filmed material. Therefore, the presentation of the material identifiers corresponding to the second type of filmed material is stopped. For example, when a trigger instruction for the stop presentation control 345 is detected in FIG. 5D, the presentation of the multiple prop identifiers 343 is stopped on the start filming page 302, as shown in FIG. 5E. The disable function 344 for disabling the use of the second type of filmed material and the stop presentation control 345 for disabling the presentation of the material identifiers are also no longer presented.

[0076] In some cases, if a particular second type of filmed material was already selected before the stop presentation instruction was detected, after the presentation of the material identifiers and other features is stopped, the already selected second type of filmed material may still be selected and available for filming, for example, the already selected second type of filmed material may continue to be presented in the filming preview.

[0077] In some embodiments, if a page, such as the start shooting page, also includes a portal for a second type of footage selection interface, detecting a trigger indication for the portal can cause the presentation of the footage selection interface and the presentation of the multiple footage identifiers to cease. This is because, on the one hand, the user can select the desired second type of footage in the presented footage selection interface, and, on the other hand, triggering the footage selection interface may indicate that the user does not want to use the multiple footage currently recommended on the page and may want to select other footage of the second type. The presented footage selection interface may include all available footage of the second type. As shown in FIG. 6A , a user trigger indication for the prop selection interface portal 354 is detected. In response to the trigger indication, the start shooting page 302 presents a prop selection interface 620, shown in FIG. 6B , in which all props available through the application 120 can be found and selected.

[0078] In some embodiments, if a particular second type of filmed material is selected when a trigger indication for a portal in the filmed material selection interface is detected, for example, if prop 332 corresponding to prop identifier 343-3 is selected when portal 354 is triggered as shown in FIGURE 6A, the material identifier corresponding to the filmed material may be prominently displayed in the filmed material selection interface. As shown in FIGURE 6B, prop identifier 343-3 may be displayed first in prop selection interface 620, and additional shading may be added to indicate that the prop corresponding to the prop identifier has been selected. Of course, the selected second type of filmed material may be prominently displayed by other means.

[0079] In some embodiments, if a portal trigger instruction for a type of filmed material selection interface other than the second type is detected, or if a trigger instruction for another function in the start filming page is detected, the presentation of the material identifier corresponding to the second type of filmed material can be maintained. This allows a user to continue selecting or changing the second type of filmed material they want to use after selecting another type of filmed material. For example, in the example of FIG. 6A , if a user triggers a portal 340 in the filter selection interface, a user triggers an album portal 356, or a user triggers a slip function 341, the presentation of the prop identifier 343 can be maintained on the start filming page 302.

[0080] In some embodiments, if a user has already selected the first, second, and / or other possible types of footage on the start shooting page, a shooting instruction can be triggered. For example, a shooting instruction can be triggered by triggering a shooting control. In response to the detection of a shooting instruction simultaneously with the selection of each type of footage, the previously selected footage can be used to shoot, for example, video, images, or animated graphics. As shown in FIG. 7A , a user's trigger instruction on the shooting control 352 is detected. When the trigger instruction is detected, the shooting mode is video shooting mode, the music type footage is "Music A," and the prop type footage is prop 332. Thus, as shown in FIG. 7B , a video can be started on the shooting page 703 using "Music A" as background music and prop 332.

[0081] 8 shows a block diagram of a schematic configuration of an apparatus 800 for content shooting according to some embodiments of the present invention. The apparatus 800 can be implemented as the electronic device 110 or included in the terminal device 110. Each module / component in the apparatus 800 can be implemented by hardware, software, firmware, or any combination thereof.

[0082] Apparatus 800 includes a material presenting module 810 for presenting, in response to determining that at least a first type of first filmed material has been selected, a plurality of material identifiers corresponding to at least a second type of plurality of filmed material, the plurality of filmed material being associated with the first filmed material. Apparatus 800 further includes a material selection module 820 for determining a selected filmed material from the plurality of filmed materials based on a selection operation on a material identifier from the plurality of material identifiers, and a first preview presenting module 830 for presenting a first filmed preview including the first filmed material and the second filmed material in response to determining that a second filmed material from the plurality of filmed materials has been selected.

[0083] In some embodiments, the device 800 further comprises a first shot material determination module for determining that first shot material included in the video of interest is selected in response to detecting a same-type shot request for the multimedia content item of interest.

[0084] In some implementations, if the multimedia content item of interest includes a third shot material of the second type, the plurality of shot materials includes at least the third shot material.

[0085] In some embodiments, the apparatus 800 further comprises a default material determination module for determining that a third filmed material is selected by default in response to the first filmed material being selected, and a second preview presentation module for presenting a second filmed preview including the first filmed material and the third filmed material.

[0086] In some embodiments, the first preview presentation module 830 includes a first preview switching module for switching from the second shot preview to the first shot preview in response to detecting that a material identifier corresponding to the second shot material has been selected.

[0087] In some embodiments, the material selection module 820 includes a gesture detection module for detecting a predetermined type of interactive gesture for switching material simultaneously with selection of a first material identifier from the plurality of material identifiers, and a gesture-based material selection module for determining that a second filmed material corresponding to the second material identifier from the plurality of filmed materials has been selected in response to the predetermined type of interactive gesture indicating a switch from the first material identifier to a second material identifier.

[0088] In some implementations, the predetermined type of interaction gesture includes at least one of a slide gesture and a click gesture.

[0089] In some embodiments, the apparatus 800 further comprises a first identifier prominence presentation module for, in response to determining that the second filmed material has been selected, prominently presenting a material identifier corresponding to the second filmed material.

[0090] In some embodiments, the plurality of material identifiers are presented on a start shooting page for starting shooting, and the start shooting page includes a portal of a second type of footage selection interface. In some embodiments, the apparatus 800 further comprises a first stop presenting module for stopping the presenting of the plurality of material identifiers in response to detecting a trigger indication for the portal of the footage selection interface, and an interface presenting module for presenting the footage selection interface in response to detecting a trigger indication for the portal of the footage selection interface.

[0091] In some embodiments, the interface presentation module includes a second identifier prominence presentation module for prominently presenting a material identifier corresponding to the second filmed material in the filmed material selection interface in response to detecting a trigger indication for a portal in the filmed material selection interface simultaneously with the selection of the second filmed material.

[0092] In some implementations, the material presentation module comprises a sidebar presentation module for presenting the plurality of material identifiers in a sidebar of a page.

[0093] In some implementations, the apparatus 800 further comprises a second stop and present module for stopping the presentation of the plurality of material identifiers in response to detecting a stop and present instruction for the plurality of material identifiers.

[0094] In some embodiments, the device 800 further comprises a third preview switching module for switching from the first shot preview to a third shot preview in response to detecting a stop instruction to stop using the second type of shot material, the third shot preview including at least the first shot material.

[0095] In some embodiments, the first type is different from the second type, and the first type of footage or the second type of footage is selected from the following types: background audio, props, filters, text, stickers, special effects, and photography templates.

[0096] In some embodiments, the material presentation module comprises a candidate material determination module for determining a set of candidate filmed materials of the second type that are included in the multimedia content item together with the first filmed material; a material determination module for selecting a plurality of filmed materials from the set of candidate filmed materials based on popularity of the set of candidate filmed materials and user interaction behavior associated with the set of candidate filmed materials; and a determined material-based presentation module for presenting a plurality of material identifiers corresponding to the determined plurality of filmed materials.

[0097] 9 illustrates a block diagram of an electronic device 900 capable of implementing one or more embodiments of the present invention. It should be understood that the electronic device 900 illustrated in FIG. 9 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 900 illustrated in FIG. 9 may implement the terminal device 110 of FIG. 1.

[0098] 9, electronic device 900 is in the form of a general-purpose electronic device. Components of electronic device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. Processing unit 910 may be a real or virtual processor and may perform various processes based on programs stored in memory 920. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel, thereby increasing the parallel processing capabilities of electronic device 900.

[0099] The electronic device 900 typically includes multiple computer storage media. Such media may be any obtainable media accessible by the electronic device 900, including, but not limited to, volatile and nonvolatile media, removable and non-removable media. The memory 920 may be volatile memory (e.g., registers, high-speed cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 930 may be removable or non-removable media and may include machine-readable media, such as a flash memory drive, a magnetic disk, or any other media, that may be used to store information and / or data (e.g., training data for training) and that may be accessible within the electronic device 900.

[0100] The electronic device 900 may further include other removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 9, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a path (not shown) by one or more data medium interfaces. The memory 920 may include a computer program product 925 having one or more program modules configured to perform various methods or operations of various embodiments of the present invention.

[0101] The communication unit 940 implements communication with other electronic devices over a communication medium. Additionally, the functionality of the components of the electronic device 900 may be implemented as a single computing cluster or multiple computing machines, which can communicate over a communication connection. Thus, the electronic device 900 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0102] The input device(s) 950 may be one or more input devices such as a mouse, keyboard, trackball, etc. The output device(s) 960 may be one or more output devices such as a display, speakers, printer, etc. The electronic device 900 may further communicate with one or more external devices (not shown) such as a storage device, a display device, etc. via the communication unit 940, as needed, to communicate with one or more devices that allow a user to interact with the electronic device 900, or any device (e.g., a netbook card, a modem, etc.) that allows the electronic device 900 to communicate with one or more other electronic devices. Such communication may be performed via an input / output (I / O) interface (not shown).

[0103] According to an exemplary implementation of the present invention, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are executed by a processor to implement the above-described method. According to an exemplary implementation of the present invention, there is further provided a computer program product, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions that are executed by a processor to implement the above-described method.

[0104] Aspects of the present invention are described herein with reference to flowchart and / or block diagrams of methods, apparatus, devices, and computer program products implemented by the present invention. It will be understood that each box in the flowchart and / or block diagrams, and combinations of boxes in the flowchart and / or block diagrams, can all be implemented by computer-readable program instructions.

[0105] These computer-readable program instructions may be provided to a processing unit of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to generate a machine such that, when the instructions are executed by the processing unit of the computer or other programmable data processing apparatus, it generates an apparatus for implementing the functions / acts specified in one or more boxes in the flowcharts and / or block diagrams. These computer-readable program instructions may be stored on a computer-readable storage medium such that the instructions cause the computer, programmable data processing apparatus, and / or other device to operate in a particular manner such that the computer-readable medium on which the instructions are stored constitutes an article of manufacture containing instructions that implement each aspect of the functions / acts specified in one or more boxes in the flowcharts and / or block diagrams.

[0106] Loading the computer-readable program instructions into a computer, other programmable data processing apparatus, or other device causes the computer, other programmable data processing apparatus, or other device to perform a series of operational steps to produce a computer-implemented process, such that the instructions executing on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in one or more boxes in the flowcharts and / or block diagrams.

[0107] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of various possible systems, methods, and computer program products according to the present invention. In this regard, each box in the flowcharts or block diagrams may represent a module, program segment, or portion of instructions, which includes one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions depicted in the boxes may occur in a different order than depicted in the figures. For example, two consecutive boxes may actually be executed substantially in parallel, or may be executed in the reverse order, depending on the functionality involved. It should also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented by a special-purpose hardware-based system that performs the specified function(s) or operation(s), or by a combination of special-purpose hardware and computer instructions.

[0108] Although various implementations of the present invention have been described above, the above descriptions are illustrative and not exhaustive, and are not limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is intended to best interpret the principles, practical applications, or improvements to commercially available technologies of the implementations, or to enable those skilled in the art to understand the implementations disclosed herein.

Claims

1. providing a plurality of material identifiers corresponding to a plurality of photographed materials of at least a second type in response to determining that at least a first type of first photographed material has been selected, the plurality of photographed materials being associated with the first photographed material; acquiring a second photographed material from the plurality of photographed materials in response to a selection operation on a material identifier from the plurality of material identifiers; presenting a first shot preview including the first shot material and the second shot material; Acquiring a second photographed material from the plurality of photographed materials includes: detecting a predetermined type of interactive gesture for switching materials simultaneously when a first material identifier from among the plurality of material identifiers is selected; determining that the second filmed material corresponding to the second material identifier has been selected from the plurality of filmed materials in response to the predetermined type of interactive gesture indicating switching from the first material identifier to a second material identifier. How to shoot content.

2. and determining, in response to detecting a same-type capture request for a multimedia content item of interest, that the first captured footage included in the video of interest has been selected. The content shooting method according to claim 1 .

3. if the multimedia content item of interest includes a third shot material of the second type, the plurality of shot materials includes at least the third shot material; The content shooting method according to claim 2 .

4. determining, in response to selecting the first photographic material, that the third photographic material is selected by default; presenting a second shot preview including the first shot material and the third shot material. The content shooting method according to claim 3 .

5. Presenting the first photographing preview includes: switching from the second capture preview to the first capture preview in response to detecting that a material identifier corresponding to the second capture material has been selected. The content shooting method according to claim 4 .

6. and, in response to determining that the second filmed material has been selected, prominently presenting the material identifier corresponding to the second filmed material. The content shooting method according to claim 1 .

7. The plurality of material identifiers are presented on a start shooting page for starting shooting, the start shooting page including a portal of the second type of shooting material selection interface; The content shooting method includes: and, in response to detecting a trigger indication for a portal of the footage selection interface, ceasing the presentation of the plurality of footage identifiers and presenting the footage selection interface. The content shooting method according to claim 1 .

8. Presenting the footage selection interface includes: and prominently presenting a material identifier corresponding to the second photographic material in the photographic material selection interface in response to detecting the trigger indication on a portal of the photographic material selection interface simultaneously with the selection of the second photographic material. The content shooting method according to claim 7 .

9. submitting the plurality of material identifiers presenting the plurality of material identifiers in a sidebar of the page. The content shooting method according to claim 1 .

10. further comprising: stopping presentation of the plurality of material identifiers in response to detecting a stop presentation instruction for the plurality of material identifiers. The content shooting method according to claim 1 .

11. and switching from the first shooting preview to a third shooting preview in response to detecting a stop instruction to stop use of a second type of filmed material, the third shooting preview including at least the first filmed material. The content shooting method according to claim 1 .

12. submitting the plurality of material identifiers determining a set of candidate filmed material of the second type that is included in the multimedia content item along with the first filmed material; selecting the plurality of filmed footage from the set of candidate filmed footage based on at least one of a popularity of the set of candidate filmed footage and user interaction activity associated with the set of candidate filmed footage; and providing the plurality of material identifiers corresponding to the determined plurality of filmed materials. The content shooting method according to claim 1 .

13. a material presentation module for presenting a plurality of material identifiers corresponding to a plurality of photographed materials of at least a second type in response to determining that at least a first type of first photographed material has been selected, the plurality of photographed materials being associated with the first photographed material; a material selection module for acquiring a second captured material from the plurality of captured materials in response to a selection operation on a material identifier from the plurality of material identifiers; a first preview presentation module for presenting a first shot preview including the first shot material and the second shot material; The material selection module: detecting a predetermined type of interactive gesture for switching materials simultaneously when a first material identifier from among the plurality of material identifiers is selected; and determining that the second filmed material corresponding to the second material identifier has been selected from the plurality of filmed materials in response to the predetermined type of interactive gesture indicating switching from the first material identifier to a second material identifier. Equipment for content shooting.

14. 1. An electronic device comprising: at least one processing unit; and at least one memory coupled to said at least one processing unit for storing instructions to be executed by said at least one processing unit, said instructions, when executed by said at least one processing unit, causing said electronic device to perform the method of any one of claims 1 to 12. The electronic device.

15. A computer program is stored, and when the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented. A computer-readable storage medium.

Images