Method, apparatus, device, and storage medium for content capture

Abstract

According to an embodiment of the present invention, a method, an apparatus, a device, and a storage medium for content shooting are provided. The method includes: in response to determining that at least a first type of first shooting material is selected, providing a plurality of material identifiers corresponding to at least a second type of multiple shooting materials, the plurality of shooting materials being associated with the first shooting material; determining a selected shooting material from the plurality of shooting materials based on a selection operation on a material identifier from the plurality of material identifiers; and in response to determining that a second shooting material from the plurality of shooting materials is selected, providing a first shooting preview including the first shooting material and the second shooting material. This allows a user to more conveniently and quickly select materials and create content, and improves the user's shooting experience.

Description

[Technical field]

[0001] [Cross-reference to related applications] This application claims priority to a Chinese invention patent application filed on June 28, 2022, entitled "Method, Apparatus, Device, and Storage Medium for Content Shooting" and bearing application number CN202210754280.X. [Technical field] FIELD Exemplary embodiments of the present invention relate generally to the field of multimedia processing, and more particularly, to methods, apparatus, devices, and computer-readable storage media for content capture. [Background technology]

[0002] Currently, there are an increasing number of applications designed to provide various services to users. For example, in a content sharing application, a user can view, comment on, and forward various content, such as multimedia content including videos, images, image collections, sounds, etc. In addition, in a content sharing type application, a user can also take and share media content, such as photos, videos, animated graphics, etc. When taking media content, the application provides a variety of taken materials from which the user can select to create personalized media content. Summary of the Invention

[0003] In a first aspect of the present invention, there is provided a content shooting method, the method including: in response to determining that at least a first type of first filmed material has been selected, presenting a plurality of material identifiers corresponding to at least a second type of multiple filmed materials, the plurality of filmed materials being associated with the first filmed material, determining a selected filmed material from the plurality of filmed materials based on a selection operation on a material identifier from the plurality of material identifiers, and in response to determining that a second filmed material from the plurality of filmed materials has been selected, presenting a first filmed preview including the first filmed material and the second filmed material.

[0004] In a second aspect of the present invention, there is provided an apparatus for content filming, the apparatus comprising: a material presenting module for presenting a plurality of material identifiers corresponding to at least a second type of a plurality of filmed materials in response to determining that at least a first type of first filmed material has been selected, the plurality of filmed materials being associated with the first filmed material, a material selection module for determining a selected filmed material from the plurality of filmed materials based on a selection operation on a material identifier from the plurality of material identifiers, and a first preview presenting module for presenting a first filmed preview including the first filmed material and the second filmed material in response to determining that a second filmed material from the plurality of filmed materials has been selected.

[0005] In a third aspect of the present invention there is provided an electronic device comprising at least one processing unit and at least one memory coupled to the at least one processing unit for storing instructions adapted to be executed by the at least one processing unit which, when executed by the at least one processing unit, cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of the present invention, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of the first aspect.

[0007] It should be understood that the contents described in the summary of the present invention are not intended to limit the main or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will be readily understood from the following description. [Brief description of the drawings]

[0008] The above and other features, advantages, and aspects of the embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the drawings, in which the same or similar symbols indicate the same or similar elements, and in which: [Figure 1] 1 shows a schematic diagram of an exemplary environment in which embodiments of the present invention may be implemented; [Diagram 2] 1 illustrates a flowchart of a process for content capture according to some embodiments of the present invention; [Figure 3A] ~ [Figure 3D] 1 illustrates a schematic diagram of an example page related to content capture according to some embodiments of the present invention; [Figure 4A] ~ [Figure 4D] 1 illustrates a schematic diagram of an exemplary page related to content capture according to some embodiments of the present invention; [Figure 5A] ~ [Figure 5E] 1 illustrates a schematic diagram of an exemplary page related to content capture according to some embodiments of the present invention; [Figure 6A] ~ [Figure 6B] 1 illustrates a schematic diagram of an exemplary page related to content capture according to some embodiments of the present invention; [Figure 7A] ~ [Figure 7B] 1 illustrates a schematic diagram of an exemplary page related to content capture according to some embodiments of the present invention; [Figure 8] FIG. 1 is a block diagram of an apparatus for content filming according to some embodiments of the present invention; [Figure 9] 1 illustrates an electronic device in which one or more embodiments of the present invention may be implemented. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] In the following, the embodiments of the present invention will be described in more detail with reference to the drawings. Although the drawings show specific embodiments of the present invention, it should be understood that the present invention can be implemented in various forms and should not be construed as being limited to the embodiments described herein, but rather, these embodiments are provided for a more thorough and complete understanding of the present invention. It should be understood that the drawings and embodiments of the present invention are for illustrative purposes and are not used to limit the protection scope of the present invention.

[0010] In describing embodiments of the present invention, the term "comprising" and similar terms are intended to be open-ended inclusions such as "including, but not limited to." The term "based on" should be understood as "based at least in part on." The terms "one embodiment" or "the embodiment" should be understood as "at least one embodiment." The term "some embodiments" should be understood as "at least some embodiments." Other explicit and implicit definitions may be included below.

[0011] It is understood that any data related to the technical solution (including but not limited to the data itself, the acquisition of the data, or the use of the data) should comply with the corresponding laws and regulations and related specified requirements.

[0012] It is understood that before using the technical solutions disclosed in each embodiment of the present invention, the types, scope of use, and scenarios of personal information related to the present invention should be notified to users in an appropriate manner in accordance with relevant laws and regulations, and consent from users should be obtained.

[0013] For example, in response to receiving an unsolicited request from a user, presenting information is sent to the user to explicitly present to the user that the requested operation requires the acquisition and use of the user's personal information, so that the user can independently choose whether or not to provide the personal information to software or hardware, such as an electronic device, application, server, or storage medium, that performs the operation of the technical solution of the present invention, based on the presenting information.

[0014] As an optional, non-limiting implementation, the method of transmitting the presentation to the user in response to receiving the user's unsolicited request may be, for example, by utilizing a pop-up window in which the presentation may be displayed in the form of text and which may further include a selection control for the user to "agree" or "not agree" to providing the personal information to the electronic device.

[0015] It will be appreciated that the notification and user authorization process described above is merely a general outline and is not intended to limit the implementation of the present invention, and other methods that comply with relevant laws and regulations may be applied to the implementation of the present invention.

[0016] 1 shows a schematic diagram of an exemplary environment 100 in which an embodiment of the present invention can be implemented. In the exemplary environment 100, a terminal device 110 has an application 120 installed thereon. A user 140 can interact with the application 120 via the electronic device 110 and / or a device connected to the electronic device 110. The application 120 may be a content sharing type application and can provide the user 140 with various services related to the multimedia content items, including viewing, commenting, transferring, creating (e.g., taking and / or editing), publishing, etc. of the multimedia content items. As used herein, a "multimedia content item" includes one or more types of content, such as video, images, animated graphics, image collections, audio, text, etc.

[0017] 1, when an application 120 is active, the terminal device 110 may present pages 150 of the application 120. The pages 150 may include various pages that the application 120 may provide, such as a multimedia content submission page, a content creation page, a content publishing page, a message page, a personal page, etc. The application 120 may provide content creation functionality for photographing and / or creating multimedia content items, allow a user to edit photographed or uploaded multimedia content, etc. The application 120 further has a publishing functionality that allows a user 140 to publish the created multimedia content.

[0018] In some embodiments, the terminal device 110 communicates with the server 130 to implement the provision of services to the application 120. The terminal device 110 may be any type of mobile, fixed, or portable terminal, including a mobile cell phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio receiver, an e-book device, a gaming device, or any combination of the above, including accessories and peripherals of these devices or any combination thereof. In some embodiments, the terminal device 110 may also support any type of interface to a user (such as "wearable" circuitry). The server 130 may be any type of computing system / server capable of providing computing capabilities, including but not limited to a mainframe, an edge computing node, a computing device in a cloud environment, and the like.

[0019] It should be understood that the structure and function of each element in environment 100 is described for illustrative purposes only and does not imply any limitation to the scope of the invention.

[0020] When shooting a multimedia content item such as a video or a photo, a user can set the shooting materials to be used during shooting, such as background music, props, filters, stickers, and text to be applied to the video or photo. Currently, different portals related to various types of shooting material libraries are provided on the shooting start page. When these portals are triggered, different types of shooting material libraries are respectively displayed and the user can select from them. However, this process requires relatively complicated and time-consuming user operations. If a certain type of shooting material library contains a large amount of material, the user needs to spend more time browsing to find the appropriate material. Also, when creating multimedia content, the user needs to spend more time combining different types of shooting materials to shoot a satisfactory work. In some cases, if the portal or shooting material of a certain type of shooting material is located far back and not noticeable enough, the user may not realize that the certain shooting material is available.

[0021] Currently, some applications provide a function of same-type shooting for existing multimedia content items, which allows a user to directly add one or more types of shooting materials of the multimedia content items that the user is interested in to a new work that the user wants to shoot. However, if the user is not satisfied with a certain type of shooting material or needs to increase other types of shooting materials, the user still needs to search from the corresponding type of shooting material library, which brings inconvenience to the user and reduces the user experience.

[0022] According to an embodiment of the present invention, an improved solution for content shooting is provided. In the solution, when a specific shot material of one type is selected, a plurality of shot materials of another type associated with the selected shot material phase are presented for selection. When a specific shot material of the presented plurality of shot materials of the other type is also selected, a shooting preview including the selected shot material of the different type is presented. According to the solution, a user can conveniently and flexibly select a desired shot material from a smaller group of shot materials of another type, and the selected plurality of types of shot materials can be more relevant and ensure a higher degree of compatibility. This allows a user to select materials and create content more conveniently and quickly, and improves the user's shooting experience.

[0023] Several exemplary embodiments of the present invention will now be described with continued reference to the drawings.

[0024] 2 shows a flowchart of a process 200 for content capture according to some embodiments of the present invention. The process 200 may be implemented in a terminal device 110. For ease of discussion, the process 200 will be described with reference to the environment 100 of FIG.

[0025] In box 210, the terminal device 110 determines whether a first shot of a first type has been selected.

[0026] As used herein, "shot material" refers to material that can be added to a multimedia content item to be shot, including visual and / or audio material. Shot material can be categorized into various types, and different types of shot material can be applied simultaneously to the same multimedia content item to provide rich content in multiple dimensions. Examples of types of shot material can include background audio, such as background music, background voice, or other types of audio. Types of shot material can further include props, filters, text, stickers, special effects, shooting templates, and any other material that can be added to a multimedia content item.

[0027] Different types of filmed materials may include multiple filmed materials that can be selected. Prop-type filmed materials may include an overall package for filmed materials to add static or dynamic objects to the screen, provide interactive effects, change the color contrast of the screen, perform character makeup, etc. Filter-type filmed materials may be used to adjust the color curve of the screen to present different filter effects. Text-type filmed materials may add text of various styles to the filmed screen, and sticker-type filmed materials may add dynamic or static stickers of various styles to the filmed screen. Special effect-type filmed materials may include video special effects and / or audio special effects, which may change the presentation effects of the screen and / or sound. Filmed materials of the filming template type may control narrative effects for the video or image group to be filmed, such as cut and transition effects, screen textures, special effect styles, opening and ending control, subtitles, etc.

[0028] The above are just some examples of footage, and these footage can be classified with other rules according to different application needs and placement rules, and more, less, or other types of footage can be submitted.

[0029] In some embodiments, the application 120 installed on the terminal device 110 may provide a shooting function for shooting multimedia content items, such as videos, images, animated graphics, etc. When a shooting request is triggered, a shooting material for shooting may be determined. In some embodiments, the application 120 may provide multiple portals for triggering a shooting request, for example, portals for triggering a shooting request on various pages of the application. In some examples, the portals for triggering a shooting request may include a start shooting control, a same type shooting portal on a detail page of a particular multimedia content item or shooting material, a common shooting portal for a particular multimedia content item, etc. If necessary, a portal for triggering a shooting request on an appropriate page or page position in the application may be set.

[0030] To better understand the exemplary embodiment, the following description is given with reference to an exemplary page of an application.

[0031] 3A illustrates an exemplary page 300 of the application 120. The page 300 can be any page of the application 120. In the example of FIG. 3A, the page 300 is an information stream presentation page on which a multimedia content item 310 shared by a user is presented. In the example, the filmed material of the multimedia content item 310 includes at least background music and props 330, which provide a visually and aurally enriched experience. In the page 300, a detail page portal 322 of the background music "Music A" used in the multimedia content item 310 is further provided. The page 300 includes a start filming control 320 for triggering the presentation of a start filming page to start filming the multimedia content item.

[0032] It should be understood that page 300 of FIG. 3A and the pages of the other figures described below are merely example pages, and that in practice a variety of page designs may exist. Each graphical element within a page may have a different arrangement and different visual representation, one or more elements therein may be omitted or substituted, and one or more other elements may be present. Embodiments of the invention are not limited in this respect. Furthermore, it should be understood that in addition to example page 300, other pages of application 120 may present a start capture control and / or allow a start capture command to be initiated by other means.

[0033] In some cases, when a user is viewing a multimedia content item 310 and is interested in the background music "Music A" used therein, the user may trigger a detail page portal 322 for "Music A," for example by clicking on the portal 322. In response to receiving a trigger instruction for the detail page portal 322, the terminal device 110 presents the detail page 301 for "Music A," as shown in FIG. 3B. It should be noted that in addition to entering the detail page 301 for "Music A" from page 310, the application 120 may provide various other means of entering the detail page 301.

[0034] In the detail page 301, more information related to "Music A" can be provided, such as the cover, the creator, the number of people using it, etc. The detail page 301 can further provide an exhibition interface 324 of multimedia content items with "Music A" as background music for users to query.

[0035] The "Music A" detail page 301 further presents a "shoot same type" control 326 for the user to trigger to shoot the same type content of the currently interested multimedia content item. When the user triggers the "shoot same type" control 326, the terminal device 110 will detect a same type shooting request for the interested multimedia content item. In some embodiments, if the user enters the detail page 301 from the multimedia content item 310, it may be defaulted that the user is interested in the multimedia content item 310. In some embodiments, when it is detected that the user selects another multimedia content item in the detail page 301 and then triggers a same type shooting request, it may be determined that the user is interested in the selected multimedia content item.

[0036] When a same-type shooting request for a multimedia content item of interest is detected, a specific shooting material in the multimedia content item is selected by default for shooting. After a same-type shooting request is detected, the terminal device 110 presents the start shooting page 302, and as shown in FIG. 3C, the background audio selection box 328 indicates that "Music A" is selected as the background audio.

[0037] In some embodiments, as shown in FIG. 4A, when a user triggers (e.g., clicks) the start shooting control 320 in the page 300, the terminal device 110 detects the start shooting command and presents the start shooting page 302 shown in FIG. 4B. In the start shooting page 302 in FIG. 4B, the user can select background music for shooting, for example, by clicking the background audio selection box 328. After the background audio selection box 328 is clicked, a background audio selection interface, such as the background audio selection interface 430 shown in FIG. 4C, can be presented, in which multiple selectable background audios are listed. When the user selects the background audio "Music A", as shown in FIG. 4D, in the start shooting page 302, the background audio selection box 328 indicates that "Music A" is selected as the background audio.

[0038] In response to determining that at least a first type of first filmed material has been selected, in box 220, the terminal device 110 submits a plurality of material identifiers corresponding to at least a second type of plurality of filmed material associated with the previously selected first filmed material.

[0039] In an embodiment of the present invention, when a particular type of filmed material has already been selected, multiple related filmed materials of other types are actively recommended for the user to select from. In some embodiments, the user is allowed to select various filmed materials for filming on the start shooting page. Thus, material identifiers corresponding to multiple filmed materials of different types may be presented on the start shooting page. In this specification, a "material identifier" may be any form of identifier information, such as text, numbers, and / or icons, that can identify different filmed materials.

[0040] In some embodiments, the second type of filmed material may be different from the first type of filmed material. For example, the first type of filmed material may be background audio, and the second type of filmed material may be props, filters, or other materials. In some embodiments, multiple other types of filmed material (e.g., second and third types) associated with the already selected filmed material are presented, for example, material identifiers corresponding to one or more props and one or more filters are presented together. In some embodiments, when multiple types of filmed material have already been selected by the user, for example, when both the first type and the third type of filmed material have already been selected, another type of filmed material (e.g., second type) is recommended to the user, for example, material identifiers corresponding to the other types of filmed material are presented.

[0041] In some embodiments, the presented second type of filmed material may be a subset of all available filmed material of the second type that is deemed to match the type of filmed material currently selected by the user.

[0042] For convenience of explanation, in some examples of the present specification, it is assumed that when a background audio type of footage is selected, a prop type of footage is recommended. However, it should be understood that the present specification is not limited to these types of footage and the selection order. In other embodiments, when it is determined that another type of footage (e.g., a prop type or a filter type) is selected, the associated other type of footage (e.g., suitable for multiple background audios of the currently selected prop or filter) is presented. These specific implementations can be set as necessary, and the embodiments of the present invention are not limited in this respect.

[0043] In some embodiments, the first type may be configured as a particular type of filmed material and / or the second type may be configured as a particular type of filmed material, i.e., only if a particular or a subset of a particular type of filmed material is determined to be selected, other particular types of filmed material are recommended for selection by the user. In some embodiments, such special configuration may not be required and such an association may be established between each type of filmed material available, such that selection of any one type of filmed material may initiate the presentation of one or more other types of filmed material for selection by the user.

[0044] In some embodiments, if a particular filmed material of the second type and the currently selected filmed material of the first type are included in the same multimedia content item, the particular filmed material of the second type may be determined as a candidate filmed material associated with the selected filmed material of the first type. In this manner, a set of candidate filmed materials associated with the selected filmed material of the first type may be determined. In some embodiments, a plurality of filmed materials may be selected for presentation from the set of candidate filmed materials of the second type, taking into account that the interface for associated filmed material may be relatively limited.

[0045] In some embodiments, a number of the filmed materials may be selected for presentation based on the popularity of the set of candidate filmed materials of the second type. In some examples, the popularity of the candidate filmed materials may be measured based on the number or frequency with which the candidate filmed materials have been used, or the number or frequency with which the candidate filmed materials have been used together with the currently selected first type of filmed material. The more frequently or frequently the candidate filmed materials have been used, the more popular the candidate filmed materials are. In some embodiments, a predetermined number of the most popular candidate filmed materials are selected for presentation.

[0046] In some embodiments, the plurality of filmed materials may be selected for presentation based on user interaction behaviors associated with the set of candidate filmed materials of the second type, additionally or alternatively. User interaction behaviors may include, for example, user favorites, "likes," shares, comments, etc. For example, if a user favorites a particular candidate filmed material or favorites a multimedia content item that includes the candidate filmed material, the candidate filmed material may be selected for presentation. In an example considering various interaction behaviors, the candidate filmed materials may be scored based on different interaction behaviors, and candidate filmed materials with higher scores may be presented. Since more interaction behaviors mean that the user has a higher probability of selecting the candidate filmed material, the selection and presentation of these filmed materials may improve the convenience of filming for the user.

[0047] In some embodiments, the second plurality of filmed materials may be selected for presentation based simultaneously on the popularity of the candidate filmed materials and the associated user interaction activity, while in other embodiments, other factors may also be considered in determining the second plurality of filmed materials for presentation.

[0048] In the following, the presentation of the second type of filmed material will be described with reference to an exemplary page.

[0049] 3C, if a user wishes to film new content that includes a particular piece of footage (e.g., background audio) in a multimedia content item of interest, in addition to indicating that the same background audio "Music A" was selected on start filming page 302, a number of other types of filmed footage are presented with prop identifiers 343-1, 343-2, 343-3, 343-4, etc. (for ease of discussion, these may be collectively referred to as prop identifiers 343) that correspond to a number of props. The props indicated by these prop identifiers are considered to be associated with or match the currently selected "Music A."

[0050] In some embodiments, a plurality of material identifiers corresponding to a plurality of recommended filmed materials of the second type may be presented in a sidebar of a page (e.g., a start filming page). Depending on the size and configuration of the page, one or more material identifiers may be hidden and presented based on user interaction. As shown in Figures 3C and 4D, a plurality of prop identifiers 343 are presented in a right sidebar of the start filming page 302. Of course, material identifiers may be presented in other sidebars or other positions of the page depending on the needs of the actual page design.

[0051] In some embodiments, the start shooting page may further present various shooting setting or material selection interface portals related to the shooting. For example, as shown in Figures 3C and 4D, the start shooting page 302 may further present a filter selection interface portal 340 for triggering the display of a filter selection interface to display a plurality of selectable filters, a lens slip function 341 for switching the front lens or rear lens of the shooting camera, and a timer function 342 for setting a countdown for the shooting. The start shooting page 302 may include a prop selection interface portal 354 for triggering the display of a prop selection interface to display a plurality of selectable props, and an album portal 356 for accessing multimedia content in local or other data sources for subsequent creation.

[0052] In some embodiments, the start shooting page 302 may further provide other controls for controlling content shooting. For example, in FIG. 3C and FIG. 4D, the start shooting page 302 may further present a shooting control 352, and shooting may be started according to a trigger instruction for the shooting control 352.

[0053] In some examples, the start shooting page 302 corresponds to the shooting portal 350, and may further provide other function portals related to the camera, such as the live streaming portal 351 shown in FIG. 3C and FIG. 4D. When the selection of the live streaming portal 351 is detected, the page switches to the live streaming page. In some embodiments, the start shooting page 302 may further provide different shooting modes of the shooting function, such as a video shooting mode 355, a photo shooting mode 357, and an animation graphics shooting mode 359. In FIG. 3C and FIG. 4D, after entering the start shooting page 302, the video shooting mode 355 may be selected by default, and the user may switch to other shooting modes.

[0054] It should be understood that the functionality illustrated herein is merely exemplary, and that more, less, or different functionality may be provided on start shooting page 302, and embodiments of the invention are not limited in this respect. For example, in addition to the prop selection interface portal and the filter selection interface portal, portals for other types of footage selection interfaces may also be provided, such as text, stickers, etc.

[0055] In some embodiments, if the multimedia content item of interest of the same type that is to be shot further includes at least a second type of shot material, such as a prop type of shot material, in addition to the first type of shot material (e.g., background audio), the second type of shot material may be determined as a recommended shot material of the type, and a material identifier thereof is also presented. In some embodiments, the second type of shot material included in the multimedia content item of interest is selected by default. As shown in FIG. 3C, the multimedia content item of interest 310 includes not only "music A" but also a prop 330, so a prop identifier 343-2 corresponding to the prop 330 is presented on the page 302. The prop identifier 343-2 may also be presented in a selected state to indicate that the corresponding prop 330 is selected.

[0056] In some embodiments, a shot preview including the selected shot material may be further provided. For example, in the example of FIG. 3C, if "Music A" is selected and props 330 are selected by default, a shot preview 314 including "Music A" and props 330 may be provided.

[0057] In some implementations, if the multimedia content item of interest does not include the second type of filmed material or if the default selected second type of filmed material has not been determined by other means, the filmed preview may not include the default selected second type of filmed material. For example, in the example of Figures 4A-4D, after "Music A" is selected, no default selected props are provided, so the filmed preview 314 of Figure 4D does not include the props type of filmed material.

[0058] In some embodiments, a disable function for disabling the use of the second type of filmed material may be further provided in association with the plurality of material identifiers. A trigger instruction for the disable function triggers a disable instruction for disabling the use of the second type of filmed material, so that the second type of filmed material is not used for filming. As shown in FIG. 3C and FIG. 4D, a disable function 344 is provided to disable the use of the second type of filmed material, i.e., to indicate that the second type of filmed material is not selected for filming. In the example of FIG. 4D, after providing the prop identifiers 343 corresponding to the plurality of props, the disable function 344 is provided in a selected state because there is no second type of filmed material selected by default in the scene.

[0059] Continuing to refer to process 200 of FIG. 2, at box 230, a selected piece of footage from the plurality of footage is determined based on a selection operation on a material identifier from the plurality of material identifiers.

[0060] The material identifiers corresponding to the presented second type of filmed material can be selected for filming as needed by the user. Although the filming start page can also provide portals for several types of filmed material selection interfaces (e.g., filters, props, etc.), more interactive operations are required after triggering the filmed material selection interface using these portals, and the user needs to spend more time finding filmed material that meets his needs from a large amount of filmed material. According to an embodiment of the present invention, after at least the first type of filmed material is selected, material identifiers corresponding to at least the associated second type of multiple filmed materials are actively presented for the user to select. This allows the user to select the desired filmed material more conveniently and flexibly.

[0061] In some embodiments, the selection operation for the multiple material identifiers may be performed through a predetermined type of interaction gesture. In some embodiments, the predetermined type of interaction gesture for material switching may include a slide gesture and / or a click gesture. In some examples, the type of slide gesture may include a leftward slide gesture, a rightward slide gesture, an upward slide gesture, a downward slide gesture, or a slide gesture with other specific trajectories. The type of slide gesture selected specifically may be based on the arrangement form of the material identifiers, and may need to avoid conflict with interaction gestures used for other functions on the page. For example, in the examples of FIG. 3C and FIG. 4D, an upward slide gesture and a downward slide gesture may be configured to select or switch between different material identifiers. In some examples, it may also be possible to support selecting or switching between corresponding material identifiers through a click gesture.

[0062] In other embodiments, the selection operation for the plurality of material identifiers can also be performed through other types of interaction gestures supported by the terminal device, such as eye movement interaction gestures, facial gesture interaction gestures, and the like.

[0063] In some implementations, it may be supported to select or switch between footage identifiers corresponding to a second type of footage through a particular type of interaction gesture, and to trigger a disable function to disable use of the second type of footage, For example, in the example of Figures 3C and 4D, it may be supported to switch between a plurality of prop identifiers 343 and a disable function 344 through an upward and downward sliding gesture.

[0064] In some embodiments, guidance information regarding material switching may be provided to allow the user to understand how to select and switch to the submitted material identifier. As shown in FIG. 3D, a guidance mask layer is provided in the start shooting page 302, which includes text guidance information 360 and animation gesture guidance 362 to guide the user in prop switching. In some embodiments, such guidance information may be provided when submitting a material identifier corresponding to the recommended shooting material for the first time, or may be provided each time the material identifier is submitted. The scope of embodiments of the present invention is not limited in this respect.

[0065] In some embodiments, after presenting a plurality of material identifiers corresponding to a plurality of filmed materials of a second type, if a particular material identifier is currently selected (e.g., selected by default or manually selected by a user), the terminal device 110 can detect a predetermined type of dialogue gesture for switching material. When the predetermined type of dialogue gesture indicates switching from the currently selected material identifier to another material identifier, it can be determined that the filmed material corresponding to the other material identifier has been selected, that is, it can be determined that the second type of "second filmed material" has been selected. This allows flexibly switching between the plurality of material identifiers through the predetermined type of dialogue gesture to flexibly select or switch between different filmed materials.

[0066] As shown in FIG. 5A, in this example, it is assumed that the prop 330 corresponding to the prop identifier 343-2 is selected by default (e.g., the user is expecting the same type of shooting of the multimedia content item 310 of interest). When the user's upward sliding gesture 510 is detected and indicates switching from the prop identifier 343-2 to the adjacent prop identifier 343-3 below, it can be determined that the prop 332 corresponding to the prop identifier 343-3 is selected. As shown in FIG. 5B, the prop identifier 343-3 is presented in a selected state. After sliding to switch the material identifier, the material identifiers to be hidden below can be presented in order, and the material identifiers that slide out of the display area above can be hidden. For example, the prop identifier 343-1 is hidden in FIG. 5B, and another prop identifier 343-5 arranged below the prop identifier 343-4 is presented.

[0067] Continuing with process 200, if it is determined in box 240 that a second shot of the plurality of shots has been selected, the terminal device 110 presents a first shot preview including the selected first shot and the second shot.

[0068] 5A, upon detecting that prop 332 corresponding to prop identifier 343-3 has been selected, a shooting preview 514 may be presented that includes the currently selected first type of filmed material, "Music A," and the second type of filmed material, prop 332. For example, in the shooting preview 514, "Music A" may be played, and the visual effect (or animation effect, if any) of prop 332 may be presented.

[0069] In some embodiments, when it is determined that a particular filmed material is selected, a material identifier corresponding to the selected filmed material may be prominently presented. As used herein, prominent presentation of a material identifier refers to a presentation form of a selected material identifier being more easily identifiable than a presentation form of a non-selected material identifier. The material identifier may be prominently presented in one or various forms. In some embodiments, the more prominent presentation of the material identifier may be reflected in the presentation position and / or appearance of the material identifier. For example, a selected material identifier may be moved to a position among all presented material identifiers that is more easily visible to the user, such as a central position in the list. Also, for example, additionally or alternatively, the appearance of one or more aspects of the selected material identifier may be differentiated from other non-selected material identifiers. For example, a separate visual design may be added to the selected material identifier, or the color, shape, texture, shading, size, etc. of the representation of the selected material may be changed. Additionally, the selected material identifier may be prominently presented by any other means.

[0070] For example, in the example of FIG. 5B, the selected prop identifier 343-3 is moved upward and enlarged, and is shaded to distinguish it from the other prop identifiers. In some examples, in addition to the material identifier selected by the user, the default selected material identifier or the triggered disable function can also be prominently presented. For example, in the example of FIG. 5A, the default selected prop identifier 343-2 can also be prominently presented, and in the example of FIG. 4D, the selected disable function 344 can also be prominently presented.

[0071] In some cases, the user may switch the second type of filmed material multiple times, for example, through a predetermined type of dialogue gesture for switching material. Upon detecting that a material identifier corresponding to another filmed material of the second type is selected, the corresponding material identifier may be prominently presented, and the filmed preview may also be switched to include the other filmed material. If the first filmed material of the first type remains selected, the switched filmed preview may continue to include the first filmed material of the first type.

[0072] For example, in Fig. 5B, when "MUSIC A" is still selected, if a user's downward sliding gesture 512 is detected indicating a switch from the current prop identifier 343-3 to the adjacent prop identifier 343-2 above, it can be determined that the prop 330 corresponding to the prop identifier 343-2 has been selected again. As shown in Fig. 5C, the prop identifier 343-2 is presented in a selected state, and the shooting preview 514 of Fig. 5B is switched to a shooting preview including the other prop identifier and "MUSIC A". Of course, if a selection of another prop identifier by the user is detected in Fig. 5B, the shooting preview 514 can be switched to a shooting preview including the other prop identifier and "MUSIC A".

[0073] If the second type of filmed material is not recommended, when the user switches or selects the filmed material in the second type of filmed material selection interface, the identifier of the portal may be dynamically changed to the filmed material currently selected by the user. For example, in the example of FIG. 5A-FIG. 5C, the icon of the portal 354 in the prop selection interface changes according to the prop selected by the user in the prop selection interface, for example, showing the prop identifier corresponding to the currently selected prop. In the case where the second type of filmed material is separately presented in the embodiment of the present invention, even if the user switches or selects between the prop identifiers 343, the identifier of the portal in the filmed material selection interface does not change, thus avoiding user confusion and making the user pay attention to switching between the prop identifiers 343.

[0074] In some embodiments, when a stop instruction to stop using the second type of filmed material is detected, a filming preview including the first type of selected filmed material and the second type of selected filmed material is switched to another filming preview, which does not include the second type of filmed material but includes the first type of selected filmed material. For example, when a trigger instruction for the stop function 344 shown in Figure 5C is detected, a filming preview 314 in Figure 5C is switched to a filming preview 516 shown in Figure 5D, which still includes "music A" but does not include the prop type of filmed material, i.e., the presentation of the prop 330 is stopped.

[0075] In some embodiments, in addition to the material identifiers corresponding to the second type of filmed material and the stop function, a control for stopping the presentation of the material identifiers is further presented. For example, in the examples of FIG. 3C, FIG. 4D, and FIG. 5A-FIG. 5D, the start shooting page 302 further includes a stop presentation control 345. A trigger on the stop presentation control triggers a stop presentation instruction for the material identifiers. The trigger of the stop presentation instruction means that the user is no longer planning to switch or select between the recommended second type of filmed material. Thus, the presentation of the material identifiers corresponding to the second type of filmed material is stopped. For example, when a trigger instruction on the stop presentation control 345 is detected in FIG. 5D, the presentation of the multiple prop identifiers 343 is stopped on the start shooting page 302 as shown in FIG. 5E. Also, the stop function 344 for stopping the use of the second type of filmed material and the stop presentation control 345 for stopping the presentation of the material identifiers are no longer presented.

[0076] In some cases, if a particular second type of filmed material was already selected before the stop presentation instruction was detected, after the presentation of the material identifiers and other functions is stopped, the already selected second type of filmed material may still be selected and used for filming, for example, the already selected second type of filmed material may continue to be presented in the filming preview.

[0077] In some embodiments, if a page such as the start shooting page also includes a portal of a second type of filmed material selection interface, a trigger indication for the portal may be detected to present the filmed material selection interface and stop presenting the material identifiers. This is because, on the one hand, the user may select the desired second type of filmed material in the presented filmed material selection interface, and, on the other hand, the trigger for the filmed material selection interface may mean that the user does not want to use the filmed material currently recommended on the page and may want to select other filmed materials of the second type. The presented filmed material selection interface may include all available filmed materials of the second type. As shown in FIG. 6A, a user's trigger indication for the portal 354 of the prop selection interface is detected. In response to the trigger indication, a prop selection interface 620 shown in FIG. 6B is presented on the start shooting page 302, in which all props that can be provided by the application 120 can be found and selected.

[0078] In some embodiments, if a particular second type of filmed material is selected when a trigger indication is detected for a portal in the filmed material selection interface, for example, if prop 332 corresponding to prop identifier 343-3 is selected when portal 354 is triggered as shown in FIG 6A, the material identifier corresponding to the filmed material may be prominently presented in the filmed material selection interface. As shown in FIG 6B, prop identifier 343-3 may be presented first in prop selection interface 620, and shading may be added to indicate that the prop corresponding to the prop identifier has been selected. Of course, the second type of filmed material may be prominently presented in other ways.

[0079] In some embodiments, when a portal trigger instruction for a different type of filmed material selection interface other than the second type is detected, or when a trigger instruction for another function in the start shooting page is detected, the presentation of the material identifier corresponding to the second type of filmed material can be maintained. This allows the user to continue to select or change the second type of filmed material to be used after selecting another type of filmed material. For example, in the example of FIG. 6A, when a user triggers a portal 340 of the filter selection interface, a user triggers an album portal 356, or a user triggers a slip function 341, the presentation of the prop identifier 343 can be maintained in the start shooting page 302.

[0080] In some embodiments, when the user has already selected the first type, the second type, and / or other possible types of shooting materials in the start shooting page, a shooting instruction can be triggered. For example, a shooting control can be triggered to trigger a shooting instruction. In response to the selection of each type of shooting material and the detection of a shooting instruction, the already selected shooting materials can be used to shoot, for example, video, images, or animated graphics. As shown in FIG. 7A, a trigger instruction of a user to the shooting control 352 is detected. When the trigger instruction is detected, the shooting mode is a video shooting mode, and the shooting materials of the music type are "music A" and the shooting materials of the props type are props 332. Thus, as shown in FIG. 7B, a video can be started to be shot in the shooting page 703 using "music A" as background music and props 332.

[0081] 8 shows a block diagram of a schematic configuration of an apparatus 800 for content shooting according to some embodiments of the present invention. The apparatus 800 can be implemented as the electronic device 110 or included in the terminal device 110. Each module / component in the apparatus 800 can be implemented by hardware, software, firmware, or any combination thereof.

[0082] The apparatus 800 includes a material presenting module 810 for presenting a plurality of material identifiers corresponding to at least a second plurality of filmed materials in response to determining that at least a first type of first filmed material has been selected, the plurality of filmed materials being associated with the first filmed material. The apparatus 800 further includes a material selection module 820 for determining a selected filmed material from the plurality of filmed materials based on a selection operation on a material identifier from the plurality of material identifiers, and a first preview presenting module 830 for presenting a first filmed preview including the first filmed material and the second filmed material in response to determining that a second filmed material from the plurality of filmed materials has been selected.

[0083] In some embodiments, the device 800 further comprises a first shot material determination module for determining that a first shot material included in the video of interest is selected in response to detecting a same type shot request for the multimedia content item of interest.

[0084] In some implementations, if the multimedia content item of interest includes a third shot material of the second type, the plurality of shot materials includes at least the third shot material.

[0085] In some embodiments, the apparatus 800 further comprises a default material determination module for determining that the third shot material is selected by default in response to the first shot material being selected, and a second preview presentation module for presenting a second shot preview including the first shot material and the third shot material.

[0086] In some embodiments, the first preview presenting module 830 includes a first preview switching module for switching from the second shot preview to the first shot preview in response to detecting that a material identifier corresponding to the second shot material has been selected.

[0087] In some embodiments, the material selection module 820 includes a gesture detection module for detecting a predetermined type of interactive gesture for switching material simultaneously with a selection of a first material identifier from the plurality of material identifiers, and a gesture-based material selection module for determining that a second filmed material corresponding to the second material identifier from the plurality of filmed materials has been selected in response to the predetermined type of interactive gesture indicating a switch from the first material identifier to a second material identifier.

[0088] In some implementations, the predetermined type of interaction gestures includes at least one of a slide gesture and a click gesture.

[0089] In some embodiments, the apparatus 800 further comprises a first identifier prominence module for, in response to determining that the second filmed material has been selected, prominently presenting a material identifier corresponding to the second filmed material.

[0090] In some embodiments, the plurality of material identifiers are presented on a start shooting page for starting shooting, and the start shooting page includes a portal of a second type of filmed material selection interface. In some embodiments, the apparatus 800 further comprises a first stop presenting module for stopping the presenting of the plurality of material identifiers in response to detecting a trigger indication for the portal of the filmed material selection interface, and an interface presenting module for presenting the filmed material selection interface in response to detecting a trigger indication for the portal of the filmed material selection interface.

[0091] In some embodiments, the interface presentation module includes a second identifier prominence presentation module for prominently presenting a material identifier corresponding to the second filmed material in the filmed material selection interface in response to detecting a trigger indication for a portal in the filmed material selection interface simultaneously with the second filmed material being selected.

[0092] In some implementations, the material presentation module comprises a sidebar presentation module for presenting the plurality of material identifiers in a sidebar of a page.

[0093] In some implementations, the apparatus 800 further comprises a second stop and present module for stopping the presentation of the plurality of material identifiers in response to detecting a stop presentation instruction for the plurality of material identifiers.

[0094] In some embodiments, the device 800 further comprises a third preview switching module for switching from the first capture preview to a third capture preview in response to detecting a stop instruction to stop using the second type of capture material, the third capture preview including at least the first capture material.

[0095] In some embodiments, the first type is different from the second type, and the first type of footage or the second type of footage is selected from among the following types: background audio, props, filters, text, stickers, special effects, and photography templates.

[0096] In some embodiments, the material presentation module comprises a candidate material determination module for determining a set of candidate filmed materials of the second type that are included in the multimedia content item together with the first filmed material, a material determination module for selecting a plurality of filmed materials from the set of candidate filmed materials based on a popularity of the set of candidate filmed materials and a user interaction activity associated with the set of candidate filmed materials, and a determined material based presentation module for presenting a plurality of material identifiers corresponding to the determined plurality of filmed materials.

[0097] 9 illustrates a block diagram of an electronic device 900 capable of implementing one or more embodiments of the present invention. It should be understood that the electronic device 900 illustrated in FIG. 9 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 900 illustrated in FIG. 9 may implement the terminal device 110 of FIG. 1.

[0098] As shown in Fig. 9, the electronic device 900 is in the form of a general-purpose electronic device. The components of the electronic device 900 may include, but are not limited to, one or more processors or processing units 910, memory 920, storage device 930, one or more communication units 940, one or more input devices 950, and one or more output devices 960. The processing unit 910 may be a real or virtual processor and may perform various processes based on programs stored in the memory 920. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel, thereby improving the parallel processing capabilities of the electronic device 900.

[0099] The electronic device 900 typically includes a number of computer storage media. Such media may be any obtainable media accessible by the electronic device 900, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 920 may be volatile memory (e.g., registers, high-speed cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 930 may be removable or non-removable media and may include machine-readable media, such as a flash memory drive, a magnetic disk, or any other media, that may be used to store information and / or data (e.g., training data for training) and may be accessible within the electronic device 900.

[0100] The electronic device 900 may further include other removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 9, a magnetic disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to a path (not shown) by one or more data media interfaces. The memory 920 may include a computer program product 925 having one or more program modules, which are configured to perform various methods or operations of various embodiments of the invention.

[0101] The communication unit 940 implements communication with other electronic devices over a communication medium. Additionally, the functionality of the components of the electronic device 900 may be implemented as a single computing cluster or multiple computing machines that can communicate over a communication connection. Thus, the electronic device 900 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or other network nodes.

[0102] The input device 950 may be one or more input devices such as a mouse, a keyboard, a trackball, etc. The output device 960 may be one or more output devices such as a display, a speaker, a printer, etc. The electronic device 900 may further communicate, as necessary, with one or more external devices (not shown), such as a storage device, a display device, etc., via the communication unit 940, with one or more devices that allow a user to interact with the electronic device 900, or with any device (e.g., a netbook card, a modem, etc.) that allows the electronic device 900 to communicate with one or more other electronic devices. Such communication may be performed via an input / output (I / O) interface (not shown).

[0103] According to an exemplary implementation of the present invention, a computer-readable storage medium having computer-executable instructions stored thereon is provided, where the computer-executable instructions are executed by a processor to implement the above-mentioned method. According to an exemplary implementation of the present invention, a computer program product is further provided, the computer program product being tangibly stored on a non-transitory computer-readable medium and including computer-executable instructions executed by a processor to implement the above-mentioned method.

[0104] Aspects of the present invention are described herein with reference to flowchart and / or block diagrams of methods, apparatus, devices, and computer program products implemented by the present invention. It will be understood that each box in the flowchart and / or block diagrams, and combinations of boxes in the flowchart and / or block diagrams, can be implemented by computer readable program instructions.

[0105] These computer readable program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, or other programmable data processing apparatus to generate a machine such that, when the instructions are executed by a processing unit of the computer or other programmable data processing apparatus, they generate an apparatus for implementing the functions / operations specified in one or more boxes in the flowcharts and / or block diagrams. These computer readable program instructions may be stored on a computer readable storage medium such that the instructions cause the computer, programmable data processing apparatus, and / or other device to operate in a particular manner such that the computer readable medium on which the instructions are stored constitutes an article of manufacture including instructions that implement each aspect of the functions / operations specified in one or more boxes in the flowcharts and / or block diagrams.

[0106] Loading the computer readable program instructions into a computer, other programmable data processing apparatus, or other device causes the computer, other programmable data processing apparatus, or other device to perform a series of operational steps to produce a computer-implemented process, such that the instructions executing on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in one or more boxes in the flowcharts and / or block diagrams.

[0107] The flowcharts and block diagrams in the figures illustrate possible architectures, functions, and operations of some possible systems, methods, and computer program products according to the present invention. In this regard, each box in the flowcharts or block diagrams may represent a module, program segment, or part of instructions, which includes one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions depicted in the boxes may occur in a different order than depicted in the figures. For example, two consecutive boxes may in fact be executed substantially in parallel, or may be executed in reverse order depending on the functionality involved. It should also be noted that each box in the block diagrams and / or flowcharts, and combinations of boxes in the block diagrams and / or flowcharts, may be implemented by a special purpose hardware-based system that performs the specified functions or operations, or by a combination of special purpose hardware and computer instructions.

[0108] Although each implementation of the present invention has been described above, the above description is illustrative, not exhaustive, and is not limited to each disclosed implementation. Many modifications and changes will be apparent to those skilled in the art without departing from the scope and spirit of each described implementation. The selection of terms used in this specification is intended to best interpret the principles, practical applications, or improvements to technology in the marketplace of each implementation, or to enable those skilled in the art to understand each implementation disclosed in this specification.

Claims

1. providing a plurality of material identifiers corresponding to at least a second plurality of photographic materials in response to determining that at least a first type of first photographic material has been selected, the plurality of photographic materials being associated with the first photographic material; determining a selected filmed material from the plurality of filmed materials based on a selection operation for a material identifier from the plurality of material identifiers; presenting a first shooting preview including the first and second photographed materials in response to determining that a second photographed material is selected from the plurality of photographed materials; How to shoot content.

2. and determining, in response to detecting a same type capture request for a multimedia content item of interest, that the first captured footage included in the video of interest is selected. The content shooting method according to claim 1 .

3. if the multimedia content item of interest includes a third shot material of the second type, the plurality of shot materials includes at least the third shot material; The content shooting method according to claim 2 .

4. determining, in response to selecting the first photographic material, that the third photographic material is selected by default; presenting a second shot preview including the first shot material and the third shot material. The content shooting method according to claim 3 .

5. Presenting the first capture preview includes: switching from the second capture preview to the first capture preview in response to detecting a selection of a material identifier corresponding to the second capture material. The content shooting method according to claim 4.

6. Determining a selected filmed material from the plurality of filmed materials includes: detecting a predetermined type of dialogue gesture for switching materials simultaneously when a first material identifier of the plurality of material identifiers is selected; determining that the second filmed material corresponding to the second material identifier has been selected from among the plurality of filmed materials in response to the predetermined type of dialogue gesture indicating switching from the first material identifier to a second material identifier. The content shooting method according to claim 1 .

7. and in response to determining that the second filmed material is selected, prominently presenting the material identifier corresponding to the second filmed material. The content shooting method according to claim 1 .

8. The plurality of material identifiers are presented on a start shooting page for starting shooting, the start shooting page including a portal of the second type of shooting material selection interface; The content shooting method includes: and in response to detecting a trigger indication for a portal of the footage selection interface, ceasing the presentation of the plurality of footage identifiers and presenting the footage selection interface. The content shooting method according to claim 1 .

9. Presenting the footage selection interface includes: and conspicuously presenting a material identifier corresponding to the second photographic material in the photographic material selection interface in response to detecting the trigger indication on a portal of the photographic material selection interface simultaneously with the second photographic material being selected. The content shooting method according to claim 8.

10. submitting the plurality of material identifiers presenting the plurality of material identifiers in a sidebar of the page. The content shooting method according to claim 1 .

11. and stopping the presentation of the plurality of material identifiers in response to detecting a stop presentation instruction for the plurality of material identifiers. The content shooting method according to claim 1 .

12. and switching from the first capture preview to a third capture preview in response to detecting a stop instruction to stop use of a second type of filmed material, the third capture preview including at least the first filmed material. The content shooting method according to claim 1 .

13. submitting the plurality of material identifiers determining a set of candidate shot material of the second type that is included in the multimedia content item together with the first shot material; selecting the plurality of filmed materials from the set of candidate filmed materials based on at least one of a popularity of the set of candidate filmed materials and a user interaction activity associated with the set of candidate filmed materials; and providing the plurality of material identifiers corresponding to the determined plurality of filmed materials. The content shooting method according to claim 1 .

14. a material presentation module for presenting a plurality of material identifiers corresponding to at least a second plurality of photographed materials in response to determining that at least a first type of first photographed material has been selected, the plurality of photographed materials being associated with the first photographed material; a material selection module for determining a selected filmed material from the plurality of filmed materials based on a selection operation on a material identifier from the plurality of material identifiers; a first preview presenting module for presenting a first shot preview including the first shot material and the second shot material in response to determining that a second shot material of the plurality of shot materials has been selected; Equipment for content shooting.

15. 1. An electronic device comprising: At least one processing unit; and at least one memory coupled to said at least one processing unit for storing instructions to be executed by said at least one processing unit, said instructions, when executed by said at least one processing unit, causing said electronic device to perform the method according to any one of claims 1 to 13. The electronic device.

16. A computer program is stored, the computer program being executed by a processor to implement the method according to any one of claims 1 to 13. A computer-readable storage medium.

Images