Video creation method and electronic device
Through intelligent search and different forms of result presentation, electronic devices solve the problem of inefficiency of users when selecting image materials, achieving more efficient human-computer interaction for video creators.
Patent Information
- Application Number
- PCT/CN2024/112885
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-10
- Filing Date
- 2024-08-16
- Publication Date
- 2025-07-10
AI Technical Summary
In electronic devices, when users select image materials for video creation, the large number of images leads to low human-computer interaction efficiency and cumbersome selection process.
Through intelligent search and different forms of presentation results, electronic devices display image materials in the form of thumbnails or albums according to search requests, providing controls to facilitate the creation of videos quickly.
It improves the efficiency of image selection and the human-computer interaction efficiency of video creation, and simplifies the user operation process.
Smart Images

Figure CN2024112885_10072025_PF_FP_ABST
Abstract
Description
Video creation method and electronic device
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on October 27, 2023, with application number 202311418278.6 and invention name “A video production method and electronic equipment based on large models”, the entire contents of which are incorporated by reference into this application.
[0002] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on January 10, 2024, with application number 202410046038.6 and invention name “A video creation method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0003] The embodiments of the present application relate to the field of terminal technology, and in particular to a video creation method and electronic device. Background Art
[0004] On electronic devices like mobile phones and tablets, you can often create videos using video editing apps. For example, you can create a video by combining multiple images in the device's gallery app. In these video creation methods, the user first selects an image, and then the device generates a video based on the selected image.
[0005] However, electronic devices usually contain a large number of images, and it is very troublesome for users to select images from them, resulting in extremely low human-computer interaction efficiency in the video creation process.
[0006] Summary of the Invention
[0007] This application provides a video creation method and electronic device that can intelligently search for images in an electronic device and use them to create videos. Furthermore, the search results are presented in different forms according to different needs to facilitate video creation and improve the efficiency of human-computer interaction.
[0008] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0009] In a first aspect, the present application provides a video creation method, which is applied to an electronic device, wherein the electronic device can present search results in different forms for different image search requests (such as a first image search request and a second image search request).
[0010] Specifically, in response to a first image search request, a first search result is displayed, where the first search result includes first thumbnails of multiple first image materials and a first control. That is, in response to the first image search request, the electronic device presents the searched image materials in the form of thumbnails. In response to a triggering operation on the first control in the first search result, a first video is displayed, where the first video includes multiple first image materials.
[0011] And, in response to the second image search request, the second search results are displayed, and the second search results include multiple options of the first album and the first control. Each album includes a category of searched image materials, such as image materials of categories such as group photos and buildings. That is, in response to the second image search request, the electronic device presents the searched image materials in the form of an album. Among them, the multiple first albums include a second album, and the second album includes multiple second image materials. In response to the selection operation of the second album option, the second album is selected, that is, the image materials in the second album are selected to create a video. In response to the triggering operation of the first control in the second search result, the second video is displayed, and the second video includes multiple second image materials.
[0012] In summary, with this application, first, the electronic device can search and provide search results for image search requests without the user having to manually find images from the electronic device, thereby improving the efficiency of obtaining images. Furthermore, the electronic device can provide corresponding forms of search results for different image search requests to facilitate video creation. In addition, in the search results, the electronic device also provides a first control for quickly creating videos. This improves the human-computer interaction efficiency of the entire video creation process.
[0013] In a possible design of the first aspect, the second image search request includes a selection operation on an option of the second topic, or the second image search request includes a triggering operation on a second creation recommendation card. The second topic is a topic of video creation, the second creation recommendation card is a creation recommendation card for video creation, and the topic content of the second topic and the recommended subject of the second creation recommendation card include at least one of the following: birthdays, holidays, anniversaries, travel, and growth records. That is to say, the second image search request is a request related to the search needs of long time lines such as birthdays, holidays, anniversaries, travel, and growth records. Exemplarily, the second image search request is a selection operation on the topic options "Birthday Wishes" and "Growth Records" below, or the second image search request is a triggering operation on the creation recommendation card for the birthday wish video, the creation recommendation card for the anniversary video, the creation recommendation card for itinerary 1, and the creation recommendation card for revisiting destination 2 below.
[0014] It can be seen that in response to long-term search needs, electronic devices can present search results in the form of albums, thereby classifying and presenting a large amount of image materials so that users can select albums from them to create videos.
[0015] In a possible design of the first aspect, the first image search request includes a selection operation on an option of the first topic, or the first image search request includes a triggering operation on the first creation recommendation card. The first topic is a video creation topic, the first creation recommendation card is a creation recommendation card for video creation, and the topic content of the first topic and the recommended themes of the first creation recommendation card do not include birthdays, holidays, anniversaries, travel, and growth records. In other words, the first image search request is not a request related to the search needs of the above-mentioned long time line. Exemplarily, the first image search request is a selection operation on the topic option "Spring Travel" below, or the first image search request is a triggering operation on the creation recommendation card of the newly added image below.
[0016] It can be seen that for the search needs of a short timeline, electronic devices can present search results in the form of thumbnails, so that part or all of the materials in the search results can be intuitively presented to help users determine whether to use these image materials to create videos.
[0017] In a possible design of the first aspect, the electronic device may also present the search results in a corresponding form based on the quantity of the searched image materials (recorded as less than the first quantity, greater than or equal to the first quantity).
[0018] Specifically, the displaying of the first search result in response to the first image search request includes: displaying the first search result in response to the first image search request when the electronic device searches for fewer than a first number of image materials matching the first image search request (i.e., number 1 hereinafter). In other words, when fewer image materials are found, the electronic device presents the search results in the form of thumbnails.
[0019] Furthermore, the displaying of the second search results in response to the second image search request includes: displaying the second search results in response to the second image search request, if the electronic device finds a number of image materials matching the second image search request that is greater than or equal to a second number. That is, when a large number of image materials are found, the electronic device presents the search results in the form of an album, thereby categorizing the searched image materials and facilitating user viewing and video creation.
[0020] As can be seen, with this design, the electronic device may find different numbers of image materials for different image search requests (such as the first image search request and the second image search request), and the search results will be presented in different formats. Furthermore, at different time points, even for the same image search request, the electronic device may find different numbers of image materials, and accordingly, the electronic device will present the search results in different formats.
[0021] In a possible design method of the first aspect, in a scenario where search results are presented in the form of an album, the album presented by the electronic device may be different depending on the search object (such as searching for image materials of people, searching for image materials of travel, etc.).
[0022] Specifically, in response to the second image search request, displaying second search results, wherein the second search results include multiple options for the first album, includes: in response to the second image search request, and the second image search request includes searching for image materials of people, i.e., the second image search request searches for image materials of people, and the multiple first albums include albums of at least two of the following categories: group photos, portraits, birthdays, holidays, and travel. Alternatively, in response to the second image search request, and the second image search request includes searching for image materials of travel, i.e., the second image search request searches for image materials of travel, and the multiple first albums include albums of at least two of the following categories: portraits, architecture, scenery, and group photos.
[0023] That is to say, by adopting this design method, the electronic device can present different albums in the search results according to different search objects, so that the searched image materials can be presented according to the album that matches the current image search requirements, so that users can view and create videos.
[0024] In a possible design of the first aspect, in a scenario where search results are presented in the form of an album, the electronic device can also provide an entry for adding custom albums (i.e., entry 3 below, such as "Custom"), for users to add custom albums for creating videos.
[0025] Specifically, the second search result also includes an entry for adding a custom album. Before displaying the second video in response to triggering the first control in the second search result, the method further includes: displaying thumbnails of multiple image assets in the electronic device's gallery application in response to triggering the entry for adding the custom album. That is, the image assets in the gallery application are provided to the user for selection. In response to selecting and confirming the addition of at least one second thumbnail, the second search result is displayed, the entry for adding the custom album in the second search result is updated to the custom album, and the custom album is selected. The at least one second thumbnail corresponds to at least one third image asset in the gallery application. In other words, selecting the at least one second thumbnail is equivalent to selecting the at least one third image asset in the gallery application. Furthermore, after adding the image asset through the entry for adding the custom album, the electronic device displays the custom album in the second search result and selects the custom album by default for video creation. Accordingly, the second video includes not only the multiple second image assets but also the at least one third image asset from the custom album.
[0026] As can be seen, the electronic device can not only provide albums corresponding to the searched image materials for the user to select for video creation, but also provide an entry for adding custom albums for the user to add custom albums. In this way, the electronic device can create a video by combining the searched image materials with the image materials added by the user.
[0027] In a possible design of the first aspect, the electronic device may provide different editing controls according to different search requirements (such as satisfying the first condition or not satisfying the first condition).
[0028] Specifically, the above method also includes: in response to the triggering operation of the first control in the second search result, and the second image search request meets the first condition, displaying the first editing control of the second video (i.e., "text blessing" hereinafter). In response to the triggering operation of the first control in the second search result, but the second image search request does not meet the first condition, displaying the second editing control of the second video (i.e., "smart text" hereinafter). Among them, the first condition includes: the image search request includes a selection operation for an option of a third topic, and the third topic is a topic of video creation; or, the image search request includes a triggering operation for a third creation recommendation card, and the third creation recommendation card is a creation recommendation card for video creation; the topic content of the third topic and the recommended theme of the third creation recommendation card include at least one of the following: birthdays, holidays, and anniversaries.
[0029] That is to say, if the image search request is a request related to the search needs for special days such as birthdays, holidays, and anniversaries, such as the selection operation of the topic option "Birthday Wishes" below, or the triggering operation of the creation recommendation card of the birthday wishes video and the creation recommendation card of the anniversary video below, the electronic device can provide a first editing control. If the search request is a request unrelated to the search needs for special days such as birthdays, holidays, and anniversaries, such as the selection operation of the topic option "Spring Travel" below, or the triggering operation of the creation recommendation card of Itinerary 1 and the creation recommendation card of Revisit Destination 2 below, the electronic device can provide a second editing control. In this way, the editing control provided by the electronic device can meet the needs of editing videos under different search needs.
[0030] It should be noted that the first image search request is similar, that is, if the first condition is met, the first editing control is provided, and if the first condition is not met, the second editing control is provided.
[0031] In a possible design of the first aspect, the first editing control can be used to add text blessings to the video.
[0032] Specifically, after displaying the first editing control of the second video, the method further includes: displaying the first greeting in response to a triggering operation on the first editing control of the second video. In response to a confirmation operation (such as clicking on "Confirm" in the greeting card), displaying a third video, the third video including the plurality of second image materials and the first greeting.
[0033] That is, by providing the first editing control, the electronic device can provide an entry for adding text blessings to videos created based on search requirements for special days such as birthdays, holidays, and anniversaries, thereby conveniently adding blessings to videos in need.
[0034] In one possible design of the first aspect, for all image search requests (second image search request, third image search request, etc.) that meet the first condition, after a video is created, the electronic device provides a first editing control for adding a greeting to the video. However, the greeting provided by the electronic device varies for different image search requests and / or different albums selected by the user.
[0035] Specifically, after displaying the third video in response to a confirmation operation, or before displaying the second search results in response to a second image search request, the method further includes: displaying third search results in response to the third image search request, the third search results including a plurality of third album options and a first control, the plurality of third albums including a fourth album, the fourth album including a plurality of fourth image materials. In response to a selection operation on the fourth album option, the fourth album is selected. In response to a triggering operation on the first control in the third search result, and the third image search request meeting the first condition, displaying a fourth video and a first editing control for the fourth video, the fourth video including a plurality of fourth image materials. The third image search request is different from the second image search request, e.g., the second image search request is for a birthday-related search request, while the third image search request is for an anniversary-related search request. And / or, the fourth album and the first album are of different categories, i.e., the user selected different albums, e.g., the first album is a group photo album, while the fourth album is an album of birthdays over the years. Accordingly, in response to the triggering operation of the first editing control of the fourth video, the second blessing is displayed, and the second blessing is different from the first blessing. In response to the confirmation operation, the fifth video is displayed, and the fifth video includes multiple fourth image materials and the second blessing;
[0036] That is to say, the electronic device can provide targeted blessings so that the blessings match the image search request and the album selected by the user.
[0037] In a possible design method of the first aspect, the video obtained after editing through various editing controls (including the first editing control and the second editing control mentioned above) is displayed after the original video to achieve the effect of additional dialogue.
[0038] Specifically, the displaying of the third video in response to the confirmation operation includes: displaying the third video after the second video in response to the confirmation operation. That is, the electronic device displays the third video with the added greetings after the original second video.
[0039] In a possible design method of the first aspect, different from the above-mentioned method of editing the video through the editing control, after editing the video by triggering the video to enter the video editing interface, the electronic device will replace the original video with the edited video (recorded as the sixth video) instead of continuing to append the edited video.
[0040] Specifically, after displaying the second video, the method further includes: in response to a trigger operation on the second video, displaying an editing interface for the second video (such as the video editing interface described below). After completing and saving the editing in the editing interface, in response to a return operation, replacing the second video with a sixth video, where the sixth video is the saved edited video.
[0041] It should be noted that the display principle for the edited first video is similar and will not be repeated here.
[0042] That is to say, the electronic device can ensure that when editing is triggered from the video itself (such as performing a trigger operation on the second video), the video before editing is replaced by the edited video; and when editing is triggered from the editing control (such as performing a trigger operation on the first editing control), the edited video is displayed in addition.
[0043] In one possible design of the first aspect, when at least one of the electronic device's time, location, and newly added image materials in its gallery application meets the second condition, a creation recommendation card is displayed, such as a creation recommendation card for a birthday video or a creation recommendation card for an anniversary video. The first image search request and / or the second image search request includes a triggering operation for the creation recommendation card. For details, please refer to the description of Method 5 below and will not be repeated here.
[0044] In other words, electronic devices can intelligently push creation recommendation cards to trigger image searches and video creation.
[0045] In a possible design of the first aspect, the electronic device can also push a floating image search entrance in the gallery application.
[0046] Specifically, the above method also includes: in response to starting the gallery application, displaying the first interface of the gallery application (such as the main interface of the gallery application), and the first interface includes a floating image search entrance. Or, in response to starting the gallery application, displaying the first interface of the gallery application. When the sliding speed of the first interface exceeds the first speed and / or the sliding displacement exceeds the first displacement, that is, when the user has a need to find an image, a floating image search entrance is displayed in the first interface. In response to the triggering operation of the floating image search entrance, a dialog box is displayed. The first image search request and / or the second image search request includes inputting an image search voice or an image search text in the dialog box.
[0047] That is to say, the electronic device can provide an entrance for quickly searching for image materials in the gallery application through the floating image search entrance in the gallery application, thereby meeting the need for fast image search.
[0048] In a second aspect, the present application provides a video creation method, which is applied to an electronic device, in which a voice assistant application and a gallery application are installed. Specifically, the voice assistant application is started and a dialog box is displayed. In response to a search request, search results are displayed in a dialog box, and the search results include information of at least one image material from the image materials searched from the gallery application and a first control. In response to a triggering operation on the first control, a first video is displayed in a dialog box, and the first video includes one or more searched image materials.
[0049] In summary, using this application, after launching a voice assistant application, an electronic device can provide a smart search function for images in a gallery application, allowing for quick image searches within the gallery application. Furthermore, within the search results, the electronic device also provides a first control for quickly creating videos. This improves the efficiency of human-computer interaction throughout the video creation process.
[0050] In one possible design of the second aspect, launching the voice assistant application includes: launching the voice assistant application in response to a first operation. The first operation includes any of the following: waking up the voice assistant application, as described in Method 1 below; triggering the application icon of the voice assistant application, as described in Method 2 below; triggering a creation recommendation card, as described in Method 5 below; and triggering a floating image search entry in a gallery application, as described in Method 6 below.
[0051] In a possible design of the second aspect, the first operation may further include a triggering operation on the video creation portal. In response to the user's triggering operation on the video creation portal, such as a click operation, the mobile phone may respond in the following two situations.
[0052] Specifically, the above-mentioned starting of the voice assistant application and displaying of the dialog box include: in a first case (such as case 1 below), in response to a trigger operation on the video creation entrance, starting the voice assistant application, displaying topic options of multiple video creation topics, the topic options of multiple video creation topics include a target topic option, and displaying a dialog box in response to the user's selection operation of the target topic option. Among them, the first case includes: no trigger operation on the video creation entrance has been received, or the image in the gallery application does not meet the creation conditions. That is to say, if it is the first time to perform a trigger operation on the video creation entrance, or the creation conditions are not met, the electronic device will provide topic options for the user to select and create a video.
[0053] Alternatively, the above-mentioned starting of the voice assistant application and displaying of the dialog box include: in the second case (such as Case 2 below), in response to the trigger operation on the video creation entrance, starting the voice assistant application and displaying a dialog box, the dialog box includes a guiding wording, and the guiding wording is used to guide the user to input a search request. For example, the guiding wording is "Try inputting "parent-child time" and start creating videos." Among them, the second case includes: a trigger operation on the video creation entrance has been received, and the image in the gallery application meets the creation conditions. That is to say, if it is not the first time that the trigger operation is performed on the video creation entrance and the creation conditions are met, the electronic device will directly guide the user to input a search request in the dialog box.
[0054] In a possible design method of the second aspect, the image search request includes any of the following: a triggering operation on a creation recommendation card, which can also be seen in Method 5 below; a selection operation on a target topic option, which can be seen in Method 3 below; and inputting voice or text indicating an image search in a dialog box, which can be seen in Method 1, Method 2, Method 4, and Method 6 below.
[0055] In one possible design of the second aspect, the image search request includes a selection operation for a target topic option of the second topic, or the image search request includes a triggering operation for a second creation recommendation card, and the information of the at least one image material includes a thumbnail of the at least one image material. The second topic is a video creation topic, the second creation recommendation card is a creation recommendation card for video creation, and the topic content of the second topic and the recommended theme of the second creation recommendation card include at least one of the following: birthdays, holidays, anniversaries, travel, and growth records.
[0056] In other words, image search requests are related to long-term search needs such as birthdays, holidays, anniversaries, travel, and growth records. For example, an image search request is a selection operation for the topic options "Birthday Wishes" and "Growth Records" below, or it is a triggering operation for the creation recommendation cards for birthday wish videos, anniversary videos, itinerary 1, and revisit destination 2. As can be seen, to meet long-term search needs, electronic devices can present search results in the form of albums, thereby categorizing and presenting a large amount of image material so that users can select from them to create videos.
[0057] In one possible design of the second aspect, the image search request includes a selection operation for a target topic option of the first topic, or the image search request includes a trigger operation for a first creation recommendation card, and the search results also include multiple album options, an album includes one or more image materials, and the information of at least one image material includes multiple album option covers, and each album option cover is a thumbnail of an image material included in the album. The first topic is a video creation topic, the first creation recommendation card is a creation recommendation card for video creation, and the topic content of the first topic and the recommended themes of the first creation recommendation card do not include birthdays, holidays, anniversaries, travel, and growth records.
[0058] In other words, the image search request is not a request related to the long-term search needs mentioned above. For example, the image search request is a selection operation for the topic option "Spring Travel" below, or the image search request is a trigger operation for the creation recommendation card of the newly added image below. It can be seen that for the search needs of a short timeline, the electronic device can present the search results in the form of thumbnails, so that some or all of the materials in the search results can be intuitively presented, so that the user can determine to use these image materials to create a video.
[0059] In one possible design of the second aspect, the multiple albums include a second album. Before displaying the created first video in the dialog box in response to a triggering operation on the first control, the method further includes: selecting the second album in response to a selection operation on an option in the second album. The created first video includes image material from the second album. In other words, the electronic device can create a video based on the album selected by the user.
[0060] In a possible design of the second aspect, the method further includes: in response to a trigger operation on the first control, and the image search request satisfies the first condition, displaying the first editing control (i.e., "text blessing" hereinafter). In response to a trigger operation on the first control, but the image search request does not satisfy the first condition, displaying the second editing control (i.e., "smart text" hereinafter). The first condition includes: the image search request includes a selection operation on an option of a third topic, and the third topic is a topic of video creation; or, the image search request includes a trigger operation on a third creation recommendation card, and the third creation recommendation card is a creation recommendation card for video creation; the topic content of the third topic and the recommended theme of the third creation recommendation card include at least one of the following: birthdays, holidays, and anniversaries.
[0061] That is to say, if the image search request is a request related to the search needs for special days such as birthdays, holidays, and anniversaries, such as the selection operation of the topic option "Birthday Wishes" below, or the triggering operation of the creation recommendation card of the birthday wishes video and the creation recommendation card of the anniversary video below, the electronic device can provide a first editing control. If the search request is a request unrelated to the search needs for special days such as birthdays, holidays, and anniversaries, such as the selection operation of the topic option "Spring Travel" below, or the triggering operation of the creation recommendation card of Itinerary 1 and the creation recommendation card of Revisit Destination 2 below, the electronic device can provide a second editing control. In this way, the editing control provided by the electronic device can meet the needs of editing videos under different search needs.
[0062] In one possible design of the second aspect, after displaying the first edit control, the method further includes: displaying the first greeting in response to a triggering operation on the first edit control; and displaying a second video in response to a confirmation operation, the second video including the one or more searched image materials and the first greeting.
[0063] That is, by providing the first editing control, the electronic device can provide an entry for adding text blessings to videos created based on search requirements for special days such as birthdays, holidays, and anniversaries, thereby conveniently adding blessings to videos in need.
[0064] In a possible design of the second aspect, displaying the second video in response to a confirmation operation includes: displaying the second video after the first video in response to the confirmation operation.
[0065] That is to say, the video obtained after editing through various editing controls (including the first editing control and the second editing control mentioned above) is displayed after the original video to achieve the effect of additional dialogue.
[0066] In one possible design of the second aspect, after the first video is displayed in the dialog box, the method further includes: displaying an editing interface for the first video in response to a triggering operation on the first video. After completing and saving the editing in the editing interface, in response to a return operation, replacing the first video with a third video, where the third video is the saved edited video.
[0067] That is to say, the difference from the above-mentioned video editing through the editing control is that after entering the video editing interface through the triggering operation of the video to edit the video, the electronic device will replace the original video with the edited video instead of continuing to append the edited video.
[0068] In a third aspect, the present application further provides an electronic device comprising a display screen, a memory, and one or more processors. The display screen, the memory, and the processor are coupled. The memory is configured to store computer program code, which comprises computer instructions. When the computer instructions are executed by the processor, the electronic device performs the method of the first aspect and any possible design thereof.
[0069] In a fourth aspect, the present application provides a chip system, which is applied to an electronic device including a display screen and a memory; the chip system includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected by lines; the interface circuit is used to receive signals from the memory of the electronic device and send signals to the processor, the signals including computer instructions stored in the memory; when the processor executes the computer instructions, the electronic device executes the method as described in the first aspect and any possible design method thereof.
[0070] In a fifth aspect, the present application provides a computer storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method of the first aspect and any possible design thereof.
[0071] In a sixth aspect, the present application provides a computer program product, which, when executed on a computer, enables the computer to execute the method according to the first aspect and any possible design thereof.
[0072] It can be understood that the beneficial effects that can be achieved by the electronic device of the third aspect, the chip system of the fourth aspect, the computer storage medium of the fifth aspect, and the computer program product of the sixth aspect provided above can be referred to the beneficial effects in the first aspect, the second aspect and any possible design methods thereof, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0073] FIG1 is a hardware structure diagram of a mobile phone provided in an embodiment of the present application;
[0074] FIG2 is a schematic diagram of a first method for triggering image search according to an embodiment of the present application;
[0075] FIG3 is a schematic diagram of a second method for triggering image search according to an embodiment of the present application;
[0076] FIG4 is a schematic diagram of a third method for triggering image search according to an embodiment of the present application;
[0077] FIG5 is a schematic diagram of one of the image search entrances in the fourth method of triggering image search provided in an embodiment of the present application;
[0078] FIG6 is a schematic diagram of the second image search entry in the fourth method of triggering an image search provided in an embodiment of the present application;
[0079] FIG7 is a schematic diagram of the third image search entry in the fourth method of triggering an image search provided in an embodiment of the present application;
[0080] FIG8 is a schematic diagram of a fourth method for triggering image search according to an embodiment of the present application;
[0081] FIG9 is a schematic diagram of a creation recommendation portal in the fifth method of triggering image search provided in an embodiment of the present application;
[0082] FIG10 is a schematic diagram of a fifth method for triggering image search according to an embodiment of the present application;
[0083] FIG11 is a schematic diagram of a sixth method for triggering image search according to an embodiment of the present application;
[0084] FIG12 is a schematic diagram of one of the presentation forms of search results provided in an embodiment of the present application;
[0085] FIG13 is a second schematic diagram of the presentation format of search results provided in an embodiment of the present application;
[0086] FIG14 is a third schematic diagram of the presentation format of search results provided in an embodiment of the present application;
[0087] FIG15 is a fourth schematic diagram of the presentation format of search results provided in an embodiment of the present application;
[0088] FIG16 is a schematic diagram of adjusting image materials and creating videos according to an embodiment of the present application;
[0089] FIG17 is a schematic diagram of an adjustment album provided in an embodiment of the present application;
[0090] FIG18 is a schematic diagram of creating a video using an album according to an embodiment of the present application;
[0091] FIG19 is a schematic diagram of a greeting card provided in an embodiment of the present application;
[0092] FIG20 is a schematic diagram of a blessing message provided in an embodiment of the present application;
[0093] FIG21 is a schematic diagram of adding a blessing message through a blessing card according to an embodiment of the present application;
[0094] FIG22 is a schematic diagram of a text card provided in an embodiment of the present application;
[0095] FIG23 is a schematic diagram of editing a video through a video editing interface provided by an embodiment of the present application;
[0096] Figure 24 is a schematic diagram of the application for saving videos to the gallery provided in an embodiment of the present application. DETAILED DESCRIPTION
[0097] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.
[0098] References to "one embodiment" or "some embodiments" etc. described in this specification mean that the specific features, structures or characteristics described in conjunction with the embodiment are included in one or more embodiments of the present application. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in another way. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in another way. The term "connected" includes direct and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
[0099] In the embodiments of this application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplarily" or "for example" is intended to present the relevant concepts in a concrete manner.
[0100] The video creation method provided in the present application can be applied to scenarios where electronic devices create videos. Specifically, the electronic device can receive a user's image search request. Exemplarily, the user can trigger an image search request by inputting a search keyword through text or voice, such as inputting "Jimmy's image" or "image of weekend play." In response to the image search request, the electronic device can search for image materials in the electronic device that match the image search request. Taking the input of the search keyword "Jimmy's image" as an example, in response to the user inputting "Jimmy's image", the electronic device can search for image materials in the electronic device that include "Jimmy." In this way, the electronic device can quickly search for image materials that match the image search request without the user having to manually search for image materials.
[0101] Specifically, for different image search requests, the electronic device can present the searched image materials in different forms, so that users can select image materials to create videos. For example, for the search keyword "Jimmy's images", after the electronic device searches for image materials, it can divide the image materials into multiple albums, and then present the searched image materials in the form of albums, so that users can easily select one or create a video for each album. For another example, for the search keyword "weekend travel images", after the electronic device searches for image materials, it can present thumbnails of some high-quality image materials among the searched image materials, so that users can easily view the image materials and create videos based on the thumbnails.
[0102] Exemplarily, the electronic devices may be mobile phones, tablets, desktops, laptops, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, personal digital assistants (PDAs), augmented reality (AR) and virtual reality (VR) devices, and other electronic devices with video production requirements, such as electronic devices equipped with applications with video production functions. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device. The following mainly takes the electronic device being a mobile phone as an example to illustrate the present application solution.
[0103] 1 , the mobile phone may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0104] It should be understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on mobile phones. In other embodiments of the present application, the mobile phone may include more or fewer components than shown in the figure, or some components may be combined or separated, or the components may be arranged differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0105] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0106] In some embodiments, the mobile phone can complete the video creation method through the processor 110, realize intelligent search and image materials that match the image search request and present them to the user, and, for different image search requests, can also present image materials in different forms.
[0107] The wireless communication function of the mobile phone can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.
[0108] The mobile phone implements its display functionality through a GPU, display 194, and an application processor. The GPU is a microprocessor for image processing that connects display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0109] The display screen 194 is used to display images, videos, etc. In some embodiments, the mobile phone can display information related to video creation through the display screen 194, such as search results, an entrance to video creation, etc.
[0110] The mobile phone can realize the shooting function through the ISP, camera 193, video codec, GPU, display 194 and application processor.
[0111] The mobile phone can implement audio functions such as music playback and recording through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0112] The button 190 may include a power button, a volume button, etc. The button 190 may be a mechanical button. It may also be a touch button. The mobile phone may receive the button input and generate key signal input related to the user settings and function control of the mobile phone. The motor 191 may generate a vibration prompt. The motor 191 may be used for incoming call vibration prompts or for touch vibration feedback. The indicator 192 may be an indicator light that may be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 195 is used to connect the SIM card. The SIM card may be connected to or separated from the mobile phone by inserting it into or removing it from the SIM card interface 195.
[0113] The software system of the mobile phone can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. This embodiment of the application does not specifically limit this.
[0114] The video creation method provided in the embodiment of the present application can be implemented in a mobile phone having the above-mentioned hardware and software structure. The video creation method provided in the embodiment of the present application is further described in detail below with reference to the accompanying drawings.
[0115] In some embodiments, the mobile phone can provide image search and video creation functions through a voice assistant application (hereinafter referred to as voice assistant), such as YOYO. In practice, this is not limited to this. For example, the mobile phone can also provide image search and video creation functions through other applications, such as dedicated video editing applications, gallery applications, etc.
[0116] In the following, taking the voice assistant as an example, the solution of the present application will be described. It can be understood that if it is other applications, the implementation principle is similar and will not be elaborated herein.
[0117] The mobile phone can provide at least one of the following ways to trigger the mobile phone to start searching for images.
[0118] Way 1: After waking up the voice assistant, enter a search image request.
[0119] Among them, the waking-up methods of the voice assistant include but are not limited to at least one of the following: Waking-up method 1, keyword waking-up: When the mobile phone recognizes that the user inputs a waking-up voice including a keyword, such as "Hello YOYO", the voice assistant can be woken up; Waking-up method 2, when the mobile phone detects that the user long-presses the power button, the voice assistant can be woken up; Waking-up method 3, breath waking-up: When the mobile phone detects that the user raises the mobile phone and points the mouth at the microphone, the voice assistant can be woken up. The embodiments of the present application do not specifically limit the waking-up methods.
[0120] Taking the waking-up method as inputting the waking-up voice "Hello YOYO" as an example, referring to Figure 2, in the case of the mobile phone display interface 201, in response to inputting the waking-up voice "Hello YOYO", the mobile phone can wake up the voice assistant. After waking up the voice assistant, the mobile phone can display interface 202. Interface 202 includes a prompt card 2021 of the voice assistant, indicating that the voice assistant has been woken up.
[0121] After the mobile phone wakes up the voice assistant through the above method, the voice assistant is in the waking-up state. In the case where the voice assistant is in the waking-up state, the mobile phone can receive the user's voice input. For example, the user can input the voice "Jimmy's image". Or, the mobile phone can also receive the user's text input. As shown in the prompt card 2021 in the interface 201 of Figure 2, in response to the user's triggering operation (such as a click operation) on the keyboard control 2022, the mobile phone can provide a keyboard for the user to input text.
[0122] In response to the user inputting voice or text indicating image search (that is, inputting a search image request), the mobile phone can display a dialog box of the voice assistant (hereinafter simply referred to as a dialog box), and the dialog box includes the search image request.
[0123] Taking the voice indicating image search as "Jimmy's image" as an example, continuing to refer to Figure 2, in the case of the mobile phone display interface 202, in response to the user inputting the voice "Jimmy's image", the mobile phone can display interface 203, and interface 203 includes a dialog box 2031 of the voice assistant. The dialog box 2031 includes the conversation "Jimmy's image" 2032.
[0124] In addition, in response to the user inputting a search image request, the mobile phone can also start searching for image materials in the gallery application that match the search image request, that is, trigger the start of image search.
[0125] At this point, it should be noted that: in this article, the format of the image search request input by the user through text or voice can be arbitrary. Taking the search for Jimi's image as an example, the search request can be "Jimi's image", "Search for Jimi's image", "Include Jimi's image", etc. It is understandable that creating a video usually requires finding images. Therefore, the format of the image search request can also be "Generate / create a video of...", such as generating a birthday blessing video for Jimi, generating a travel video, etc. In practice, the mobile phone can limit the voice or text image search request to one or more of the above-mentioned fixed formats, such as a fixed format of "Generate a video of...", so as to facilitate identification of user needs. In the following, this will not be repeated.
[0126] Method 2: Enter the voice assistant dialog box and enter the image search request.
[0127] A voice assistant icon is displayed on the desktop of the mobile phone. In response to a user triggering operation on the voice assistant icon, such as a click operation, the mobile phone can display a dialog box.
[0128] 3 , the mobile phone may display interface 301. Interface 301 is the mobile phone's desktop. Interface 301 includes a voice assistant icon 3011. In response to a user clicking icon 3011, the mobile phone may display interface 302, which includes a dialog box 3021.
[0129] In the dialog box, the user can also enter a search request. In response to the input indicating the search request in the dialog box, the mobile phone can also display the search request in the dialog box and search for image materials, that is, trigger the start of the search.
[0130] Still taking the voice command "Jimmy's image" as an example, referring to FIG3 , when the mobile phone displays interface 302, in response to the user inputting the voice command "Jimmy's image", the mobile phone may display interface 303 (same as interface 203 above), which also includes dialog box 3021. Dialog box 3021 further includes the dialog box "Jimmy's image" 3031.
[0131] It should be noted that the dialog box in the above-mentioned method 1 (such as dialog box 2031) and the dialog box in the method 2 (such as dialog box 3021) can be the same dialog box. Therefore, in the dialog box of method 1, the mobile phone can also start searching for images in response to the user inputting the image search request. This will not be repeated here.
[0132] Method three: Enter the voice assistant's skill page and select the video creation topic.
[0133] In the interface including the dialog box, such as the above interface 203, interface 302, interface 303, etc., the mobile phone can also provide multiple skill options. The multiple skill options include skill options for topics such as video creation (such as recorded as "Smart Film"). The functions of searching for pictures and creating videos in this article are mainly concentrated on "Smart Film". The multiple skill options can also include at least one of the following: skill options for topics such as copy editing (such as recorded as "Text Creation"); skill options for topics such as knowledge questions and answers (such as recorded as "Knowledge Questions and Answers"); and skill options for topics such as convenient use of mobile phones (such as recorded as "Mobile Assistant").
[0134] 4 , the mobile phone may display an interface 401 (same as the interface 302 described above), which includes a dialog box 4011. The interface 401 also includes skill options such as “Smart Filming” 4012 and “Text Creation” 4013.
[0135] "Smart Video" includes multiple topic options for video creation. In response to the user's selection of "Smart Video," the phone may display multiple topic options for video creation. Continuing with Figure 4 , in response to the user's selection of "Smart Video" 4012, the phone may display interface 402, which includes multiple topic options for video creation, such as "Birthday Wishes" 4021, "Spring Outing" 4022, "Growth Record" 4023, and "Parent-Child Time" 4024.
[0136] In addition, the dialog interface also includes a recommendation option, which includes topic options for popular topics under each skill option, such as topic options for popular video creation topics. In response to the user's selection of the recommendation option, the mobile phone can display topic options for popular video creation topics. Continuing with Figure 4, taking the recommendation option being "Recommendation" 4014 in interface 401 as an example, in response to the user's selection of "Recommendation" 4014, the mobile phone can display interface 403, which includes topic options for popular video creation topics such as "Birthday Wishes" 4021 and "Spring Travel" 4022.
[0137] Interface 403 includes "Birthday Wishes" 4021, which is also the skill card corresponding to the smart film. When the user clicks the "Birthday Wishes" skill card in interface 403, the effect is the same as clicking the "Birthday Wishes" skill card in interface 402.
[0138] After displaying the topic options of the video creation topic, in response to the user's selection operation of the topic options of the target video creation topic, the mobile phone can start a conversation on the target video creation topic in the dialog box of video creation. It should be noted that the dialog box of video creation can be the same dialog box as the dialog box of the voice assistant in the previous text (as shown in interface 404 below), or it can be a different dialog box. Exemplarily, the dialog box of video creation can be dialog box 4051 in interface 405, and dialog box 4051 is a dialog box specifically used for conversations on video creation topics. For example, "Smart Film" is displayed at the top of dialog box 4051, indicating that it is specifically used for conversations on video creation topics. In this article, the same dialog box is mainly used as an example, as shown in interface 404, to illustrate the present application scheme. Accordingly, the dialog box of video creation can also be referred to as a dialog box for short.
[0139] Continuing with FIG. 4 , for example, if the topic option for the target video creation topic is "Birthday Wishes" 4021 in interface 402 , in response to the user selecting "Birthday Wishes" 4021 , the mobile phone may display interface 404 , which also includes dialog box 4011 . Dialog box 4011 in interface 404 includes a dialogue box "Birthday Wishes" 4041 and dialogue box 4042 . Dialogue box 4042 is used to inquire whether the recipient of the birthday wishes is "Tom," "Jerry," or "Jimmy," thus starting the "Birthday Wishes" dialogue box.
[0140] Of course, if the target video creation topic clearly indicates the search intent, the mobile phone does not need to further inquire about the user's search intent. For example, if the target video creation topic option is "Spring Outing" 4022 in interface 402, the mobile phone can recognize that the search intent is to search for image materials of spring outings, and there is no need to inquire about the search intent.
[0141] Furthermore, in response to the user selecting a topic option for the target video creation topic or selecting any search intent (such as "Jimmy" in interface 404), the mobile phone can search for image materials, triggering the start of an image search. It can be seen that in method three, the image search request includes selecting a topic option for the target video creation topic or further selecting any search intent.
[0142] Method 4: Enter an image search request after performing a trigger operation on the video creation portal.
[0143] Mobile phones can provide video creation portals in multiple locations.
[0144] Position 1, global search interface.
[0145] When the mobile phone displays the desktop (including the main screen and the negative one screen), in response to the user sliding down from the middle area of the desktop, the mobile phone can display the global search interface 501 shown in FIG. 5 .
[0146] The global search interface 501 can be used to search for information in the mobile phone. In response to the user searching for a keyword for video creation, such as "smart film", the mobile phone can display a video creation entrance.
[0147] 5 , in response to a user entering “Smart Video” in search box 5011 in interface 501, the mobile phone may display interface 502, wherein search box 5011 in interface 502 includes the search term “Smart Video”, and interface 502 also includes “Smart Video” 5021. “Smart Video” 5021 is a video creation portal.
[0148] Location 2: the creation menu page of the gallery application.
[0149] When the mobile phone displays the application interface of the gallery application, in response to the user's selection operation on the creation menu, the mobile phone can display a creation menu page, which includes a video creation entrance.
[0150] Referring to Figure 6 , a mobile phone may display interface 601, which is the interface of the gallery application. For example, in the creation menu, "Create" 6011 is displayed in interface 601. In response to a user selecting "Create" 6011, the mobile phone may display interface 602, which includes "Smart Video Creation" 6021. "Smart Video Creation" 6021 is the entry point for video creation.
[0151] Position three, desktop card.
[0152] When the mobile phone displays the desktop, in response to the user's trigger operation 1 on the desktop, such as a two-finger pinch operation, the mobile phone can display a thumbnail of the desktop and multiple desktop setting items, including setting items of the desktop card.
[0153] Referring to Figure 7 , a mobile phone may display interface 701, which is the mobile phone's desktop. In response to a user's two-finger pinch operation in interface 701, the mobile phone may display interface 702. Interface 702 includes a desktop thumbnail 7021. Interface 702 also includes multiple desktop setting items, such as "Wallpaper" 7022 and "Desktop Cards" 7023. "Desktop Cards" 7023 are settings for the desktop cards.
[0154] In response to a user triggering operation on a setting item of a desktop card, such as a click operation, the mobile phone may display multiple application options, each application option corresponding to an application, including an application option for a gallery application.
[0155] 7 , in response to the user clicking on the “Desktop Card” 7023, the mobile phone may display an interface 703, which includes multiple application options such as “Contacts” 7031, “Calendar” 7032, and “Gallery” 7033. “Gallery” 7033 is an application option of the gallery application.
[0156] In response to a user selecting an application option in the gallery app, the phone may display the gallery app's card layout interface. The card layout interface includes multiple layout options. Some layout options (referred to as target layout items) include a video creation portal. In response to adding the target layout item to the desktop, the phone may add the target layout item as a desktop card, thereby displaying the video creation portal in the desktop card.
[0157] Continuing to refer to Figure 7, in response to the user's selection operation on "Gallery" 7033, the mobile phone can display interface 704. Interface 704 is a card layout interface. Interface 704 includes layout option 7041. In response to the user's sliding operation in interface 704 (such as sliding in the opposite direction as indicated by the arrow in interface 704), the mobile phone can display other layout items in interface 704, such as layout option 7042. Layout option 7042 includes the keyword "Smart Film" for video creation, that is, layout option 7042 includes a video creation entrance, and layout option 7042 is the target layout item. When layout option 7042 is displayed in interface 704, in response to the user's click operation on "Add to Desktop" 7043, the mobile phone can add layout option 7042 as a desktop card.
[0158] Subsequently, the mobile phone may display a desktop card on the desktop that includes a video creation entry. Continuing with Figure 7 , after the user clicks "Add to Desktop" 7042 and the mobile phone returns to the desktop, an interface 705 may be displayed, which includes a desktop card 7051. Desktop card 7051 includes "Smart Video Creation" 7052, which is the video creation entry.
[0159] In response to a user triggering operation on any video creation entrance in position one to position three, such as a click operation, the mobile phone can respond in the following two situations.
[0160] Case 1: The trigger operation is performed on the video creation portal for the first time, or the image in the gallery application does not meet the creation conditions.
[0161] The creation condition may correspond to a preset creation theme. For example, if the preset creation theme includes "parent-child time," the creation condition may include: the gallery application includes images of children and the gallery application includes photos of children and elders.
[0162] In the following scenario, in response to triggering any video creation portal in positions 1 through 3, the phone can display a skill page for video creation topics, allowing the user to select a target video creation topic and create a video. This way, even if this is the first time the video creation portal is triggered or the creation conditions are not met, the phone can still provide video creation topics for the user to select and create a video. For more information about the skill page and target video topics, please refer to the previous section "Method 3" and will not be repeated here.
[0163] Referring to Figure 8, taking any video creation entrance as the "Smart Film" 8012 in the desktop card 8011 in the interface 801 (the same as the previous interface 705) as an example, in the following situation, in response to the user's click operation on the "Smart Film" 8012, the mobile phone can display the interface 802 (the same as the previous interface 402).
[0164] Case 2: This is not the first time that the trigger operation is performed on the video creation portal, and the images in the gallery application meet the creation conditions.
[0165] In case 2, in response to a triggering operation on any of the video creation portals in positions 1 to 3, the mobile phone may display a video creation dialog box (also referred to as a dialog box). In addition, in the dialog box, the mobile phone may provide guidance on a preset creation theme to guide the user to create a video on the corresponding theme.
[0166] Continuing with FIG8 , taking the example of a video creation entry being "Smart Video" 8012 in desktop card 8011 in interface 801, in case two, and if the creation conditions for "Parent-Child Time" are met, in response to the user clicking on "Smart Video" 8012, the mobile phone may display interface 803, which includes dialog box 8031. Dialog box 8031 includes guiding dialogue 8032 for guiding the user in creating a video for "Parent-Child Time."
[0167] In the dialog box, the user can also enter a search request, such as entering a search request according to the guided dialogue. In response to entering the search request in the dialog box, the mobile phone can also display the search request in the dialog box, and start searching for image materials, that is, triggering the start of the search. Continuing with Figure 8, when the mobile phone displays interface 803, in response to the user inputting the voice "parent-child time", the mobile phone can display interface 804, which also includes dialog box 8031. Dialog box 8031 further includes the dialogue "parent-child time" 8041, that is, including the search request.
[0168] In the example of Figure 8 above, the example is that any video creation entry is the video creation entry in the desktop card in position 3 (such as "Smart Film"). It should be understood that when any video creation entry is the video creation entry in the global search interface in position 1 or the video creation entry in the creation menu page of the gallery application in position 2, the implementation of triggering the start of the image search is similar and will not be repeated here.
[0169] Method five: triggering the creation of recommendation cards.
[0170] After recognizing that at least one of the current time, current location, and images in the gallery app meets the requirements for video creation, the mobile phone can display a creation recommendation card. The mobile phone can display the creation recommendation card in any user interface, including the desktop, the negative one screen, the lock screen, the application interface of a video application, the application interface of a chat application, and so on. The following describes the present application solution using the example of a mobile phone displaying a creation recommendation card on the desktop.
[0171] Here are some specific implementations for identifying and displaying creation recommendation cards:
[0172] In a specific implementation, the condition for video creation includes that the current time is within time range 1. After recognizing that the current time is within time range 1, the mobile phone can display a creation recommendation card for a birthday blessing video.
[0173] Time Range 1 can be determined based on the birthdays of people included in the gallery application. For example, the start time of Time Range 1 can be a preset number of days before the birthday, and the end time can be the end time of the birthday. For example, if the preset number of days is 3 and the birthday is October 4th, then the start time of Time Range 1 can be October 1st, and the end time of Time Range 1 can be midnight on October 4th.
[0174] It should be noted that the gallery application may include multiple characters. Accordingly, the mobile phone can determine multiple time ranges 1, each of which corresponds to the birthday of a character. In this case, when the current time is within any time range 1, the mobile phone can display a recommendation card for creating a birthday greeting video.
[0175] The creation recommendation card for the birthday greeting video may include an image of a person and / or the name of the person to indicate the person to whom the birthday greeting video is directed.
[0176] For example, after recognizing that the current time is within time range 1, the mobile phone may display interface 901 shown in FIG9 . Interface 901 includes a creation recommendation card 9011 for a birthday video. Creation recommendation card 9011 includes the text "Jimmy's Birthday" 9012, where "Jimmy" is the name of the character. Furthermore, creation recommendation card 9011 also includes an image 9013 of Jimmy.
[0177] In another specific implementation, the video creation condition includes the current time being within time range 2. After recognizing that the current time is within time range 2, the mobile phone can display a recommendation card for creating an anniversary video. Anniversaries include acquaintance anniversaries, wedding anniversaries, and the like.
[0178] Among them, time range 2 can be determined based on the anniversary in the memo application or the note application. Regarding the determination process of time range 2, please refer to the detailed description of the determination of time range 1 above, and replace the birthday with the anniversary.
[0179] Similarly, there may be multiple anniversaries, and accordingly, the mobile phone can determine multiple time ranges 2, each time range 2 corresponding to an anniversary. In this case, when the current time is within any time range 2, the mobile phone can display a creation recommendation card for an anniversary video.
[0180] In another specific implementation, the video creation condition includes at least one of the following conditions 1 and 2:
[0181] Condition 1: There is a trip 1 that leaves the permanent residence within a time range 3 (such as 3 days or a week) before the current time, and the current location is not the destination 1 of the trip 1.
[0182] If there is a trip 1 that leaves the usual place of residence within time range 3 before the current time, it means that the user recently went to destination 1; and if the current location is not destination 1, it means that the current user has already left destination 1. In this case, the phone can determine that there is a demand for creating a video for trip 1 and display a creation recommendation card for trip 1.
[0183] Condition 2: There is a trip 1 leaving the permanent place of residence within the time range 3 before the current time, and the current time is within the time range 4, and the time range 4 is related to the trip 2 leaving the destination 1. Exemplarily, the start time of time range 4 is the start time of trip 2, and the end time is the time after the end of trip 2 and the time interval between the end of trip 2 and the end time of trip 2 is a preset time length (such as 12 hours, 24 hours). In other words, if the current time is within the time range 4, it indicates that the user is about to leave or has already left the destination 1. In response to this situation, the mobile phone can determine that there is a demand for creating a video for trip 1, and thus display a creation recommendation card for trip 1.
[0184] The creation recommendation card for trip 1 may include the name of destination 1 and / or an image taken at destination 1 to indicate the creation of a video of trip 1.
[0185] For example, after identifying that at least one of conditions 1 and 2 is met, the mobile phone may display interface 902 shown in FIG9 . Interface 902 includes a creation recommendation card 9021 for trip 1. Creation recommendation card 9021 includes the text "Sanya Trip" 9022, where "Sanya" is the name of destination 1. Furthermore, creation recommendation card 9021 also includes an image 9023 taken in Sanya.
[0186] In another specific implementation, the conditions for video creation include the current location being at Destination 2, which is not the user's permanent residence, and the user having visited Destination 2 in the past. In other words, Destination 2, which the user is currently at, is a place they have visited in the past. In this case, the phone can determine that there is a need to view images taken at Destination 2 and create a video, and thus display a creation recommendation card for revisiting Destination 2.
[0187] The mobile phone can determine whether the user has reached destination 2 based on the shooting location of the image in the gallery application. Taking destination 2 as Sanya as an example, the gallery application includes images shot in Sanya, and the mobile phone can determine that the user has reached Sanya.
[0188] The creation recommendation card for revisiting destination 2 may include the name of destination 2 and / or historical images taken at destination 2 to instruct creation of a video for revisiting destination 2.
[0189] For example, after recognizing that the current location is Destination 2 and the user has visited Destination 2 in the past, the mobile phone may display interface 903 shown in FIG9 . Interface 903 includes a creation recommendation card 9031 for revisiting Destination 2. Creation recommendation card 9031 includes the text "Revisiting an Old Place" 9032 , "Sanya" 9033 , and a historical image 9034 taken in Sanya.
[0190] In another specific implementation, the video creation condition includes the gallery application adding more than a first number of images within a time period. The time period can be 1 day, 3 days, or a week, etc. The first number can be 10, 30, or 50 images, etc.
[0191] If the gallery app adds more than a first number of images within a time period, this indicates a large number of new images have been generated. In this case, the phone can determine that there is a need to create a video using the newly added images, and thus display a creation recommendation card for the newly added images. The creation recommendation card can include one or more newly added images.
[0192] At this point, it should be noted that the conditions for creating videos in the various implementations described above can also be used in combination. For example, if the phone recognizes that condition 1 above is met and that the number of newly added images exceeds a first number within a time period, such as the time period spent at destination 1, the phone will display a creation recommendation card for trip 1.
[0193] After displaying the creation recommendation card in the above manner, in response to the user's triggering operation on any creation recommendation card, such as a click operation, the mobile phone can display a video creation dialog box (also referred to as a dialog box) and start the video creation dialogue in the dialog box.
[0194] Referring to FIG. 10 , taking as an example any creation recommendation card that is a birthday video creation recommendation card 10011 in interface 1001 (the same as interface 901 described above), in response to a user clicking on “Create Video” 10012 in creation recommendation card 10011, the mobile phone may display interface 1002, which includes a dialog box 10021. Dialog box 10021 includes a dialog box 10022, “Generate Jimmy’s Birthday Video.”
[0195] Furthermore, in response to the user's triggering operation on the creation recommendation card, the mobile phone can also search for image materials that match the creation recommendation card, that is, trigger the start of the image search. It can be seen that in method five, the image search request is the triggering operation on the creation recommendation card.
[0196] In the example of FIG10 above, the example of any creation recommendation card is a creation recommendation card for a birthday greeting video. It should be understood that when any creation recommendation card is a creation recommendation card for trip 1, a creation recommendation card for an anniversary video, etc., the implementation of triggering the start of the image search is similar, and will not be repeated here.
[0197] Method 6: After triggering the floating image search entry in the gallery application, enter a search request.
[0198] A mobile phone can display a floating image search entry on the main interface of the gallery application. The main interface displays thumbnails of all image assets in the gallery application. Referring to Figure 11 , the mobile phone can display interface 1101, which is the main interface of the gallery application. Interface 1101 includes thumbnails of all image assets in the gallery application, such as thumbnail 11011 and thumbnail 11012. Interface 1101 also includes a floating image search entry 11013.
[0199] In some embodiments, in response to the operation of starting the gallery application, the mobile phone can display the main interface of the gallery application and display a floating image search entrance in the main interface, such as display interface 1101.
[0200] In other embodiments, when the phone displays the main interface of a gallery application, the phone can detect a user sliding on the main interface. In response to the sliding operation, the phone can slide the main interface to display different thumbnails, presenting the different thumbnails to the user to facilitate image search. If the sliding speed of the main interface exceeds speed 1 and / or the sliding displacement exceeds displacement 1, indicating that the user is quickly sliding on the main interface to search for image materials, the phone can display a floating image search portal on the main interface, such as display interface 1101. This allows the floating image search portal to be displayed according to the user's image search needs.
[0201] Furthermore, after the display time of the floating image search entrance reaches time 1, the mobile phone cancels the display of the floating image search entrance.
[0202] In response to the user triggering the floating image search portal, the mobile phone can display a dialog box. In the dialog box, the user can also enter a search request. In response to entering the search request in the dialog box, the mobile phone can start a search dialog in the dialog box.
[0203] Taking the search voice command "Jimmy's image" as an example, referring to FIG11 , when the mobile phone displays interface 1101, in response to a user clicking on floating image search entry 11013, the mobile phone may display interface 1102, which includes dialog box 11021. In response to the user inputting the voice command "Jimmy's image", the mobile phone may display interface 1103, which also includes dialog box 11021. Dialog box 11021 in interface 1103 also includes the dialog box "Jimmy's image" 11031.
[0204] Furthermore, in response to a picture search request being input in the dialog box, the mobile phone may search for matching image materials, that is, may also trigger the start of the picture search.
[0205] After triggering the image search using any of the above methods 1 to 6, the mobile phone can display some or all of the searched image materials in a dialog box. In one specific implementation, after searching for image materials, the mobile phone can select some of the higher-quality image materials and display them in the dialog box, thereby facilitating the direct use of high-quality image materials for video creation.
[0206] Furthermore, the form of displaying the image material includes: presenting it in the form of a thumbnail of the image material.
[0207] Referring to Figure 12 , when the image search is triggered, the phone may display interface 1201 (similar to interface 1103 described above). After the search is complete, the phone may display interface 1202. Interface 1202 includes a dialog 12021 of search results. Dialog 12021 includes thumbnails of the searched image materials, such as thumbnail 12023 and thumbnail 12024. In other words, the image materials are presented as thumbnails.
[0208] Alternatively, the form of presenting the image material includes: presenting in the form of an album, where one album includes a plurality of image materials.
[0209] Continuing with Figure 12 , when the phone displays interface 1201, after the search is complete, the phone may display interface 1203. Interface 1203 includes a dialog 12031 of search results. Dialog 12031 includes albums of the searched image materials, such as "Selected Group Photos" 12033 and "Birthdays Over the Years" 12034. In other words, the image materials are presented in the form of an album.
[0210] Specifically, after searching for image materials, the mobile phone can classify the image materials, and each classification forms an album. The mobile phone can classify according to at least one of the following dimensions: shooting time, shooting location, whether it is a group photo, and image content.
[0211] Taking the search for image materials of people as an example, the mobile phone can divide the searched image materials into one or more categories of group photos, birthdays, travel and festivals. For example, the "Group Photo Selection" 12033 in the interface 1203 belongs to the group photo album, and the "Birthdays over the Years" 12034 belongs to the birthday album, etc.
[0212] Taking the search for travel image materials (e.g., itinerary 1 or revisited destination 2) as an example, the mobile phone can classify the searched image materials into one or more albums of portraits, landscapes, architecture, and group photos. Referring to FIG13 , when the image search is triggered (e.g., in response to a user triggering the creation recommendation card 9011 in the aforementioned interface 901 ), the mobile phone can display interface 1301 . After the search is complete, the mobile phone can display interface 1302 . Interface 1302 includes a dialog 13021 of search results. Dialog 13021 includes albums of the searched image materials, such as "Portraits" 13023 , "Architecture" 13024 , and "Landscapes" 13025 . Among them, "Portraits" 13023 is a portrait album, "Architecture" 13024 is an architecture album, and "Landscapes" 13025 is a landscape album.
[0213] In some embodiments, the mobile phone may present the searched image material in different forms based on the length of the timeline corresponding to the image search request.
[0214] Birthdays, anniversaries, and holidays usually span years and have a long timeline, such as a birthday once a year, National Day once a year, and a wedding anniversary once a year. Travel usually only occurs two to three times a year, or even less, and the timeline is also longer. In addition, growth records and memoirs usually also have a long timeline, such as a child’s growth record usually from the birth of the child to the present. Accordingly, for image search requests related to birthdays, anniversaries, holidays, travel, growth records, and memoirs (collectively referred to as target search requests), the mobile phone can present the searched image materials in the form of an album. In addition, for other image search requests, the mobile phone can present the searched image materials in the form of thumbnails.
[0215] In the aforementioned method 3, the image search request is a user's selection of a target video creation topic. If the target video creation topic is related to the image search request, the phone can present the searched image materials in the form of an album. If the target video creation topic is not related to the image search request, the phone can present the searched image materials as image thumbnails.
[0216] 14 , the mobile phone may display an interface 1401 (same as the interface 402 described above), which includes topic options for multiple video creation topics such as “Birthday Wishes” 14011 and “Spring Outing” 14012 :
[0217] For example, if the topic option for the target video creation topic is "Birthday Wishes" 14011, since "Birthday Wishes" 14011 indicates a topic related to birthdays, after the user selects "Birthday Wishes" 14011 and selects Jimmy as the recipient of the blessing, and the mobile phone search is completed, the mobile phone may display interface 1402. Interface 1402 presents the searched image materials in the form of an album.
[0218] For example, if the topic option "Spring Outing" 14012 is selected for the target video creation topic, since "Spring Outing" 14012 does not indicate a topic related to the target image search request, after the user selects "Spring Outing" 14012 and the mobile phone completes the search, the mobile phone may display interface 1403. Interface 1403 presents the searched image materials in the form of thumbnails.
[0219] In the aforementioned method 5, the image search request is the user's triggering action for creating a recommendation card. Based on the previous description of method 5, we can see that the recommendation cards include cards for birthday videos, anniversary videos, trip 1, revisited destination 2, and newly added images. The cards for trip 1 and revisited destination 2 correspond to travel creative needs.
[0220] If the creation recommendation card is the card of the target image search request, the mobile phone can present the searched image material in the form of an album.
[0221] Referring to Figure 15 , the phone may display interface 1501 (same as interface 901 described above), which includes a birthday video creation recommendation card 15011. Since creation recommendation card 15011 is a birthday-related image search request, after the user clicks creation recommendation card 15011 and the phone completes the search, the phone may display interface 1502. Interface 1502 presents the searched image materials in the form of an album.
[0222] If the creation recommendation card is not the card required by the target image search, the mobile phone can present the searched image material in the form of a thumbnail.
[0223] Continuing with Figure 15 , the mobile phone may display interface 1503, which includes a creation recommendation card 15031 for a newly added image (e.g., "Cute Puppy"). Since creation recommendation card 15031 for the newly added image is not part of the target image search request, in response to the user clicking creation recommendation card 15031, the mobile phone may display interface 1504 after searching for image materials. Interface 1504 presents the searched image materials as thumbnails.
[0224] In addition to the above-mentioned method three and method five, in the above-mentioned methods one, two, four and six, the image search requests are all voice or text input by the user in the dialog box to indicate the image search. The mobile phone can determine whether the voice or text input by the user in the dialog box corresponds to the target image search request through semantic analysis. Similarly, if it is determined that the voice or text input by the user in the dialog box corresponds to the target image search request, such as the user inputs "National Day images", the mobile phone can present the searched image materials in the form of an album. If it is determined that the voice or text input by the user in the dialog box does not correspond to the target creation requirements, such as the user inputs "dance competition images", the mobile phone can present the searched image materials in the form of thumbnails.
[0225] With this embodiment, for image search requests with a long timeline, the mobile phone can present the searched image materials in the form of an album, so that the image materials can be presented to the user by category, making it easier for the user to view and select the album to create a video.
[0226] In other embodiments, the mobile phone can present the searched image materials in different formats based on the number of images searched. If the number of images searched is greater than 1, such as 30 or 50, the searched image materials are presented as an album; if the number of images searched is less than or equal to 1, the searched image materials are presented as thumbnails. In this way, when a large number of images are searched, the mobile phone can present the images by category. The specific implementation of obtaining an album can be found in the previous section and will not be repeated here.
[0227] In this embodiment, the number of images searched by the mobile phone may vary for different image search requests, and the searched image materials will be presented in different forms. Furthermore, at different time points, the number of images searched by the mobile phone for the same image search request may also vary, and the searched image materials will also be presented in different forms.
[0228] Taking quantity 1 (50 images) as an example, shortly after the child is born, the phone only captures 10 images of the child, which is less than quantity 1. In this case, in response to the need to create a video recording of the child, for example, by entering "child's growth record" in the dialog box, the phone searches for fewer images than quantity 1 and presents the searched images as thumbnails. When the child is two years old, the phone captures more than 50 images of the child, which is more than quantity 1. In this case, in response to the need to create a video recording of the child's growth, the phone searches for more images than quantity 1 and presents the searched images as an album.
[0229] Of course, the mobile phone may not distinguish between the length of the timeline and the number of images searched, but may uniformly adopt the same form, such as thumbnail form, to present the searched image materials.
[0230] The mobile phone can create a video using the searched image materials. In some embodiments, the mobile phone can also adjust the image materials used in the video creation, such as adding or deleting image materials, and then use the adjusted image materials to create the video. The following describes the thumbnail format and the album format respectively.
[0231] Form 1: thumbnail form.
[0232] The search results also include entry 1 for viewing all selected materials. In response to the user's triggering operation on entry 1, such as a click operation, the mobile phone can display thumbnails of all currently selected image materials, and display entry 2 for adding more selected materials.
[0233] Referring to FIG. 16 , for example, entry 1 is "View All" 16011 in interface 1601 (same as interface 1403 described above). In response to a user clicking on "View All" 16011, the mobile phone may display interface 1602. Interface 1602 includes thumbnails of 15 selected image materials. Each thumbnail in interface 1602 is marked with a "√," indicating that it is selected. Furthermore, interface 1602 also includes "Add" 16021, which is entry 2 for adding more selected materials.
[0234] In response to a user deselecting one or more thumbnails from the currently selected thumbnails of all image materials, such as by clicking on them, the mobile phone can deselect one or more image materials, thereby deleting some of the selected image materials. Subsequently, in response to a confirmation operation, such as by clicking on "√" 16022 in interface 1602, the mobile phone can return to the dialog box, such as returning to interface 1601.
[0235] In response to the user's triggering operation on entry 2, the mobile phone may display a search results page. The search results page includes thumbnails of all searched image materials. For example, if entry 2 is "Add" 16021 in interface 1602, in response to the user clicking "Add" 16021, the mobile phone may display interface 1603, which is the search results page. Interface 1603 includes all searched image materials matching "spring outing".
[0236] In the search results page, the thumbnail of the selected image material has a mark 1, such as the above-mentioned "√", and the thumbnail of the unselected image material does not have a mark 1. In response to the user's deselection operation on one or more thumbnails with mark 1 in the search results page, the mobile phone can deselect the corresponding one or more image materials, such as canceling the mark 1 of the thumbnail, thereby deleting some of the selected image materials. In response to the user's selection operation on one or more thumbnails without mark 1 in the search results page, the mobile phone can select the corresponding one or more image materials, such as adding mark 1 to the thumbnail, thereby adding the selected image material. Subsequently, in response to a confirmation operation, such as clicking on "Add" 16031 in interface 1603, the mobile phone can return to the dialog box, such as returning to interface 1601.
[0237] In addition, when a dialog box is displayed, the user can also input a voice or text instruction to add selected image materials (referred to as an add instruction), such as inputting a voice message "add 5 image materials", "add some images", etc. In response to the add instruction, the mobile phone can add the selected image materials. Similarly, when a dialog box is displayed, the user can also input a voice or text instruction to reduce the selected image materials (referred to as a reduce instruction), such as inputting a voice message "reduce 3 image materials", "reduce a large number of images", etc. In response to the reduce instruction, the mobile phone can deselect the image materials.
[0238] It should be noted that in form 1, the thumbnails displayed by the mobile phone in the search results are all thumbnails of the selected image materials.
[0239] In response to the video creation operation, the mobile phone can create a video using the selected image material. Continuing with FIG16 , taking the example of the video creation operation being a user clicking on "Generate Video" 16012 in the search results, in response to the user clicking on "Generate Video" 16012, the mobile phone can display interface 1604, which includes the created video 16041.
[0240] The second form is the album form.
[0241] In the search results, the image materials in each album are selected by default. In the second form, the phone can adjust the image materials selected in each album and add albums. The following are the instructions:
[0242] First, adjust the selected image assets in each album.
[0243] In response to a user triggering operation 1 on a target album, such as a click, the mobile phone may display thumbnails of all image materials included in the target album. In response to a user deselecting operation on one or more thumbnails, such as a click, the mobile phone may deselect the corresponding one or more image materials, thereby adjusting the selected image materials in the target album.
[0244] Referring to FIG. 17 , taking the target album as "Selected Group Photos" 17011 in interface 1701 (same as interface 1402 described above), in response to a user clicking on "Selected Group Photos" 17011, the mobile phone may display interface 1702, which includes thumbnails of image materials in the album "Selected Group Photos" 17011, such as thumbnail 17021 and thumbnail 17022. Each thumbnail in interface 1702 is marked with a "√" to indicate that it is selected. In response to the user clicking on thumbnails 17011 and 17022, the mobile phone may deselect the corresponding image materials.
[0245] Subsequently, in response to the confirmation operation, the mobile phone can return to the dialog box again, but the number of selected images in the target album in the dialog box has changed. Continuing with FIG17 , taking the confirmation operation as a click operation on “√” 17023 in interface 1702 as an example, in response to the click operation on “√” 17023 in interface 1702, the mobile phone can display interface 1703, in which the number below “Selected Group Photos” 17011 in interface 1703 changes from “20” in interface 1701 to “18 / 20”, indicating that 18 image materials in “Selected Group Photos” 17011 are selected, while the other 2 (such as the 2 corresponding to thumbnail 17021 and thumbnail 17022) are deselected.
[0246] Similarly, when the dialog box is displayed, the user can also input voice or text instructions to reduce the number of image materials selected in the target album (referred to as a category reduction instruction), such as inputting voice messages such as "reduce 3 image materials in the group photo selection" or "reduce a large number of images in the group photo selection." In response to the category reduction instruction, the mobile phone can deselect the image materials selected in the target album.
[0247] Second, add photo albums.
[0248] The search results also include entry 3 for a custom album. In response to a user triggering entry 3, such as a click, the phone can display thumbnails of multiple image assets in the gallery application. In response to the user selecting one or more thumbnails, the phone can select the corresponding one or more image assets.
[0249] Continuing with FIG17 , taking entry 3 being “Customize” 17012 in interface 1701 as an example, in response to a user clicking on “Customize” 17012, the mobile phone may display interface 1704, which includes thumbnails of image materials under the “All Photos” album in the gallery application, such as thumbnail 17041, thumbnail 17042, thumbnail 17043, and thumbnail 17044. In response to a user selecting thumbnail 17041, thumbnail 17042, thumbnail 17043, and thumbnail 17044 in interface 1704, the mobile phone may select the four image materials corresponding to thumbnail 17041, thumbnail 17042, thumbnail 17043, and thumbnail 17044 in the interface.
[0250] Subsequently, in response to the confirmation operation, the mobile phone can return to the dialog box and display the custom album at the position of entry 3 in the dialog box, which includes the selected one or more image materials. Continuing with FIG17 , taking the confirmation operation as clicking on “√” 17045 in interface 1704 as an example, in response to clicking on “√” 17045 in interface 1704, the mobile phone can display interface 1705, which includes custom album 17051. Custom album 17051 includes the selected one or more image materials. For example, if “4” is displayed below custom album 17051, it means that custom album 17051 includes four selected image materials.
[0251] The custom album is selected by default, as indicated by a "√" mark in the interface 1705, indicating that the custom album is selected. The custom album is selected by default, meaning that the image materials in the custom album are used by default for creating videos.
[0252] The cover of a custom album can be the first thumbnail selected from multiple thumbnails of image assets in the gallery application.
[0253] Similarly, when the dialog box is displayed, the user can also input voice or text to add a custom album (referred to as an add album instruction), such as inputting voice "add custom album", "add 5 images to the custom album", etc. In response to the add album instruction, the mobile phone can create the custom album.
[0254] In form two, the image materials selected in the selected album will be used to create the video. In response to the operation of selecting an album, the mobile phone can select the album. Referring to Figure 18, taking "Selected Group Photos" 18011 in interface 1801 (the same as interface 1705 described above) as an example, in response to the user's selection operation on "Selected Group Photos" 18011, the mobile phone can display interface 1802. Unlike interface 1801, "Selected Group Photos" 18011 in interface 1802 is in a selected state. In other words, the image materials selected in "Selected Group Photos" 18011 will be used to create the video.
[0255] In response to the operation of creating a video, the mobile phone can create a video using the image materials selected in the selected album. Continuing with FIG. 18 , taking the operation of creating a video as the user clicking on "Generate Video" 18021 in interface 1802 as an example, in response to the user clicking on "Generate Video" 18021, the mobile phone can display interface 1803, which includes the created video 18031. Since "Selected Group Photos" 18011 and custom album 18012 in interface 1802 are selected, video 18031 includes the image materials selected in "Selected Group Photos" 18011 (e.g., 20 in total) and the image materials selected in custom album 18012 (e.g., 4 in total), for a total of 24 image materials.
[0256] After the creation is completed, the mobile phone can edit the video again.
[0257] In some embodiments, the mobile phone may provide one or more editing controls in a dialog box for secondary editing of the created video. Exemplarily, the editing controls include at least one or more of the following: a control for changing the video template, such as the "Change Template" button in interface 1604 and interface 1803; a control for changing the background music, such as the "Change Music" button in interface 1604 and interface 1803; and a control for adjusting the video duration, such as the "Adjust Duration" button in interface 1604 and interface 1803.
[0258] Furthermore, for different videos, the mobile phone can provide different editing controls to facilitate targeted video editing.
[0259] In one specific implementation, for videos created through image search requests related to birthdays, anniversaries, and holidays, the mobile phone can provide a text greeting editing control 1 for editing the greeting for the video. Continuing with FIG18 , taking the example of video 18031 in interface 1803 being a birthday greeting video, interface 1803 also includes "Text Greeting" 18032, which is control 1.
[0260] For videos created in search requests other than birthdays, anniversaries, and holidays, such as those related to travel and growth records, the phone can provide a caption control 2 for adding text to the video. Continuing with FIG16 , taking the example of video 16041 in interface 1604 being a travel video, interface 1604 also includes "Smart Caption" 16042, which is control 2.
[0261] It should be noted that regarding the determination of the image search request, please refer to the relevant instructions in the previous article on presenting image materials based on the length of the timeline, which will not be repeated here.
[0262] The following describes the specific functions of control 1 and control 2 respectively:
[0263] First, Control 1: used to add greetings to the video.
[0264] In response to a user triggering control 1, such as a click, the phone can display a greeting card that includes a default greeting. For example, if control 1 is "Text Greeting" 18032 in interface 1803 shown in FIG18 , in response to a user clicking "Text Greeting" 18032, the phone can display interface 1901 shown in FIG19 . Dialog box 19011 in interface 1901 includes a greeting card 19012, which includes the default greeting "The best time is with you. Happy birthday."
[0265] Furthermore, the phone can provide different default greetings for videos created based on different image search requests, so that the default greetings match the image search requests. For example, for videos created based on birthday search requests, the phone can provide a default greeting including "Happy Birthday"; for videos created based on anniversary search requests, the phone can provide a default greeting including "On this memorable day."
[0266] Furthermore, the phone can also provide different default greetings for videos created from different albums, so that the default greetings match the image material used to create the video. In this way, even if the same image search request is for birthday-related images, the default greetings provided in the greeting card will be different if the phone uses different albums to create videos.
[0267] Take birthday-related image search requests 1 and 2 as an example, see Figure 20:
[0268] In response to image search request 1, after the mobile phone finds the image material, it displays interface 2001 (same as interface 1701 above). When the user selects "Group Photo Selection" 20011 (belonging to the group photo album) in interface 2001 and clicks "Generate Video" 20012, the mobile phone creates video 20021 in interface 2002 (same as interface 1803). In response to the user clicking "Text Blessing" 20022 in interface 2002, the mobile phone can display interface 2003, which includes a blessing card 20031. Blessing card 20031 includes the default blessing "We have always been together." It can be seen that the meaning of the default blessing matches the group photo album, both of which mean "together."
[0269] In response to image search request 2, after the mobile phone finds image material, it displays interface 2004. When the user selects "Travel Selection" 20041 (a travel album) in interface 2004 and clicks "Generate Video" 20042, the mobile phone creates video 20051 in interface 2005. In response to the user clicking "Text Blessing" 20052 in interface 2005, the mobile phone displays interface 2006, which includes a blessing card 20061. Blessing card 20061 includes the default blessing, "Do you remember the days we traveled together?" This default blessing aligns with the meaning of travel, implying "travel."
[0270] In the greeting card, the phone can also change the greeting message in at least one of the following ways:
[0271] Method 1: Change the greeting message through the switch control in the greeting card.
[0272] The blessing card includes a toggle control. In response to the user triggering the toggle control, the mobile phone can change the blessing message in the blessing card. Referring to Figure 21, taking the toggle control as "Change" 21012 in the blessing card 21011 in interface 2101 (the same as interface 1901 above) as an example, in response to the user clicking "Change" 21012, the mobile phone can display interface 2102, and the blessing message in the blessing card 21011 in interface 2102 is changed to "May this day that belongs entirely to you bring you happiness, and may the days to come be even more beautiful."
[0273] Method 2: Edit the greeting message in the text box of the greeting card.
[0274] The greeting card includes a text box containing a greeting message. In response to a user triggering an operation on the text box, the mobile phone can activate the text box, i.e., make the text box editable. Subsequently, the user can edit the text in the text box to change the greeting message.
[0275] Continuing with FIG. 21 , taking text box 21021 in blessing card 21011 in interface 2102 as an example, a blessing message is displayed in text box 21021. In response to a user clicking on text box 21021, the mobile phone may display interface 2103. In interface 2103, text box 21021 in blessing card 21011 is editable. For example, if the blessing message "May this day, all yours, bring you joy, and may the days to come be even more wonderful" is selected, the user can edit the blessing message in text box 21021 in interface 2103. The mobile phone may receive the user-edited blessing message and display it in text box 21021.
[0276] After changing the greeting message or without changing the greeting message, in response to the user's confirmation operation in the greeting card, the mobile phone can apply the current greeting message in the text box to the video, obtaining Video 1 after the greeting message is added, and displaying Video 1 in the text box. Continuing with FIG. 21 , taking the confirmation operation as the user clicking "Confirm" 21013 in greeting card 21011 in interface 2101 as an example, in response to the user clicking "Confirm" 21013, the mobile phone can display interface 2104, which further includes video 21041. Video 21041 has the greeting message "The best time is with you, happy birthday" added to it. That is, video 21041 is video 1.
[0277] Second, Control 2: used to add text to the video.
[0278] In response to a user triggering control 2, such as a click, the phone can display a text card that includes a default text. For example, if control 2 is "Smart Text" 16042 in interface 1604 shown in FIG16 , in response to a user clicking "Smart Text" 16042, the phone can display interface 2201 shown in FIG22 . Interface 2201 includes text card 22011, which includes the default text "Every dance step you take speaks of your hard work and perseverance. I'm so proud of you."
[0279] Furthermore, for videos created based on different image search requests, the phone can provide different default captions, ensuring that the default captions match the image search requests. For videos created based on different albums, the phone can also provide different default captions, ensuring that the default captions match the image material used to create the video. The principles behind this section are similar to those for the default greetings mentioned above. For details, please refer to the previous section regarding default greetings and will not be repeated here.
[0280] In the text card, you can also change the text using at least one of the following methods: Method 1: Use the toggle control in the text card to change the text. Method 2: Edit the text in the text box of the text card. The principle of this part is similar to changing the greeting message mentioned above. For details, please refer to the relevant instructions for changing the greeting message above and will not be repeated here.
[0281] After changing the caption, or even without changing it, in response to the user's confirmation in the caption card, the phone can apply the caption currently in the text box to the video, creating a new video and displaying it in the text box. The principles behind this are similar to applying a greeting, and for details, please refer to the previous section on applying greetings. I will not elaborate on this here.
[0282] In other embodiments, in response to a user clicking on a video, the mobile phone may display a video playback interface and play the video. In response to a user clicking on the video playback interface, the mobile phone may display a video editing interface and complete secondary editing of the video in the video editing interface.
[0283] Referring to Figure 23, taking video 23011 in interface 2301 (same as interface 1803 above) as an example, in response to a user clicking on video 23011, the phone may display interface 2302. Interface 2302 is the video playback interface. Video 23011 is currently playing in interface 2302. In response to a user clicking on interface 2302, the phone may display interface 2303, which is the video editing interface. Interface 2303 includes multiple editing options, including "Template" 23031, "Music" 23032, "Clip" 23033, and "Edit" 23036. "Template" 23031 can be used to trigger the phone to change the video template; "Music" 23032 can be used to trigger the phone to add background music to the video; "Clip" 23033 can be used to trigger the phone to crop the video; and "Edit" 23036 can be used to trigger the phone to perform in-depth editing of the video, such as adding background music to each image in the video or changing the template.
[0284] Of course, in response to the user clicking on a video (such as video 23011), the mobile phone may also directly display a video editing interface. This embodiment does not specifically limit this.
[0285] After completing the editing in the video editing interface, in response to the user's save operation, the mobile phone can save the editing operation of the video in the video editing interface. After saving the editing, in response to the return operation, the mobile phone can display the dialog box again and replace the video in the dialog box with the edited video 2.
[0286] Continuing with FIG23 , taking the example of a save operation being a click on “√” 23034 in interface 2303, in response to the user clicking on “√” 23034, the mobile phone can save the user's editing operation on the video editing interface. Taking the example of a return operation being a click on return control 23035 in interface 2303, after saving the edits, in response to the user clicking on return control 23035, the mobile phone can display interface 2304. Interface 2304 includes video 23041, which replaces video 23011 in interface 2301.
[0287] That is, when you edit a video using this embodiment and display the dialog box again, the video in the dialog box will be replaced by the edited video 2, rather than being displayed after the original video as it would be if you edited the video using the edit controls in the dialog box. This way, the phone can ensure that when editing is triggered from the video itself (i.e., clicking on the video to trigger editing), the edited video 2 replaces the original video; and when editing is triggered from the edit controls in the dialog box, the edited video 1 is displayed in the dialog box, i.e., an additional dialog is added.
[0288] Of course, in response to the user's save operation, the mobile phone can also save and directly return to the dialog box, and replace the video in the dialog box with the edited video 2. This embodiment does not make specific limitations on this.
[0289] Around the video in the dialog box, the mobile phone also provides multiple shortcut controls, such as download controls, share controls, delete controls, etc. In response to the user's triggering operation on the shortcut controls, the mobile phone can perform corresponding processing on the video.
[0290] 24 , taking the video 24011 in the interface 2401 as an example, “Download” 24012 , “Share” 24013 , and “Delete” 24014 are displayed below the video 24011 .
[0291] "Download" 24012 is a download control. In response to a user clicking "Download" 24012, the mobile phone can download video 24011 and save video 24011 to the gallery application. For example, after saving to the gallery application, the mobile phone can display interface 2402, which is the main interface of the gallery application. Interface 2402 includes a thumbnail 24021 of video 24011.
[0292] Among them, "Share" 24013 is a sharing control. In response to the user clicking on "Share" 24013, the mobile phone can first download video 24011 and save video 24011 to the gallery application, and then continue to perform the sharing operation. In other words, the sharing control can also trigger the saving of the video.
[0293] Among them, "Delete" 24014 is a deletion control. In response to the user clicking on "Delete" 24014, the mobile phone can delete the video 24011 in the dialog box.
[0294] An embodiment of the present application further provides an electronic device, which may include: a display screen, a memory, and one or more processors (such as a CPU, GPU, NPU, etc.). The display screen, the memory, and the processor are coupled. The memory is used to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the various functions or steps performed by the device in the above method embodiment.
[0295] An embodiment of the present application further provides a chip system, which includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected via lines. For example, the interface circuit can be used to receive signals from other devices (such as a memory of an electronic device). For another example, the interface circuit can be used to send signals to other devices (such as a processor). Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can perform the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which is not specifically limited in the embodiment of the present application.
[0296] This embodiment further provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the image processing method in the above-mentioned embodiment.
[0297] This embodiment further provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the image processing method in the above-mentioned embodiment.
[0298] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory to enable the chip to execute the image processing method in the above-mentioned method embodiments.
[0299] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.
[0300] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0301] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0302] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0303] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0304] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0305] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit the present application. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present application.
Claims
1. A video creation method, characterized in that, Applied to an electronic device, the method includes: In response to a first image search request, display a first search result, where the first search result includes first thumbnails of a plurality of first image materials and a first control; In response to a trigger operation on the first control in the first search result, display a first video, where the first video includes the plurality of first image materials; In response to a second image search request, display a second search result, where the second search result includes options of a plurality of first photo albums and the first control, the plurality of first photo albums includes a second photo album, and the second photo album includes a plurality of second image materials; In response to a selection operation on the option of the second photo album, select the second photo album; In response to a trigger operation on the first control in the second search result, display a second video, where the second video includes the plurality of second image materials.
2. The method according to claim 1, wherein The second image search request includes a selection operation on an option of a second topic, or the second image search request includes a trigger operation on a second creation recommendation card; Wherein, the second topic is a topic related to video creation, the second creation recommendation card is a creation recommendation card for video creation, and the topic content of the second topic and the recommended theme of the second creation recommendation card include at least one of the following: birthday, holiday, anniversary, travel, and growth record.
3. The method according to claim 2, wherein The first image search request includes a selection operation on an option of a first topic, or the first image search request includes a trigger operation on a first creation recommendation card; Wherein, the first topic is a topic related to video creation, the first creation recommendation card is a creation recommendation card for video creation, and the topic content of the first topic and the recommended theme of the first creation recommendation card do not include birthday, holiday, anniversary, travel, and growth record.
4. The method according to any one of claims 1-3, characterized in that, The step of, in response to the first image search request, display the first search result, includes: In response to the first image search request, and when the number of image materials matching the first image search request found by the electronic device is less than a first quantity, display the first search result; The step of, in response to the second image search request, display the second search result, includes: In response to the second image search request, and when the number of image materials matching the second image search request found by the electronic device is greater than or equal to a second quantity, display the second search result.
5. The method according to any one of claims 1-4, characterized in that, The step of, in response to the second image search request, display the second search result, where the second search result includes options of a plurality of first photo albums, includes: In response to the second image search request, and when the second image search request includes searching for image materials of a person, the plurality of first photo albums includes at least two of the following categories of photo albums: group photo category, portrait category, birthday category, festival category, and travel category; or, In response to the second image search request, and when the second image search request includes searching for image materials of a travel, the plurality of first photo albums includes at least two of the following categories of photo albums: portrait category, architecture category, scenery category, and group photo category.
6. The method according to any one of claims 1-5, characterized in that, The second search result further includes an entry for adding a custom photo album; Before the step of, in response to a trigger operation on the first control in the second search result, display the second video, the method further includes: In response to a triggering operation on the entry for adding the custom photo album, display thumbnails of multiple image materials in the gallery application of the electronic device; In response to a selection operation and a confirmation addition operation on at least one second thumbnail, display the second search result, where the entry for adding the custom photo album in the second search result is updated to the custom photo album and the custom photo album is selected, and the at least one second thumbnail corresponds to at least one third image material in the gallery application; Wherein, the at least one third image material is further included in the second video.
7. The method according to any one of claims 1-6, characterized in that, The method further includes: In response to a triggering operation on the first control in the second search result and the second image search request satisfying a first condition, display the first editing control of the second video; In response to a triggering operation on the first control in the second search result, but the second image search request not satisfying the first condition, display the second editing control of the second video; Wherein, the first condition includes: the image search request includes a selection operation on an option of a third topic, and the third topic is a topic of video creation; or, the image search request includes a triggering operation on a third creation recommendation card, and the third creation recommendation card is a creation recommendation card for video creation; the topic content of the third topic and the recommended theme of the third creation recommendation card include at least one of the following: birthday, holiday, and anniversary.
8. The method according to claim 7, characterized in that, After the display of the first editing control of the second video, the method further includes: In response to a triggering operation on the first editing control of the second video, display a first blessing message; In response to a confirmation operation, display a third video, where the third video includes the multiple second image materials and the first blessing message.
9. The method according to claim 8, characterized in that, After the display of the third video in response to the confirmation operation, or before the display of the second search result in response to the second image search request, the method further includes: In response to a third image search request, display a third search result, where the third search result includes options of multiple third photo albums and the first control, and the multiple third photo albums include a fourth photo album, and the fourth photo album includes multiple fourth image materials; In response to a selection operation on the option of the fourth photo album, select the fourth photo album; In response to a triggering operation on the first control in the third search result and the third image search request satisfying the first condition, display a fourth video and the first editing control of the fourth video, where the fourth video includes the multiple fourth image materials; In response to a triggering operation on the first editing control of the fourth video, display a second blessing message, where the second blessing message is different from the first blessing message; In response to a confirmation operation, display a fifth video, where the fifth video includes the multiple fourth image materials and the second blessing message; Wherein, the third image search request is different from the second image search request, and / or, the fourth photo album and the first photo album are photo albums of different categories.
10. The method according to claim 8 or 9, characterized in that, The display of the third video in response to the confirmation operation includes: In response to the confirmation operation, display the third video after the second video.
11. The method according to any one of claims 1 to 10, characterized in that After displaying the second video, the method further includes: In response to a trigger operation on the second video, displaying an editing interface of the second video; After completing and saving the editing in the editing interface, in response to a return operation, replacing the second video with a sixth video, where the sixth video is the video after saving the editing.
12. The method according to any one of claims 1 to 11, characterized in that, The method further includes: When at least one of the time, location of the electronic device, and newly added image materials in the gallery application satisfies a second condition, displaying a creation recommendation card, and the first image search request and / or the second image search request includes a trigger operation on the creation recommendation card.
13. The method according to any one of claims 1-12, characterized in that, The method further includes: In response to starting the gallery application, displaying a first interface of the gallery application, where the first interface includes a floating image search entry; or, in response to starting the gallery application, displaying the first interface of the gallery application; in a case where the sliding speed of the first interface exceeds a first speed and / or the sliding displacement exceeds a first displacement, displaying the floating image search entry in the first interface; In response to a trigger operation on the floating image search entry, displaying a dialog box; Wherein, the first image search request and / or the second image search request includes inputting an image search voice or an image search text in the dialog box.
14. A video creation method, characterized in that, Applied to an electronic device, where a voice assistant application and a gallery application are installed in the electronic device, the method includes: Starting the voice assistant application and displaying a dialog box; In response to an image search request, displaying search results in the dialog box, where the search results include information of at least one image material searched from the image materials in the gallery application and a first control; In response to a trigger operation on the first control, displaying a first video in the dialog box, where the first video includes one or more searched image materials.
15. The method according to claim 14, wherein The starting the voice assistant application includes: In response to a first operation, starting the voice assistant application; Wherein, the first operation includes any one of the following: an operation to wake up the voice assistant application; a trigger operation on the application icon of the voice assistant application; a trigger operation on the creation recommendation card; and, a trigger operation on the floating image search entry in the gallery application.
16. The method according to claim 14, wherein The starting the voice assistant application and displaying a dialog box includes: In a first case, in response to a trigger operation on a video creation entry, starting the voice assistant application and displaying topic options of multiple video creation topics, where a target topic option is included in the topic options of the multiple video creation topics, and in response to a user's selection operation on the target topic option, displaying the dialog box; In a second case, in response to a trigger operation on a video creation entry, starting the voice assistant application and displaying the dialog box, where the dialog box includes guiding words for guiding the user to input an image search request; Wherein, the first case includes: not receiving a trigger operation on the video creation entry, or the images in the gallery application not satisfying the creation conditions; the second case includes: receiving a trigger operation on the video creation entry, and the images in the gallery application satisfying the creation conditions.
17. The method according to any one of claims 14 - 16, characterized in that, The image search request includes any one of the following: a triggering operation on a creation recommendation card, a selection operation on a target topic option, and inputting voice or text indicating image search in the dialog box.
18. The method according to claim 17, wherein The image search request includes a selection operation on a target topic option of a second topic, or the image search request includes a triggering operation on a second creation recommendation card, and the information of the at least one image material includes a thumbnail of the at least one image material; Wherein, the second topic is a topic of video creation, the second creation recommendation card is a creation recommendation card for video creation, and the topic content of the second topic and the recommended theme of the second creation recommendation card include at least one of the following: birthday, holiday, anniversary, travel, and growth record.
19. The method according to claim 17, characterized in that, The image search request includes a selection operation on a target topic option of a first topic, or the image search request includes a triggering operation on a first creation recommendation card, and the search results further include options of multiple photo albums, one photo album includes one or more image materials, and the information of the at least one image material includes the option covers of the multiple photo albums, and the option cover of each photo album is a thumbnail of an image material included in the photo album; Wherein, the first topic is a topic of video creation, the first creation recommendation card is a creation recommendation card for video creation, and the topic content of the first topic and the recommended theme of the first creation recommendation card do not include birthday, holiday, anniversary, travel, and growth record.
20. The method according to claim 19, wherein The multiple photo albums include a second photo album; Before displaying the first video created in the dialog box in response to the triggering operation on the first control, the method further includes: In response to a selection operation on an option of the second photo album, selecting the second photo album; Wherein, the first video created includes the image materials in the second photo album.
21. The method according to any one of claims 14 - 20, characterized in that, The method further includes: In response to the triggering operation on the first control and when the image search request meets a first condition, displaying a first editing control; In response to the triggering operation on the first control but when the image search request does not meet the first condition, displaying a second editing control; Wherein, the first condition includes: the image search request includes a selection operation on an option of a third topic, and the third topic is a topic of video creation; or the image search request includes a triggering operation on a third creation recommendation card, and the third creation recommendation card is a creation recommendation card for video creation; the topic content of the third topic and the recommended theme of the third creation recommendation card include at least one of the following: birthday, holiday, and anniversary.
22. The method according to claim 21, wherein After displaying the first editing control, the method further includes: In response to the triggering operation on the first editing control, displaying a first blessing message; In response to a confirmation operation, displaying a second video, and the second video includes one or more searched image materials and the first blessing message.
23. The method according to claim 22, wherein The displaying the second video in response to the confirmation operation includes: In response to the confirmation operation, displaying the second video after the first video.
24. The method according to any one of claims 14-23, characterized in that, After displaying the first video in the dialog box, the method further includes: In response to a trigger operation on the first video, display an editing interface for the first video; After completing editing and saving the editing in the editing interface, in response to a return operation, replace the first video with a third video, where the third video is the video after saving the editing.
25. An electronic device, characterized in that, Comprising: A display screen, one or more processors, and one or more memories; the one or more processors are coupled to the display screen and the one or more memories; the one or more memories are used to store computer program code, the computer program code includes computer instructions, and when the one or more processors execute the computer instructions, the electronic device executes the method according to any one of claims 1-24.
26. A computer-readable storage medium having computer instructions stored thereon, characterized in that, When the computer instructions run on an electronic device, the electronic device executes the method according to any one of claims 1-24.
27. A computer program product comprising computer instructions, characterized in that, When a computer program product runs on a computer, the computer executes the method according to any one of claims 1-24.