Video data generation method and electronic equipment
By displaying the labels associated with the material on the interface of the electronic device, users can help them select video templates, solve the problems of low user participation and high rework rate, and achieve more efficient video data generation.
Patent Information
- Application Number
- CN202410134904.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-30
- Publication Date
- 2025-08-08
AI Technical Summary
In the prior art, when the electronic device is functioned as one-click to form a chip, the user's participation is low, resulting in the created video works that do not meet expectations, the rework rate is high, and the human-computer interaction efficiency is reduced.
By providing tags associated with the material when displaying multiple materials on the interface of the electronic device, the user can select tags to match the appropriate video template. The electronic device determines the video template based on the tags selected by the user and generates video data that meets the user's expectations.
It improves the accuracy and efficiency of video creation, reduces the rework rate, and improves users' participation and human-computer interaction efficiency in the video production process.
Smart Images

Figure CN120455786A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to a method for generating video data and an electronic device. Background Art
[0002] With the popularity of electronic devices with camera functions, users can use electronic devices to take pictures (photos) or videos anytime and anywhere, thereby recording precious moments.
[0003] Users can also create works based on images or videos stored on electronic devices. Enabling the one-click video creation feature can simplify video creation. However, when using this feature, user participation is low, and the resulting video often fails to meet user expectations. This results in a high rework rate and reduces the efficiency of human-computer interaction in video creation. Summary of the Invention
[0004] The embodiments of the present application provide a video data generation method and electronic device to reduce the rework rate of video creation and improve the human-computer interaction efficiency of creating video works.
[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0006] In a first aspect, a video data generation method provided in an embodiment of the present application can be applied to an electronic device. The above-mentioned electronic device can display a first interface, on which multiple materials are displayed. A user can select materials for producing video works in the first interface through a first operation.
[0007] The above-mentioned material may be a photo material, a video material, a dynamic picture material, etc. The above-mentioned first operation may be clicking on the material displayed in the first interface, or gazing at the display position of the material on the first interface, etc.
[0008] Taking the first material displayed in the first interface as an example, the electronic device determines that the user has selected the first material in response to the user's first operation on the first material. When the first material is selected, one or more tags may also be displayed.
[0009] As you can understand, tags are brief information describing a video template. A video template can be templated data used to create a video work, and can include, for example, special effects, music, and editing templates. Electronic devices can pre-configure a variety of video templates, each of which has one or more tags. Users can participate in the selection of video templates by selecting tags, which helps the electronic device select a video template that best meets the user's expectations.
[0010] In the above embodiment, in response to the user selecting the first material, the electronic device displays tags including tags associated with the first material. It is understood that the tags associated with the first material are derived from a video template suitable for processing the first material. For example, if the visual content of the first material matches the style of the video template, the video template is suitable for processing the first material.
[0011] The tags associated with different assets can be the same or different. If the tags associated with the third asset differ from those associated with the first asset, the tags displayed in the first interface will differ when the user selects the third asset and the first asset. This allows the electronic device to accurately recommend tags tailored to the asset selected by the user.
[0012] After displaying one or more tags, in response to a user operation on a first tag among the one or more tags, the first tag is marked as selected. The display form of the tag marked as selected and the tags not marked as selected may be different. For example, the tag marked as selected may be displayed in a grayed-out state.
[0013] Afterward, upon detecting the user's second action instructing to create a video, a first template is determined based on the user's selected first tag. The first template corresponds to at least one first tag. It is understood that the user's selected first tag may indicate the user's preference for a video template. The first module determined based on the first tag has a high probability of meeting the user's expectations and is suitable for processing the first material.
[0014] In this way, based on the first template and the first material, the probability that the generated first video data meets the user's expectations is higher. Without increasing the difficulty of operation, the user's participation in the video production process is improved, the rework rate of video production is reduced, and the human-computer interaction efficiency of creating video works is improved.
[0015] In some embodiments, the electronic device displays a creation interface in response to a user instruction to run a gallery application. The creation interface includes a creation entry control, and in response to a user clicking on the creation entry control, a first interface is displayed.
[0016] In other embodiments, the electronic device displays an editing main interface in response to a user instruction to run an editing application, the editing main interface includes a creation entry card, and displays a first interface in response to the user clicking on the creation entry card.
[0017] In the above embodiment, the electronic device can enter the first interface from multiple types of applications. Through the configuration of multiple entrances, it is convenient for the user to trigger the electronic device to start the video data generation method in multiple application scenarios.
[0018] In some embodiments, the first interface includes a first pop-up window. After the first interface is displayed, in response to a user's first operation on the first material, a thumbnail of the first material is displayed in the first pop-up window. In addition, one or more labels may be displayed in the first pop-up window.
[0019] Exemplarily, the above-mentioned tags may be displayed at the bottom of the material thumbnail, prompting the user to continue to select the corresponding tags after selecting the material, thereby facilitating user operation and improving human-computer interaction efficiency.
[0020] In some embodiments, in response to a user operation, after the selected material is changed, an update of the displayed label may be triggered.
[0021] For example, the multiple materials displayed in the first interface also include a second material. After the label is displayed in the first pop-up window, in response to the user's third operation on the second material, a thumbnail of the second material is newly displayed in the first pop-up window, and the one or more labels displayed in the first pop-up window are updated. For example, a label related to the second material is added.
[0022] Among them, the above-mentioned third operation is similar to the first operation, both of which are operations for indicating the selection of materials.
[0023] As another example, in response to a user operation canceling a user-selected material, an update of the label displayed in the pop-up window may also be triggered. For example, if a second material is already selected, in response to a fourth user operation on the second material (an operation indicating canceling the selection of the material), the second material is canceled from the pop-up window, and the label corresponding to the second material is also canceled.
[0024] It can be seen that the labels in the pop-up box can be changed dynamically, avoiding the problem that the labels displayed in the pop-up box are less compatible with the material after the selected material changes.
[0025] In some embodiments, the first interface includes a search bar. After the first interface is displayed, the keyword entered by the user is displayed in the search bar in response to the user's input operation; multiple materials displayed on the first interface are updated; wherein, after the materials are updated, the materials displayed in the first interface all match the keyword; the materials matching the keyword include the first material.
[0026] In the above embodiment, the user can filter the materials by searching, thereby improving the human-computer interaction efficiency of searching for materials. In particular, when there are more materials stored in the device, the search efficiency is improved more.
[0027] In some embodiments, the first tag includes a first target tag and a second target tag, and in response to the user's operation on the first tag among the one or more tags, marking the first tag as selected includes: in response to the user clicking on the first target tag, marking the first target tag as selected; in response to the user clicking on the second target tag, marking the second target tag as selected.
[0028] In the above embodiment, the user can select multiple tags in sequence, and the electronic device can also search for the first template according to the multiple tags selected by the user, thereby improving the accuracy of the found first template.
[0029] In some embodiments, before marking the second target tag as selected in response to the user clicking the second target tag, the method further includes: updating the one or more displayed tags in response to the user clicking the first target tag.
[0030] In the above embodiment, the displayed tags can change dynamically according to the tags actually selected by the user, making the tag recommendation more flexible and accurate.
[0031] In some embodiments, the first target tag and the third tag among the one or more tags are tags indicating a template style. The updating of the one or more tags displayed includes: in response to the user clicking the first target tag, canceling the display of the third tag.
[0032] In the above embodiment, after the user has selected a tag indicating a template style, other tags indicating template styles are canceled and the user is guided to select other types of tags. In this way, the applicable first template can be determined more accurately through multiple types of tags.
[0033] In some embodiments, updating the displayed one or more tags further includes: if the first target tag is a tag of the template style, displaying a fourth tag indicating a tag of the music genre in the video template, the fourth tag matching the first target tag.
[0034] If the video template has both the first target tag and the fourth tag, it can be determined that the first target tag and the fourth tag are matched.
[0035] In the above embodiment, after the tag indicating the style of the template is determined, the user is guided to view the matching music tags to avoid the music tag selected by the user conflicting with the selected tag, thereby affecting the accuracy of determining the first template.
[0036] In other examples, the card point label of the template style and the card point music label are displayed separately to avoid repeated selection by the user.
[0037] In some embodiments, the first tag includes a first target tag, a second target tag, and a third target tag. The first tag refers to a tag selected by the user.
[0038] If the preconfigured video template includes a first target template, the first template is a video template determined from the first target template, and the first target template also includes a first target tag, a second target tag and a third target tag, ensuring that the selected first template can fit all tags. In this way, the video data created based on the first template can be closer to the user's expectations.
[0039] If the preconfigured video template includes a second target template, a third target template and a fourth target template, but does not include the first target template, the first template is a video template determined from the second target template, the third target template and the fourth target template; the second target template includes both the first target tag and the second target tag, but does not include the third target tag; the third target template includes both the first target tag and the third target tag, but does not include the second target tag; the fourth target template includes both the second target tag and the third target tag, but does not include the first target tag.
[0040] If the preconfigured video template includes the fifth target template, the sixth target template and the seventh target template, but does not include the first target template, the second target template, the third target template and the fourth target template, the first template is a video template determined from the fifth target template, the sixth target template and the seventh target template; the fifth target template includes the first target tag, but does not include the second target tag and the third target tag; the sixth target template includes the second target tag, but does not include the first target tag and the third target tag; and the seventh target template includes the third target tag, but does not include the second target tag and the first target tag.
[0041] In the above embodiment, it is ensured that the selected first template is the video template that best fits the first tag selected by the user.
[0042] In some embodiments, if the preconfigured video template includes a second target template, a third target template, and a fourth target template, the first target label and the second target label are different labels of the same type, and the third target label and the first target label are labels of different types, the probability of the first template being selected from the third target template or the fourth target template is higher than the probability of being selected from the second target template.
[0043] In the above embodiment, the first template is selected from the video templates that meet more different types of tags, ensuring that the selected first template is the most suitable video template for selection.
[0044] In some embodiments, the second interface includes a first control, and the method further includes: detecting that a user clicks on the first control; in response to the user clicking on the first control, displaying second video data on the second interface, the second video data including the first material, special effects from the second template, and music from the second video template, the second template corresponds to at least one first tag, and the second template and the first template are different video templates.
[0045] In the above embodiment, if the user is dissatisfied with the first video data, they can use the first control to change the video template and recreate the video work. The replaced second template still matches the video template with the user's selected tags. Clearly, in this process, the user's triggering of rework is simple, and the second template selected during rework still matches the user's selected tags. This not only meets the user's expectations for the created video work, but also improves the efficiency of human-computer interaction during creation.
[0046] In some embodiments, after detecting that a user clicks the first control, a second pop-up window is displayed, wherein the second pop-up window includes a first identifier of the second template and a second identifier of the third template. The second template is a video template determined in response to the user clicking the first control, from among the video templates corresponding to at least one first tag. The third template is another video template corresponding to at least one first tag. The first identifier may be a cover image corresponding to the second template. The second identifier may be a cover image corresponding to the third template.
[0047] In the second pop-up box, the first indicator is in a selected state and the second indicator is in an unselected state. It can be understood that the display forms of the first indicator in the selected state and the second indicator in the unselected state are different, and the user can distinguish them.
[0048] In some embodiments, the electronic device can respond to the user's operation in the second pop-up window by displaying the identifiers of other video templates for the user to select. The other video templates may include templates related to the first tag or templates unrelated to the first tag, making it easier for the user to find a video template they like and create a new video work.
[0049] When there are multiple video template logos in the second pop-up frame, the multiple video template logos are arranged in order from left to right in the second pop-up frame.
[0050] For example, when the user selects L first tags, the video templates with L first tags are arranged before the video templates with L-1 first tags. L is a positive integer greater than 1.
[0051] For example, when the user selects L first tags, if there is only a video template with one first tag, the video templates are grouped according to the first tag they have, and video templates with different first tags are grouped together. In the second pop-up box, the video templates of each group are arranged in sequence.
[0052] In some embodiments, the first interface includes a first pop-up box, and the one or more tags include first-category tags, second-category tags, and third-category tags; the first-category tags are tags indicating the style of the video template; the second-category tags are tags indicating the music type in the video template; the third-category tags are tags indicating the theme type in the video template; the first-category tags are arranged in the first row area of the first pop-up box; the second-category tags are arranged in the second row area of the first pop-up box; the third-category tags are arranged in the third row area of the first pop-up box.
[0053] In some embodiments, the above-mentioned one or more tags also include a first commonly used tag and a second commonly used tag; the first commonly used tag is the tag with the highest selection frequency among the first category of tags; the second commonly used tag is the tag with the highest selection frequency among the second category of tags; the first category of tags is a tag indicating the style of the video template, and the second category of tags is a tag indicating the type of music in the video template; within the first date, one or more tags also include an operation tag, and the operation tag is used to indicate a video template exclusive to the first date.
[0054] In the above embodiment, the displayed tags include not only tags related to the material selected by the user, but also tags frequently used by the user, and special tags related to dates, so that the tag recommendation is more accurate.
[0055] In some embodiments, the first interface includes a first pop-up box, in which one or more tags are arranged from left to right. The operation tag is arranged before the first commonly used tag and the second commonly used tag, and the tag associated with the first material is arranged after the first commonly used tag and the second commonly used tag; among the tags associated with the first material, the first category tags and the second category tags are arranged alternately. In this way, the user is guided to first decide whether to select a special tag related to the date, then decide whether to select a commonly used tag, and finally decide whether to select a tag related to the selected material. In addition, the first category tags and the second category tags are arranged alternately to reduce the probability of the user selecting multiple tags of the same type.
[0056] In a second aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory is used to store code instructions; the processor is used to run the code instructions so that the electronic device executes the method described in the first aspect and any one of its implementations.
[0057] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores instructions. When the instructions are executed, the computer executes the method described in the first aspect and any one of its implementations.
[0058] In a fourth aspect, a computer program product includes a computer program, which, when executed, enables a computer to execute the method described in the first aspect and any one of its implementations.
[0059] It should be understood that the second to fourth aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] Figure 1 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0061] Figure 2 This is one of the example scenes for enabling the one-click blockbuster function provided in an embodiment of the present application;
[0062] Figure 3 This is the second example of a scenario for enabling the one-click blockbuster function provided in an embodiment of the present application;
[0063] Figure 4 This is an example diagram of a search scenario for materials provided in an embodiment of the present application;
[0064] Figure 5 This is an example diagram of a scene for selecting materials and tags provided in an embodiment of the present application;
[0065] Figure 6 This is an example diagram of a scenario for canceling a selected tag provided in an embodiment of the present application;
[0066] Figure 7 This is one of the example diagrams of the label arrangement provided in the embodiment of the present application;
[0067] Figure 8 This is one of the example diagrams of the interaction between a user and a displayed tag provided in an embodiment of the present application;
[0068] Figure 9 This is a second example diagram of the interaction between a user and a displayed tag provided in an embodiment of the present application;
[0069] Figure 10This is an example diagram of a scene in which the displayed label changes with the selected material provided in an embodiment of the present application;
[0070] Figure 11 This is an example diagram of a scene in which the displayed tag changes with the selected tag provided in an embodiment of the present application;
[0071] Figure 12 This is the second example diagram of the label arrangement provided in the embodiment of the present application;
[0072] Figure 13 The third example diagram of the arrangement of labels provided in the embodiment of the present application;
[0073] Figure 14 This is an example diagram of a scene for creating a video work provided in an embodiment of the present application;
[0074] Figure 15 This is an example diagram of a scenario for changing a video template provided in an embodiment of the present application;
[0075] Figure 16 This is one of the example diagrams of the arrangement of recommended video templates provided in the embodiment of the present application;
[0076] Figure 17 This is the second example diagram of the arrangement of recommended video templates provided in an embodiment of the present application. DETAILED DESCRIPTION
[0077] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.
[0078] At the same time, in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner to facilitate understanding.
[0079] In the technical solutions disclosed in this application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved comply with the provisions of relevant laws and regulations and do not violate public order and good morals.
[0080] With the advancement of terminal technology, users are increasingly using electronic devices. To meet users' needs to record and share their lives anytime, anywhere, most electronic devices are equipped with cameras. This allows users to capture footage such as photos, videos, and animated images anytime, anywhere. Furthermore, these devices can respond to user actions and create video productions based on the captured footage.
[0081] During the video production process, users need to conceive how to create the video, and they also need to manually edit the footage, configure the video music, add animation effects, and add transition effects. Obviously, for users who lack production experience, creating high-quality video works is quite difficult, which affects their creative enthusiasm.
[0082] In some embodiments, electronic devices provide a one-click blockbuster feature to assist users in creating video works. This one-click blockbuster feature, also known as the one-click film creation feature, is a feature for creating video works based on video templates. These video templates include editing templates, various video effects, and video sound effects (or video music).
[0083] The aforementioned "one-click blockbuster" feature can reduce user involvement in the creative process and ease the difficulty of creation. For example, after enabling the "one-click blockbuster" feature, the electronic device can randomly select a video template and process the user's selected material according to the video template. For example, it can edit the user's selected material according to an editing template to produce a video clip. The video clip can then be assigned video music and / or video effects to produce a video work.
[0084] While the "One-Click Blockbuster" feature can simplify video creation, the random nature of video templates means the resulting video will likely not meet user expectations. In this scenario, users will need to re-enable the "One-Click Blockbuster" feature until they achieve a video that meets their expectations. This process is cumbersome and inefficient, leading to low human-computer interaction efficiency.
[0085] An embodiment of the present application provides a method for generating video data, which can be applied to an electronic device including a display screen. The electronic device can recommend multiple tags to the user based on the material selected by the user. The tags are information used to describe the video template. For example, the same video template can correspond to multiple tags, and the multiple tags can describe the video template from multiple dimensions, such as style, music, theme, and special events. In addition, different video templates can also correspond to the same tags, indicating that there is similarity between different video templates in a certain dimension.
[0086] Afterwards, the electronic device can match the video template used to produce the video work according to the tag selected by the user, making the matched video template more accurate, and the higher the probability that the generated video work meets the user's expectations, reducing the rework rate of video creation and improving the human-computer interaction efficiency of the electronic device in creating video works.
[0087] For example, the electronic device in the embodiments of the present application may be a mobile phone, a tablet computer, a smart watch, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, as well as a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) or virtual reality (VR) device, etc., which includes multiple cameras. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.
[0088] The following is a detailed description of the implementation of the embodiment of the present application with reference to the accompanying drawings. Figure 1 , is a structural diagram of an electronic device 100 provided in an embodiment of the present application. Figure 1 As shown, the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0089] Among them, the above-mentioned sensor module 180 may include sensors such as pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor and bone conduction sensor.
[0090] It should be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 100. In other embodiments, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0091] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.
[0092] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0093] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0094] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.
[0095] It is understood that the interface connection relationship between the modules illustrated in this embodiment is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.
[0096] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0097] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLED, or a quantum dot light-emitting diode (QLED).
[0098] The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
[0099] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.
[0100] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include N cameras 193, where N is a positive integer greater than 1.
[0101] Exemplarily, the N cameras 193 may include: one or more front cameras and one or more rear cameras.
[0102] In some embodiments, the electronic device may enable at least one of the N cameras 193 to take pictures and generate corresponding photos or videos.
[0103] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0104] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0105] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0106] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110. The speaker 170A, also known as the "speaker", is used to convert audio electrical signals into sound signals. In this way, the electronic device 100 can play audio data, such as video, music, etc.
[0107] The pressure sensor is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor can be set on the display screen 194. The gyroscope sensor can be used to determine the movement posture of the electronic device 100. When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device 100 and applied to applications such as horizontal and vertical screen switching. Touch sensor, also known as "touch panel". The touch sensor can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as a "touch screen". The touch sensor is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
[0108] The methods in the following embodiments can all be implemented in the electronic device 100 having the above hardware structure. The methods in the embodiments of the present application are described below with reference to the accompanying drawings.
[0109] In some embodiments, the gallery application and the editing application in the electronic device can provide an entrance to the one-click blockbuster function. It is understandable that other applications in the electronic device that can provide image editing services can also provide an entrance to the one-click blockbuster function, such as a short video application.
[0110] like Figure 2 As shown, the electronic device displays a main interface 201, and the main interface 201 displays application icons of installed applications, such as a gallery icon 202 and a clip icon 203. For example, the user can instruct the corresponding application to run in the foreground by operating the application icon. Figure 2As shown, in response to the user clicking on the gallery icon 202 , the gallery application is run in the foreground, and the application interface corresponding to the gallery application, such as the creation function interface 204 , is displayed.
[0111] like Figure 2 As shown, the creation function interface 204 includes a one-click blockbuster function entrance, such as a control 205. In response to the user clicking the control 205, the electronic device can display a material browsing interface 206, which can also be called a first interface. For example, Figure 2 As shown, the material browsing interface 206 includes preview images of stored materials, such as preview image 214. The stored materials include photos, videos, or dynamic images captured by the electronic device through shooting, screenshots, or other methods. Displaying preview images of materials on the material browsing interface 206 may also be referred to as displaying the materials on the material browsing interface 206.
[0112] In addition, preview images of the most recently captured, saved, or screenshotted materials may be displayed in the front. Each preview image displayed in the material browsing interface 206 may include a control for selection (e.g., a selection button 207). The selection button 207 is used to indicate that the material corresponding to the preview image 214 is available for user selection. In response to a user clicking on the preview image 214, it is determined that the user has selected the material corresponding to the preview image 214. Accordingly, the electronic device may cancel displaying the selection button 207 and display a selection indicator relative to the preview image 214. For details, see the subsequent embodiments.
[0113] Optionally, each preview image displayed in the material browsing interface 206 may include a control for zooming in (e.g., a zoom button 208). In response to the user clicking the zoom button 208, the electronic device may add a display mask and display the material corresponding to the preview image 214 on the mask.
[0114] Optionally, the user can slide to view more materials on the material browsing interface 206. When the material browsing interface 206 cannot display preview images of all materials at the same time, the preview images of some materials can be hidden. Later, in response to the user's sliding operation, the hidden materials can be displayed on the material browsing interface 206.
[0115] In addition, the material browsing interface 206 may further include a pop-up window 209, which may also be referred to as a first pop-up window. The pop-up window 209 may include a prompt message 210 and a one-key blockbuster control 211. The prompt message 210 is used to prompt the user to automatically generate a film after selecting the material. The one-key blockbuster control 211 can generate a blockbuster (video blockbuster) based on the material selected by the user. The material browsing interface 206 may further include a close control 212 and a search bar 213 displayed above the interface. Among them, the close control 212 is used to return to the previous interface (such as Figure 2 The search bar 213 is used to assist users in searching for materials. Figure 4 .
[0116] For example Figure 3 As shown, the electronic device displays a main interface 201. In response to the user clicking the clip icon 203, the clip application is run in the foreground, and the application interface corresponding to the clip application is displayed, such as the clip main interface 301. Figure 3 As shown, the editing main interface 301 also includes a one-click blockbuster function entrance, such as a card 302. In response to the user clicking the card 302, the electronic device can also display the material browsing interface 206.
[0117] In some embodiments, while the electronic device displays the material browsing interface 206, the user can instruct the electronic device to filter the materials displayed in the material browsing interface 206. For example, the electronic device can receive keywords input by the user and, in response to the received keywords, display materials that match the keywords on the material browsing interface 206.
[0118] like Figure 4 As shown, in response to the user clicking the search bar 213, a soft keyboard 401 is displayed on the material browsing interface 206. The user can enter keywords by operating on the soft keyboard 401. In response to the keywords entered by the user, the electronic device performs material screening and selects materials that match the keywords.
[0119] For example, the search bar 213 displays a demonstration word 402 , which has a guiding effect. The user can refer to the demonstration word 402 to determine the keyword to be input.
[0120] Among them, "photo" in demonstration word 402 is an example of a material type word, which is used to guide the user to enter a word indicating the material type to trigger material screening. For example, if the user enters "photo", the electronic device will filter out materials of the photo type. For another example, if the user enters the keyword "video", the electronic device will filter out materials of the video type.
[0121] The "character" in the exemplary word 402 is an example of a word indicating the content of the screen, and is used to guide the user to input a word indicating the content of the screen to trigger the screening of materials. For example, if the user inputs a name, the electronic device will screen out materials including the character corresponding to the name.
[0122] "Location" in demonstration word 402 is an example of a material attribute, guiding the user to enter a term indicating a material attribute to trigger material selection. For example, if the user enters location A, the electronic device will select materials with the shooting address of location A. Another example is if the user enters time A, the electronic device will select materials with the shooting time of time A. In these examples, the shooting address and shooting time are both material attributes.
[0123] like Figure 4 As shown, the user inputs the keyword "sunrise" through the soft keyboard 401, and the electronic device can display the keyword 403 on the search bar 213, that is, the character sunrise. In addition, the electronic device can also respond to the keyword 403 and filter out the material that fits the keyword 403 from the stored materials. For example, if the picture content of the material is related to sunrise, it can be determined that the material fits "sunrise". As an implementation method, the electronic device can identify the preview image of the stored material to obtain a recognition result. Among them, the above-mentioned recognition result can indicate the picture content of the material, such as the shooting object, background elements, etc. Afterwards, based on the recognition result, the material related to sunrise is filtered out. For example, the background contains the material of the sunrise.
[0124] After determining the material that matches the keyword 403, the electronic device can update the material displayed in the material browsing interface 206. Figure 2 and Figure 3 After the update, the material browsing interface 206 in Figure 4 The number of materials in the material browsing interface 206 is reduced, and the materials displayed are all materials that match the keyword 403.
[0125] Afterwards, the user can also add or change keywords through the soft keyboard 401. Taking the addition of keywords as an example, the user continues to enter "sunset" through the soft keyboard 401, and the electronic device can display keyword 404, that is, the character "sunset", on the search bar 213. The above keyword 404 is displayed adjacent to keyword 403. The electronic device can also respond to keyword 404 and filter out materials that match keyword 404 from the stored materials. For example, if the picture content of the material is related to sunset, it can be determined that the material matches "sunset". Afterwards, the electronic device can update the materials displayed in the material browsing interface 206. After the update, the material browsing interface 206 will display the material that matches keyword 404. That is, after the update, the material browsing interface 206 will display materials that match keyword 403 or keyword 404. If the user changes the keyword, the materials displayed in the material browsing interface 206 will be updated so that the displayed materials all match the changed keyword.
[0126] In short, the materials displayed on the material browsing interface 206 can change according to the keywords input by the user (ie, the keywords displayed on the search bar 213 ), thereby improving the human-computer interaction efficiency of the user in searching for materials.
[0127] Afterwards, in response to the user clicking on a blank display area in the material browsing interface 206 , the soft keyboard 401 may be retracted.
[0128] In some embodiments, while the electronic device displays the material browsing interface 206 , the user can select materials for creating a video work from the materials displayed on the material browsing interface 206 .
[0129] like Figure 5 As shown, in response to a user's first operation on preview image 501, it is determined that the material corresponding to preview image 501 (e.g., the first material) is selected. Accordingly, the electronic device may display a selection indicator 502 relative to preview image 501. For example, the first operation may be the user clicking on preview image 501. For another example, the first operation may be the user gazing at the display area of preview image 501.
[0130] The selection indicator can be an icon containing a sequence number. For example, when only one material is selected, the selection indicator corresponding to that material is an icon containing the sequence number "1." For example, if the user only clicks on preview image 501, the selection icon 502 displayed relative to preview image 501 is an icon containing the sequence number "1." For example, when multiple materials are selected, the selection indicators corresponding to the multiple materials can be icons containing different sequence numbers. The larger the sequence number, the more recently the corresponding material was selected. For example, a user sequentially clicks on preview image 501, preview image 503, and preview image 504. The electronic device detects the user clicking on preview image 501 and displays selection icon 502 containing the sequence number 1 relative to preview image 501. Subsequently, the electronic device detects the user clicking on preview image 503 and displays selection icon 505 containing the sequence number 2 relative to preview image 503. The electronic device detects the user clicking on preview image 504 and displays selection icon 506 containing the sequence number 3 relative to preview image 504.
[0131] If the user instructs to cancel the selection of a material, the selection mark of the material can be removed. In addition, the electronic device can also update the selection marks of other materials, ensuring that the minimum value of the sequence number of the selection marks of other materials is 1 and remains continuous. For example, if the selection mark 502 is displayed on the preview image 501, in response to the user clicking the preview image 501 again, or in response to the user clicking the delete control 511 on the thumbnail 507, the selection mark 502 is removed from the display. In addition, the sequence number of the selection mark 505 can be updated from 2 to 1, and the sequence number of the selection mark 506 can be updated from 3 to 2.
[0132] In some embodiments, in response to the user selecting any material, the electronic device may further display a thumbnail of the selected material in the pop-up box 209 .
[0133] like Figure 5 As shown, after determining that the material corresponding to preview image 501 is selected, the electronic device displays thumbnail 507 in pop-up box 209, and the material indicated by the thumbnail 507 is the same as the material indicated by preview image 501. After determining that the material corresponding to preview image 503 is selected, the electronic device displays thumbnail 509 in pop-up box 209, and the material indicated by the thumbnail 509 is the same as the material indicated by preview image 503. After determining that the material corresponding to preview image 504 is selected, the electronic device displays thumbnail 510 in pop-up box 209, and the material indicated by the thumbnail 510 is the same as the material indicated by preview image 504. It can be understood that the thumbnails of the materials selected by the user will be displayed in the pop-up box 209, and the user-selected materials mentioned in subsequent embodiments may refer to the materials corresponding to the thumbnails displayed in the pop-up box 209.
[0134] When the pop-up box 209 includes multiple thumbnails, they are arranged from left to right in the order in which the corresponding materials are selected. Among them, the material with the thumbnail arranged on the leftmost side of the pop-up box 209 can also be called material a. For example, Figure 4 In the illustrated scene, thumbnail 507 is arranged at the far left of the pop-up box 209 , and thumbnail 507 is a thumbnail of material a.
[0135] In some embodiments, in response to the user selecting material a, the electronic device may further display one or more tags 508 in the pop-up box 209. The tags required to be displayed in the pop-up box 209 are divided into recommended tags, operational tags, and common tags according to different determination methods.
[0136] It can be understood that the above tags are all tags of the video template. The tag types of the video template may include tags indicating the style of the template (such as called template style tags, or first-class tags), tags indicating the theme (such as called theme tags, or third-class tags), tags indicating the soundtrack (such as called music tags, or, second-class tags) and / or event tags. Among them, the above-mentioned recommended tags can be selected from the template style tags, music tags and theme tags of the video template, the operation tags can be selected from the event tags of the video template, and the commonly used tags can be selected from the template style tags, theme tags and / or music tags of the video template.
[0137] Table 1 shows examples of common template style tags, theme tags, and music tags:
[0138] Table 1
[0139]
[0140] Table 1 is only an example and is not intended to be limiting.
[0141] In addition, festivals (such as Christmas), solar terms (such as the beginning of spring) or pre-configured important days (such as sports games) all have corresponding event tags.
[0142] Among them, the video template suitable for making "festival" related videos corresponds to the event label of the festival. For example, the video template suitable for making Christmas related videos contains the event label corresponding to Christmas (such as the label "Christmas").
[0143] A video template suitable for making videos related to solar terms has an event tag corresponding to that solar term. For example, a video template suitable for making videos related to the beginning of spring contains an event tag corresponding to the beginning of spring (e.g., the tag "Beginning of Spring").
[0144] A video template suitable for making videos related to important days has an event tag corresponding to the important day. For example, a video template suitable for making videos related to sports games contains an event tag corresponding to sports games (e.g., the tag "sports games").
[0145] It is understandable that some video templates correspond to event tags, while some video templates may not have event tags.
[0146] For example, the electronic device can filter out the recommended tags to be displayed from the template style tags, music tags, and / or theme tags of all video templates based on material a. In this way, after the user selects the first material, the electronic device can promptly push one or more tags to the user. As an implementation method, the electronic device determines a video template a suitable for material a based on information such as the picture content and picture brightness of material a. The electronic device then determines the recommended tags based on video template a. For example, the recommended tags include the template style tags, music tags, and / or theme tags of video template a.
[0147] For example, if video template a contains children or toys, the video template a is determined to be a childlike video template. If video template a has a childlike tag (indicating the template's style) and a light music tag (indicating the template's soundtrack style), the electronic device will determine the recommended tags as "childlike" and "light music."
[0148] For example, if the image brightness of material A is dim, and the determined video template A is a texture-themed video template with romantic music, then if video template A has a texture tag (indicating the template's style) and a romantic music tag (indicating the template's soundtrack style), the electronic device will determine the recommended tags as "texture" and "romantic music."
[0149] As another implementation, the electronic device determines a video template b that matches material a based on the keywords used by the user to search for material a. The electronic device then determines recommended tags based on video template b. For example, the recommended tags include a template genre tag, a music tag, and / or a theme tag for video template b.
[0150] For example, after the user enters "sunrise and sunset" in the search bar 213, the electronic device displays keywords 403 and 404 on the search bar 213. During the display of keywords 403 and 404 on the search bar 213, it is detected that the user has selected the material corresponding to the preview image 501, and the thumbnail 507 corresponding to the preview image 501 is displayed on the far left of the pop-up box 209. In this scenario, it can be determined that the material corresponding to the thumbnail 507 is material a, and correspondingly, it is determined that the keywords used by the user to search for material a are "sunrise" and "sunset". Then, the electronic device determines a video template b suitable for producing "sunrise" and / or "sunset" related videos. If the video template b corresponds to a movie tag (indicating the style of the template), a texture music tag (indicating the music style of the template) and an event tag "Lixia", the corresponding recommended tags determined by the electronic device include the tag "movie" and the tag "texture music".
[0151] In addition, the electronic device can also determine the video template c that matches the material b. If the video template c corresponds to a theme tag, the theme tag is also determined as a recommended tag. Among them, the above-mentioned material b is the material in the pop-up box 209, except for the material a. It can be seen that as the material selected by the user increases, the pushed tags can change, making the recommendation more accurate. For details, please refer to the subsequent embodiments. Figure 10 , I will not go into details here.
[0152] As another example, if the current day is a holiday, solar term or pre-configured important day (collectively referred to as the first date), the event label indicating the holiday, solar term or important day can also be determined as the operation label to be displayed.
[0153] In some embodiments, each tag in the electronic device corresponds to a selection count. For example, after a user selects a video template to create a video work and retains the video work, the selection count corresponding to the tag of the video template is increased by one.
[0154] For another example, the electronic device may sort the preset template style tags, music tags, and theme tags in the electronic device according to the number of times the tags have been selected, with tags with higher selection counts being ranked first and tags with lower selection counts being ranked last. The electronic device may determine the tags ranked in the top N positions as frequently used tags, where N is a positive integer greater than 0, such as 2.
[0155] In other embodiments, the electronic device may determine the template style tag with the highest number of selections as a commonly used tag (a first commonly used tag), and determine the music tag with the highest number of selections as another commonly used tag (a second commonly used tag). If the number of selections corresponding to the template style tags is 0, the commonly used tags determined do not contain the template style tags. If the number of selections corresponding to the music tags is 0, the commonly used tags determined do not contain the music tags. In this way, in some scenarios, only one commonly used tag is displayed in the pop-up box 209, in other scenarios, no commonly used tag is displayed in the pop-up box 209, and in other scenarios, two commonly used tags are displayed in the pop-up box 209. In other scenarios, no commonly used tags are displayed in the pop-up box 209.
[0156] In some embodiments, the labels displayed on the bullet box 209 are all interactive controls. Figure 5 As shown, the tags 508 displayed on the pop-up box 209 include tags 508-1 and tags 508-2. In response to the user clicking on tags 508-1 and tags 508-2, tags 508-1 and tags 508-2 are marked as selected, indicating that the above tags 508-1 and tags 508-2 have been selected by the user.
[0157] In some scenarios, the user can change the selected tag 508. Figure 6 As shown, if tags 508-1 and 508-2 are selected, and a user clicks on tag 508-1, the electronic device may unselect tag 508-1 to indicate that the user has not selected it. Subsequently, if the electronic device detects a user click on the one-click blockbuster control 211, the electronic device selects a target template 1 from among the video templates with tag 508-2 that match the user-selected material. Based on the user-selected material, the corresponding video work is generated according to target template 1.
[0158] In some embodiments, when there are multiple tags 508 to be displayed in the pop-up box 209, the multiple tags 508 can be displayed in a tiled manner from left to right. For example, Figure 7 As shown, the tags 508 to be displayed on the pop-up box 209 include: tag 508-1, tag 508-2, tag 508-3, tag 508-4, tag 508-5, tag 508-6, tag 508-7 and tag 508-8. The above multiple tags 508 are arranged in order from left to right, among which the operation tag is arranged before the commonly used tags, and the commonly used tags are arranged before the recommended tags, such as Figure 7As shown, tag 508-3 indicating "Christmas" is a determined operational tag, tag 508-1 indicating "texture" and tag 508-2 indicating "romantic music" are determined common tags, and tag 508-4 indicating "travel", tag 508-5 indicating "movie", tag 508-6 indicating "light music", tag 508-7 indicating "card point", and tag 508-8 indicating "dynamic music" are all determined recommended tags. Tag 508-3 is arranged before tags 508-1 and 508-2, and tags 508-1 and 508-2 are arranged before tags 508-4, 508-5, 508-6, 508-7, and 508-8.
[0159] In a possible embodiment, the number of tags 508 displayed in the pop-up box 209 can be a fixed value. Taking the number of tags 508 as 8, the number of operational tags that can be displayed is 1, the number of commonly used tags that can be displayed is 1 or 2, and the number of recommended tags that can be displayed is 5 (or 6). When the number of commonly used tags actually displayed is 1, the number of recommended tags that can be displayed is 6. When the number of commonly used tags actually displayed is 2, the number of recommended tags that can be displayed is 5.
[0160] If the electronic device determines that the number of recommended tags exceeds 5 (or 6), the electronic device can select 5 (or 6) tags from the determined recommended tags as the recommended tags that can actually be displayed. For example, the recommended tags are sorted according to the degree of relevance between the tags and the selected materials, and the tags ranked in the top 5 (or top 6) are used as the recommended tags that can actually be displayed. If the electronic device determines that the number of recommended tags is less than 5 (or 6), 1 (or 2) template style tags or music tags can also be randomly determined as supplementary tags. For example, the supplementary tags are arranged after other tags, so that the number of tags 508 displayed on the pop-up box 209 remains at 8.
[0161] For example, among the recommended tags displayed in the pop-up window 209, the theme tag is arranged first, and the template style tag and the music tag are displayed interspersed, for example, a music tag is displayed after a template style tag. The template style tag "Kadian" and the music tag "Kadian Music" may not be displayed at the same time.
[0162] When all labels 508 cannot be displayed simultaneously on the pop-up window 209, some labels 508 can be hidden. Figure 7 As shown, label 508-6, label 508-7 and label 508-8 are hidden. It can be understood that Figure 7The labels 508 displayed in the pop-up window 209 are all labels that need to be displayed in the pop-up window 209. The labels 508 with solid borders are labels visible to the current user, and the labels 508 with dotted borders are labels that are not visible to the current user. In addition, the electronic device can also scroll to display hidden labels 508 in response to the user sliding operation relative to the label 508.
[0163] like Figure 8 As shown, the sliding operation relative to the label 508 may be an operation in which the sliding track is located in the display area of the label 508. Figure 8 As shown, in response to the user's sliding operation relative to label 508, the electronic device hides label 508-3 and label 508-1 one by one, and displays label 508-6 and label 508-7 one by one.
[0164] The user can slide to view all tags 508 displayed on the pop-up box 209, and can click on one or more tags 508. In some embodiments, the electronic device can limit the number of selected tags 508 to no more than M, where M is a positive integer greater than 1, for example, M is 3.
[0165] like Figure 9 As shown, when the user has indicated that tags 508-2 and 508-4 have been selected, the electronic device can mark tag 508-5 as selected in response to the user clicking on tag 508-5 (the third target tag). At this time, the number of selected tags 508 in the pop-up box 209 is 3. Thereafter, in response to the user clicking on tag 508-6, the electronic device displays a prompt message 1001 to prompt the user that the number of selected tags has reached the upper limit. In addition, tag 508-6 in the pop-up box 209 remains unselected.
[0166] In some embodiments, the label 508 displayed on the pop-up window 209 may also change dynamically.
[0167] For example, the label 508 on the pop-up box 209 can change dynamically with the material selected by the user. For example, when the user selects a new material in the material browsing interface 206, such as the second material, the label 508 in the pop-up box 209 can change. Figure 10As shown, the electronic device displays the material browsing interface 206. Thumbnails 507, 509, and 510 are displayed on the pop-up box 209 of the material browsing interface 206, indicating that the materials corresponding to thumbnails 507, 509, and 510 have been selected by the user. In response to the user's input operation in the search bar 213, the keywords 403 and 404 in the search bar 213 are canceled, and a new keyword 1101 is displayed in the search bar 213, such as the characters "amusement park". That is, keywords 403 and 404 are replaced with keyword 1101. In response to the user input of keyword 1101, the materials in the material browsing interface 206 are updated. After the update, the materials whose screen content matches keyword 1101 are displayed in the material browsing interface 206. For example, the material browsing interface 206 includes a preview image 1102 and a preview image 1103 . The screen contents of the materials indicated by the preview image 1102 and the preview image 1103 are both consistent with an amusement park.
[0168] like Figure 10 As shown, in response to a third user operation on preview images 1102 and 1103, such as a click operation, the electronic device displays thumbnails 1104 and 1105 in pop-up window 209, indicating that the user has selected an additional material. Preview image 1102 and thumbnail 1104 correspond to the same material (e.g., material c), and preview image 1103 and thumbnail 1105 correspond to the same material (e.g., material d). Materials c and d are also materials selected by the user and can be referred to as second materials.
[0169] If the video template suitable for material c (or material d) contains the theme tag "parent-child", such as Figure 10 As shown, a new display label 508 - 9 is added in the pop-up box 209 , such as a second label.
[0170] In other embodiments, after the material selected by the user is added, that is, after thumbnails of other materials are added to the pop-up box 209 , the recommended tags can be re-determined in combination with the material displayed in the pop-up box 209 .
[0171] For example, the label 508 on the pop-up box 209 may change with the label actually selected by the user (referred to as the selected label, or the first label). Figure 11 As shown, the pop-up box 209 displays labels 508 - 1 , 508 - 2 , 508 - 3 , 508 - 4 , 508 - 5 , 508 - 6 , 508 - 7 and 508 - 8 .
[0172] In response to the user clicking on tag 508-1, the electronic device may cancel displaying tags of the same type as tag 508-1. For example, if tag 508-1 is a template style tag, the electronic device may cancel displaying other template style tags (e.g., third tags) in pop-up box 209, such as tag 508-5 indicating "movie" and tag 508-7 indicating "card point."
[0173] In some examples, when eight tags 508 need to be displayed in pop-up window 209, after removing tags 508-5 and 508-7, two new music tags are displayed in pop-up window 209: for example, tag 508-10 for "Clock Music" and 508-11 for "Healing Music." These newly added music tags can also be referred to as fourth tags. The fourth tag comes from the video template with tag 508-1, and can also be referred to as matching tag 508-1.
[0174] In other examples, the music tags in the tag 508 may be updated so that the updated music tags all come from a video template with a template style of "texture".
[0175] In other embodiments, the electronic device may further display different types of tags 508 on the pop-up box 209 according to the type of tag (template style tag, theme tag, and music tag).
[0176] for example, Figure 12 As shown, tags indicating the style of the film (including event tags and template style tags) are arranged before the music tag.
[0177] For example, Figure 13 As shown, in the pop-up box 209, labels 1401 indicating style (template style labels and event labels), labels 1403 indicating themes (theme labels), and labels 1402 indicating music (music labels) are displayed in separate rows. For example, labels 1401-1, 1401-2, 1401-3, and 1401-4 are labels 1401 indicating style, which can be displayed in the same row, such as in the first row area. Labels 1402-1, 1402-2, 1402-3, and 1402-4 are all labels 1402 indicating music, and can also be displayed in the same row, such as in the second row area. Labels 1403-1, 1403-2, and 1403-3 are all labels 1403 indicating themes, and can also be displayed in the same row, such as in the third row area. The first row area, the second row area and the third row area are all within the display area of the pop-up box 209 , the first row area is above the second row area, and the second row area is above the third row area.
[0178] In some embodiments, the label 1402 indicating the music displayed in the pop-up box 209 may change according to the label selected by the user. For example, the label 1402 displayed in the pop-up box 209 may be different before and after the user selects any label 1401. For another example, the label 1402 displayed in the pop-up box 209 may also be different when the user selects different labels 1401.
[0179] like Figure 13 As shown, in response to the user clicking on tag 1401-2, tag 1401-2 in the pop-up box 209 is set to a selected state. In addition, based on the selected tag 1401-2, the tag 1402 indicating music is updated, and the updated tags 1402 are all from the video template with tag 1401-2.
[0180] For example, video templates with texture tags include video template 1, video template 2, and video template 3. Video template 1 corresponds to the romantic music tag, video template 2 corresponds to the soothing music tag, and video template 3 corresponds to the light music tag. After the texture tag 1401-2 is selected, the electronic device updates the music tags in the pop-up box 209 from the pop music tag 1402-1, romantic music tag 1402-2, dynamic music tag 1402-3, and soothing music tag 1402-4 to the romantic music tag 1402-2, soothing music tag 1402-4, and light music tag 1402-5.
[0181] In addition, the pop-up box 209 also includes a control 1404 indicating collapse. In response to the user clicking the control 1404, the label 1402 indicating music and the label 1403 indicating the theme can be hidden.
[0182] In some embodiments, after the electronic device detects that the user selects a tag on the pop-up box 209, in response to the user clicking the one-key blockbuster control 211, such as the second operation, a video work is produced.
[0183] like Figure 14 As shown, after tags 508-1 and 508-2 are marked as selected, in response to the user clicking the one-click blockbuster control 211, a prompt information pop-up box 601 is displayed. Prompt information pop-up box 601 is used to prompt the user that the material is currently being intelligently analyzed and a video template is selected. For example, among the video templates with tags 508-1 and / or 508-2 that match the material selected by the user, target template 1 is selected. Then, based on the material indicated by the thumbnail displayed in the pop-up box 209 (the material selected by the user), the corresponding video work is generated according to target template 1.
[0184] As an implementation, the electronic device may preferentially select target template 1 from the first category of video templates, where the first category of video templates refers to video templates having all selected tags. For example, if the selected tags include tag A (e.g., referred to as the first target tag), tag B (e.g., referred to as the second target tag), and tag C (e.g., referred to as the third target tag), the first category of video templates refers to a video template (the first target template) having "tag A + tag B + tag C."
[0185] Exemplarily, selecting the target template 1 from the first category of video templates may be performed by randomly selecting the target template 1 from the first category of video templates. Exemplarily, selecting the target template 1 from the first category of video templates may be performed by selecting the target template 1 based on the popularity of each first category of video templates. Exemplarily, selecting the target template 1 from the first category of video templates may be performed by selecting the target template 1 from the first category of video templates based on user preset preference information. The embodiments of the present application do not limit the specific selection method.
[0186] In the absence of the first type of video template, the electronic device can also select the target template 1 from the second type of video template. It can be understood that the implementation details of selecting the target video template 1 from the second type of video template can refer to the implementation details of selecting the target template 1 from the first type of video template, which will not be repeated here.
[0187] The second type of video template refers to a video template that has L-1 selected tags, and the number of selected tags is less than L, where L is the number of selected tags. Continuing with the previous example, the second type of video template can include a video template with "tag A + tag B" (the second target template), a video template with "tag B + tag C" (the fourth target template), and a video template with "tag A + tag C" (the third target template).
[0188] For example, when tag B and tag A are tags of the same type, and tag C and tag B are tags of a different type, for example, tag B and tag A are both template style tags (or music tags, event tags, or theme tags), and tag C is a music tag (or template style tag, event tag, or theme tag), the electronic device can select target template 1 from the video templates having "tag A + tag C" and the video templates having "tag B + tag C". If there is no video template having "tag A + tag C" or "tag B + tag C", the electronic device can select target template 1 from the video template having "tag B + tag A".
[0189] In the absence of the first and second category video templates, the electronic device can also select target template 1 from the third category video templates. The second category video templates refer to video templates with L-2 selected tags, where the number of selected tags is less than L-1. Continuing with the previous example, the third category video templates include a video template with tag A (the fifth target template), a video template with tag B (the sixth target template), and a video template with tag C (the seventh target template).
[0190] In the case where the target template 1 needs to be selected from the third category of video templates, if label A and label C are template style labels, label B is a music label, and there is a conflict between label A and label B, the target template 1 is preferentially selected from the third category of video templates with label A or label C. It can be understood that the conflict between two labels means that the two labels are of different types and cannot be used to describe the same video template at the same time. For example, there is a conflict between the texture label (template style label) and the card point music label (music label). When the selected label contains the texture label and the card point music label, and there is only a third category of video templates, the video template with the texture label is preferentially selected as the target template.
[0191] As another implementation, the electronic device may randomly select a target template 1 from video templates containing at least one selected tag. The probability of selecting a first-category video template is higher than that of selecting a second-category video template, and the probability of selecting a second-category video template is higher than that of selecting a third-category video template. Furthermore, within the third-category video template, the probability of selecting a video template containing a template style tag is higher than that of selecting a video template containing a music tag.
[0192] In addition, in response to the user clicking the one-click blockbuster control 211 , the electronic device may cancel displaying the search bar 213 and display all stored materials in the material browsing interface 206 .
[0193] Continue as Figure 14 As shown, after generating a video work, the electronic device displays a preview interface 602 (e.g., a second interface). Preview interface 602 displays a video work 603 (e.g., first video data). Video work 603 is the currently created video work, i.e., video data generated according to target template 1 (or first template). Video work 603 includes the user-selected material (e.g., first material), music corresponding to the first template, special effects, etc. Exemplarily, preview interface 602 includes a control 604 indicating a save action. In response to the user clicking control 604, video work 603 is saved.
[0194] In some embodiments, while the preview interface 602 is displayed, the user can also indicate to select the target template 2 to trigger the electronic device to re-produce the video work based on the target template 2.
[0195] like Figure 15 As shown, the electronic device displays a preview interface 602. The preview interface 602 includes a video work 603. In addition, the preview interface 602 also includes a play control bar 1501. For example, the electronic device can play the video work 603 in response to the user's operation in the play control bar 1501.
[0196] In some embodiments, the preview interface 602 further includes a template change control 1502 (first control).
[0197] like Figure 15 As shown, the electronic device determines target template 2 from multiple candidate templates in response to the user's operation on the template replacement control 1502. Target template 2 is different from target template 1.
[0198] Then, based on target template 2 and the user-selected material, video work 1505 (second video data) is generated. For example, the video data generated according to target template 2 (or second template) includes the user-selected material (e.g., first material), the music corresponding to the second template, special effects, etc. Accordingly, the electronic device can display video work 1505 on preview interface 602. Video work 603 and video work 1505 are video works created based on different video templates and the same material. In this scenario, the electronic device plays video work 1505 in response to the user's operation on playback control bar 1501.
[0199] In addition, in response to the user's operation on the template change control 1502, the electronic device may also display a template box 1503 (a second pop-up box). The template box 1503 displays a template identifier of a video template with at least one selected tag (hereinafter referred to as the selected template), such as a template cover image. In other embodiments, the electronic device may also display template identifiers of other video templates in the template box 1503 in response to the user's operation.
[0200] If target template 2 is template 1504, after displaying video work 1505 on preview interface 602, the electronic device may further mark the template identifier (e.g., the first identifier) of template 1504 as selected in template box 1503. In template box 1503, the template identifier (e.g., the second identifier) of the other video template (the third template) is unselected.
[0201] The first identifier of the above template 1504 is marked as selected, which can prompt the user that the currently displayed video work 1505 is generated based on template 1504. If the user is not satisfied with the current video work 1505, he or she can also select a new video template on the template box 1503 to trigger the generation of a new video work.
[0202] In the case where there are multiple templates to be selected, the multiple templates to be selected are arranged in a tiled manner from left to right in the template frame 1503. If the template frame 1503 cannot display all the templates to be selected, some of the templates to be selected can be hidden. For example, the templates to be selected on the right can be hidden.
[0203] In an exemplary scenario, when the multiple templates to be selected include a first-category video template, a second-category video template, and a third-category video template, the first-category video template is arranged before the second-category video template and the third-category video template, and the second-category video template is arranged before the third-category video template.
[0204] like Figure 16 As shown, the selected tags include tag A, tag B, and tag C. The multiple templates to be selected include video template 1601 having "tag A+tag B+tag C", such as template 1601-1, template 1601-2, and template 1601-2.
[0205] The plurality of templates to be selected further include a video template 1602 having “label A+label B”, such as template 1602 - 1 , template 1602 - 2 , and template 1602 - 3 .
[0206] The plurality of templates to be selected further include a template 1603 - 1 having a “label A”, a template 1603 - 2 having a “label B”, and a template 1603 - 3 having a “label C”.
[0207] The video template 1601 is a first-category video template, the video template 1602 is a second-category video template, and the templates 1603-1, 1603-2, and 1603-3 are third-category video templates.
[0208] like Figure 16 As shown, in the template frame 1503, the above video template 1601 is arranged before the video template 1602, and the video template 1602 is arranged before the template 1603-1, template 1603-2 and template 1603-3. In the case that the template frame 1503 can only display four templates to be selected at the same time, the video templates arranged on the left are displayed first, for example, template 1601-1, template 1601-2, template 1601-2 and template 1602-1 are displayed, and template 1602-2, template 1602-3, template 1603-1, template 1603-2 and template 1603-3 are hidden. Figure 16In the figure, a dotted frame is used to mark the hidden template to be selected.
[0209] It is understandable that the electronic device can display the hidden templates to be selected one by one in response to the user's left swipe operation relative to the template to be selected for the user to select.
[0210] In another exemplary scenario, when the multiple templates to be selected include the second type of video template and the third type of video template, the second type of video template is arranged before the third type of video template.
[0211] In another exemplary scenario, when the plurality of templates to be selected are all third-category video data determined based on the selected tags, the plurality of templates to be selected are displayed in groups according to the corresponding selected tags, wherein the templates to be selected in the same group have different corresponding selected tags.
[0212] like Figure 17 As shown, the templates to be selected include a video template 1701 with label A, a video template 1702 with label B, and a video template 1703 with label C.
[0213] The video template 1701 includes template 1701-1, template 1701-2 and template 1701-3; the video template 1702 includes template 1702-1, template 1702-2 and template 1702-3; and the video template 1703 includes template 1703-1, template 1703-2 and template 1703-3.
[0214] The electronic device may group template 1701-1, template 1702-1, and template 1703-1 into one group. The electronic device may also group template 1701-2, template 1702-2, and template 1703-2 into one group. The electronic device may also group template 1701-3, template 1702-3, and template 1703-3 into one group. Figure 17 As described above, in the template frame 1503, each group of templates to be selected is arranged in sequence.
[0215] The present application also provides an electronic device. The electronic device can perform the methods described in the preceding embodiments. The electronic device may include a memory and one or more processors. The memory and processor are coupled. The memory is used to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device can perform the steps described in the preceding embodiments. Of course, the electronic device includes, but is not limited to, the memory and one or more processors described above.
[0216] The present application also provides a chip system that can be applied to the electronic device in the aforementioned embodiment. The chip system includes at least one processor and at least one interface circuit. The processor can be the processor in the aforementioned electronic device. The processor and the interface circuit can be interconnected via a line. The processor can receive and execute computer instructions from the memory of the aforementioned electronic device via the interface circuit. When the computer instructions are executed by the processor, the electronic device can perform the various steps in the aforementioned embodiment. Of course, the chip system can also include other discrete components, which are not specifically limited in the present application.
[0217] In some embodiments, through the description of the above embodiments, those skilled in the art can clearly understand that for the convenience and brevity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment and will not be repeated here.
[0218] The functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0219] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk.
[0220] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present invention should be included in the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.
Claims
1. A method for generating video data, characterized in that: The method comprises: Displaying a first interface, wherein the first interface includes a plurality of materials, and the plurality of materials includes a first material; In response to a first operation of the user on the first material, displaying one or more tags, wherein the one or more tags include a tag associated with the first material; In response to a user operation on a first tag among the one or more tags, marking the first tag as selected; After detecting the second operation of the user instructing to create a video, a second interface is displayed, which includes first video data. The first video data includes the first material, special effects from the first template, and music from the first template. The first template corresponds to at least one of the first tags.
2. The method according to claim 1, characterized in that The first interface includes a first pop-up window. After displaying the first interface, the method further includes: In response to a first operation of the user on the first material, displaying a thumbnail of the first material in the first pop-up window; The displaying of one or more tags includes: displaying the one or more tags in the first pop-up box.
3. The method according to claim 2, characterized in that The multiple materials further include a second material. After displaying the one or more tags in the first pop-up window, the method further includes: In response to the user's third operation on the second material, a thumbnail of the second material is newly displayed in the first pop-up box, and the one or more tags displayed in the first pop-up box are updated.
4. The method according to claim 3, characterized in that The updating of the one or more labels displayed in the first pop-up box in response to the user's third operation on the second material includes: A second label is newly displayed in the first pop-up box, and the second label is associated with the second material.
5. The method according to any one of claims 1 to 4, characterized in that The first interface includes a search bar. After displaying the first interface, the method further includes: In response to a user input operation, displaying the keyword input by the user in the search bar; Updating the plurality of materials displayed on the first interface; After the material is updated, all materials displayed in the first interface match the keyword; and the materials matching the keyword include the first material.
6. The method according to any one of claims 1 to 5, characterized in that The first tag includes a first target tag and a second target tag, and in response to a user operation on a first tag among the one or more tags, marking the first tag as selected includes: In response to the user clicking the first target tag, marking the first target tag as selected; In response to the user clicking the second target tag, marking the second target tag as selected.
7. The method according to claim 6, characterized in that Before marking the second target tag as selected in response to the user clicking the second target tag, the method further includes: In response to the user clicking the first target tab, the one or more displayed tabs are updated.
8. The method according to claim 7, characterized in that The first target tag and the third tag among the one or more tags are tags indicating a template style; The updating of the one or more displayed labels includes: In response to the user clicking the first target label, the third label is canceled from being displayed.
9. The method according to claim 8, characterized in that The updating of the one or more displayed labels further comprises: If the first target tag is a tag of the template style, a fourth tag is displayed, where the fourth tag indicates a tag of the music type in the video template, and the fourth tag matches the first target tag.
10. The method according to any one of claims 1 to 9, characterized in that The first tag includes a first target tag, a second target tag, and a third target tag; If the preconfigured video template includes a first target template, the first template is a video template determined from the first target template, and the first target template includes the first target tag, the second target tag, and the third target tag; If the preconfigured video template includes a second target template, a third target template, and a fourth target template, but does not include the first target template, the first template is a video template determined from the second target template, the third target template, and the fourth target template; The second target template includes both the first target label and the second target label, but does not include the third target label; the third target template includes both the first target label and the third target label, but does not include the second target label; the fourth target template includes both the second target label and the third target label, but does not include the first target label; If the preconfigured video template includes the fifth target template, the sixth target template and the seventh target template, but does not include the first target template, the second target template, the third target template and the fourth target template, the first template is a video template determined from the fifth target template, the sixth target template and the seventh target template; the fifth target template includes the first target tag, but does not include the second target tag and the third target tag; the sixth target template includes the second target tag, but does not include the first target tag and the third target tag; and the seventh target template includes the third target tag, but does not include the second target tag and the first target tag.
11. The method according to claim 10, characterized in that If the preconfigured video template includes a second target template, a third target template and a fourth target template, the first target tag and the second target tag are different tags of the same type, and the third target tag and the first target tag are tags of different types, the probability of the first template being selected from the third target template or the fourth target template is higher than the probability of being selected from the second target template.
12. The method according to claims 1-11, characterized in that The second interface includes a first control, and the method further includes: detecting that a user clicks on the first control; In response to the user clicking the first control, second video data is displayed on the second interface, the second video data includes the first material, special effects from the second template and music from the second video template, the second template has a corresponding relationship with at least one of the first tags, and the second template is different from the first template.
13. The method according to claim 12, characterized in that After detecting that the user clicks the first control, the method further includes: A second pop-up box is displayed, which includes the first identifier of the second template; wherein the first identifier is in a selected state, and the second pop-up box also includes the second identifier of the third template, and the second identifier is in an unselected state, and the third template has a corresponding relationship with at least one of the first labels.
14. The method according to claim 1, wherein The first interface includes a first pop-up window, and the one or more tags include a first-category tag, a second-category tag, and a third-category tag; the first-category tag is a tag indicating the style of the video template; the second-category tag is a tag indicating the type of music in the video template; and the third-category tag is a tag indicating the type of theme in the video template; The first type of labels are arranged in the first row area of the first pop-up box; The second type of labels are arranged in the second row area of the first pop-up frame; The third type of tags are arranged in the third row area of the first pop-up box.
15. The method according to claim 1, wherein The one or more tags further include a first commonly used tag and a second commonly used tag; the first commonly used tag is the tag with the highest selection frequency among the tags of the first category; the second commonly used tag is the tag with the highest selection frequency among the tags of the second category; The first type of tags are tags indicating the style of the video template, and the second type of tags are tags indicating the type of music in the video template; On the first date, the one or more tags further include an operation tag, and the operation tag is used to indicate a video template that is exclusive to the first date.
16. The method according to claim 15, characterized in that The first interface includes a first pop-up box, and the one or more tags are arranged in order from left to right in the first pop-up box. The operation tag is arranged before the first commonly used tag and the second commonly used tag, and the tag associated with the first material is arranged after the first commonly used tag and the second commonly used tag; among the tags associated with the first material, the first category tags and the second category tags are arranged alternately.
17. An electronic device comprising a memory, a processor, and a computer program stored in the memory, wherein: The processor executes the computer program to implement the steps of the method according to any one of claims 1 to 16.
18. A computer-readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.
19. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 16 are implemented.