Video production method and electronic equipment
Patent Information
- Application Number
- CN202480004679.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-10-27
- Filing Date
- 2024-01-10
- Publication Date
- 2025-06-27
AI Technical Summary
The video production process provided by existing electronic devices is relatively cumbersome and has poor user experience.
By providing a conversation page in the voice assistant application of electronic devices, users can be guided to gradually complete video production. The page includes a prompt box for video generation, an image collection item and a video generation control. Users can generate videos through these controls and display a preview prompt window for videos on the page. At the same time, a text editing window and an audio input window are provided, and users can add text and audio content to the video.
It simplifies the video production process, reduces the difficulty of user operations, improves the user experience, and allows users who have no experience in video production to easily create videos.
Smart Images

Figure CN120226368A_ABST
Abstract
Description
Video production method and electronic equipment
[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on October 27, 2023, with application number 202311418278.6 and invention name “A video production method and electronic equipment based on large models”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The embodiments of the present application relate to the field of terminal technology, and in particular to a video production method and electronic device. Background Art
[0003] Electronic devices often have camera functions to meet users' photography needs. Users can use these devices to capture images, documenting their lives through captured images. To provide better user services, electronic devices may also offer video production capabilities through video production software. For example, video production software can combine user-selected images into a video.
[0004] However, the video production process currently provided by electronic devices is relatively cumbersome and the user experience is poor.
[0005] Summary of the Invention
[0006] The present application provides a video production method and electronic device for simplifying the video production process and improving user experience.
[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0008] In a first aspect, a video production method is provided, comprising: displaying a conversation page of a voice assistant application, the conversation page including a prompt box for video generation, the prompt box including at least one image collection item and a video generation control, the at least one image collection item being used to provide at least one image, and the video generation control being used to generate a video. In response to a user operation on the video generation control, a first video is generated based on the at least one image, and a preview prompt window for the first video is displayed on the conversation page of the voice assistant application. After displaying the preview prompt window for the first video, a video addition card is further displayed on the conversation page, the video addition card including a first control. If a user operation on the first control is received, a text editing window is displayed on the conversation page in response to the user operation on the first control. The text content in the text editing window is obtained, and a second video is further generated based on the text content and the first video, and a preview prompt window for the second video is displayed on the conversation page.
[0009] In this way, the electronic device's voice assistant can provide video creation guidance through a dialogue interface, guiding users step by step through the video creation process. Even users without video creation experience can use the voice assistant to create videos, reducing the user's operational difficulty. In addition, users can add text content to the videos they create, making them more tailored to their needs and enhancing the user experience.
[0010] In one possible implementation of the first aspect, the text editing window includes a recommendation, where the recommendation is generated based on the theme of the first video. In this way, the electronic device can proactively provide the user with text content added to the video, saving the user time in entering text content in the text editing window.
[0011] In another possible implementation of the first aspect, the text editing window further includes a change option, and the electronic device updates the recommendation in the text editing window in response to a user operation on the change option. In this way, the user can select a satisfactory recommendation in the text editing window, thereby improving the user experience.
[0012] In another possible implementation of the first aspect, in response to a user editing operation on a recommendation in a text editing window, the electronic device changes the recommendation, obtains the changed text content, and further obtains the changed text content in the text editing window. In this way, if the user is dissatisfied with the recommendation in the text editing window, they can also edit the text content added to the video, further improving the user experience.
[0013] In another possible implementation of the first aspect, the electronic device further provides a production template for video production. When generating a second video based on text content and a first video, the electronic device obtains a first production template, which is used to provide a video display style. The first production template is further synthesized with the text content to generate a third video, which includes the text content. The third video is then synthesized with the first video to generate the second video. In this way, a video with a specific display style can be provided to the user.
[0014] In another possible implementation of the first aspect, the video add card further includes a second control. Upon receiving a user operation on the second control, an audio input window is displayed on the conversation page in response to the user operation on the second control. The audio input window is configured to provide a recording function and includes a record function key. In response to the user operation on the record function key, audio content is acquired, a fourth video is generated based on the audio content and the first video, and a preview window for the fourth video is displayed on the conversation page.
[0015] In this way, the voice assistant of the electronic device also provides a way to add audio content. Users can add audio content to the produced video, so that the produced video meets user needs and improves user experience.
[0016] In another possible implementation of the first aspect, the audio input window further includes a text conversion area for providing text corresponding to the audio content. In this way, the video produced by the electronic device includes not only the audio content but also the text corresponding to the audio content.
[0017] In another possible implementation of the first aspect, in response to a user's editing operation on the text corresponding to the audio content, the electronic device changes the text corresponding to the audio content to obtain the changed text corresponding to the audio content. In this way, if the user is not satisfied with the text corresponding to the audio content, they can also enter the text corresponding to the audio content through the editing operation, further improving the user experience.
[0018] In another possible implementation of the first aspect, the electronic device obtains the second production template, synthesizes the audio content and the second production template, and generates a fifth video. The fifth video includes the audio content and text corresponding to the audio content. The electronic device further synthesizes the fifth video with the first video to generate a fourth video. In this manner, a video with a specific display style can be provided to the user.
[0019] In another possible implementation of the first aspect, the video add card further includes a third control. Upon receiving a user operation on the third control, a video capture window is displayed in response to the user operation on the third control. The video capture window is configured to provide a video capture function and includes a capture function key. In response to the user operation on the capture function key, video content is acquired, a sixth video is generated based on the video content and the first video, and a preview window of the sixth video is displayed on the conversation page.
[0020] In this way, the voice assistant of the electronic device also provides a way to add video content. Users can add video content to the produced video, so that the produced video meets user needs and improves user experience.
[0021] In another possible implementation of the first aspect, the video content includes text corresponding to the video data. In response to a user operating a capture button, the electronic device records the video content. After the video content is captured, the electronic device displays a video preview page for the video content, which includes a Done button. In response to the user operating the Done button, the electronic device retrieves the video content.
[0022] In this way, the sixth video presented to the user by the electronic device not only provides the collected video data, but also includes text corresponding to the video data, thereby improving the user experience.
[0023] In another possible implementation of the first aspect, the electronic device records at least one reminder event, which includes an event date and an event subject. Within a preset time period before the reminder date, a video creation recommendation card is provided on the desktop interface, where the recommendation card provides a quick access to the conversation page. In this way, when the electronic device predicts that a user has a need to create a video, the recommendation card can be displayed on the desktop interface, providing the user with a quick access to the voice assistant's video creation function.
[0024] In another possible implementation of the first aspect, the reminder event is any one of a birthday, an anniversary, and a holiday. The electronic device can provide a video production process corresponding to a blessing event such as a birthday, an anniversary, or a holiday, such as creating a birthday blessing video.
[0025] In another possible implementation of the first aspect, the electronic device, in response to a user operation on a recommendation card or a received voice command, accesses a conversation page of a voice assistant application, wherein the at least one image collection item is associated with an event theme, and the event theme is included in the recommendation card or voice command. In this manner, the electronic device can access the conversation page of the voice assistant application through the recommendation card or voice command, providing convenience for the user.
[0026] In a second aspect, the present application provides an electronic device comprising: a memory and one or more processors. The memory stores computer program code, the computer program code comprising computer instructions, which, when executed by the processor, causes the electronic device to perform the method described in the first aspect and any possible implementation thereof.
[0027] In a third aspect, the present application provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method described in the first aspect and any possible implementation thereof.
[0028] In a fourth aspect, the present application provides a computer program product comprising program instructions, which, when executed on a computer, enables the computer to execute the method described in the first aspect and any possible implementation thereof. For example, the computer may be the electronic device described above.
[0029] In a fifth aspect, the present application provides a chip system, which is applied to an electronic device. The chip system includes an interface circuit and a processor. The interface circuit and the processor are interconnected via a circuit. The interface circuit is configured to receive signals from a memory and send signals to the processor, the signals including computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device executes the method described in the first aspect and any possible implementation thereof. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] FIG1 is a schematic diagram of a video software interface provided in an embodiment of the present application;
[0031] FIG2 is a hardware structure block diagram of a mobile phone 100, an example of an electronic device provided in an embodiment of the present application;
[0032] FIG3 is a schematic diagram of a video production method provided in an embodiment of the present application;
[0033] FIG4 is a schematic diagram of a conversation page for entering a voice assistant provided in an embodiment of the present application;
[0034] FIG5 is a schematic diagram of a video adding card provided on a conversation page according to an embodiment of the present application;
[0035] FIG6 is a schematic diagram of a video production process in a text adding mode provided in an embodiment of the present application;
[0036] FIG7 is a schematic diagram of a video production process in an audio adding mode provided in an embodiment of the present application;
[0037] FIG8 is a schematic diagram of a video production process of a video adding mode provided in an embodiment of the present application. DETAILED DESCRIPTION
[0038] To better provide services to users, electronic devices may provide a video production function. For example, the electronic device may be installed with third-party video production software, which may provide a video production function. Users may use the video production software to create videos.
[0039] However, the video production process currently provided by electronic devices is relatively cumbersome. For example, in the interface of the video production software shown in Figure 1, multiple function keys are provided, and different function keys correspond to different pattern logos. The video production software can execute the functions corresponding to the function keys according to the user's touch operation at the function keys, such as executing video cropping, changing filters, etc. This requires the user to understand how to use the video production software and the functions corresponding to each function key. If the user does not understand how to use the video production software or the functions corresponding to the function keys in the video production software, it will be difficult for the user to operate the video production software, and the user experience will be poor.
[0040] In view of this, an embodiment of the present application provides a convenient and intelligent video production method, which can provide a video production solution for a specific scene in a conversational manner through the voice assistant of an electronic device (i.e., a voice assistant application). Specifically, the electronic device displays a conversation page of the voice assistant, which includes a prompt box for video generation, and the prompt box includes a video generation control. In response to the user operation of the user clicking the video generation control, the electronic device generates a first video and displays a preview prompt window of the first video in the conversation page of the voice assistant. After displaying the preview prompt window of the first video, the electronic device displays a video addition card in the conversation page of the voice assistant. The video addition card includes a control for at least one content addition mode for the user to select from at least one content addition mode of the video. Furthermore, if the electronic device receives a user operation of the user clicking a control for a content addition mode, such as receiving a user operation of the user clicking a first control for a text addition mode, a content input window corresponding to a content addition mode, such as a text editing window, is displayed in the conversation page. The content input window is used to prompt the user to enter additional content, so that the user can enter additional content according to the prompt. If the electronic device obtains the added content, it further generates a second video based on the added content and the first video, and displays a preview prompt window of the second video on the conversation page.
[0041] In this way, the electronic device's voice assistant can provide video production guidance services in a conversational manner, guiding users step by step to complete video production. Even for users without video production experience, they can use the voice assistant to complete video production, reducing the user's operational difficulty and improving the user experience.
[0042] It's understood that voice assistants, or voice assistant functionality, are functions provided by intelligent applications within electronic devices. Voice assistants can recognize user voice commands and execute corresponding actions, such as conducting voice conversations and instant Q&A. Voice assistants can reduce user reliance on input devices like keyboards and mice, providing a more convenient way for users to interact.
[0043] For example, the electronic devices described in the embodiments of the present application may be mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, personal digital assistants (PDAs), augmented reality (AR) and virtual reality (VR) devices, media players, wearable devices, and the like. The embodiments of the present application do not impose any particular restrictions on the specific form of the electronic devices.
[0044] In the embodiment of the present application, the electronic device is a mobile phone 100 as an example, and the hardware structure of the electronic device is described through the mobile phone 100. As shown in Figure 2, the mobile phone 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195.
[0045] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), a driver processor, etc. Different processing units may be independent devices or integrated into one or more processors. The processor 110 may be the nerve center and command center of the mobile phone 100. The processor 110 may generate an operation control signal based on the instruction opcode and timing signal to complete the control of instruction fetching and execution.
[0046] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly retrieve it from the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.
[0047] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage. For example, the mobile phone 100 can save a video created using a voice assistant to the external memory card.
[0048] The internal memory 121 can be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the mobile phone 100 by running the instructions stored in the internal memory 121. For example, in an embodiment of the present application, the processor 110 can execute instructions stored in the internal memory 121, and the internal memory 121 can include a program storage area and a data storage area.
[0049] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. While charging the battery 142, the charging management module 140 can also provide power to the mobile phone 100 through the power management module 141.
[0050] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. In some embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.
[0051] The wireless communication functionality of mobile phone 100 may be implemented via antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, a modem processor, and a baseband processor. In some embodiments, antenna 1 of mobile phone 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling mobile phone 100 to communicate with a network and other devices via wireless communication technologies. For example, mobile phone 100 may transmit a completed video to other electronic devices via mobile communication module 150 or wireless communication module 160.
[0052] The mobile phone 100 can implement audio functions such as music playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0053] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and is also used to convert input analog audio signals into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.
[0054] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. For example, the mobile phone 100 can play music, video audio, or play hands-free call voice through the speaker 170A.
[0055] The receiver 170B, also called the "earpiece", is used to convert audio electrical signals into sound signals. When the mobile phone 100 receives a call or a voice message, the voice can be heard by placing the receiver 170B close to the ear.
[0056] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The mobile phone 100 can be provided with at least one microphone 170C. In other embodiments, the mobile phone 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the mobile phone 100 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, and directional recording functions. For example, the mobile phone can collect voice data input by the user through the microphone 170C, and use the voice data to make a video.
[0057] The sensor module 180 may include a pressure sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a Hall sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc. The mobile phone 100 may collect various data through the sensor module 180 .
[0058] Mobile phone 100 implements display functionality through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.
[0059] The display screen 194 is used to display images, videos, etc. The display screen 194 can also be called a screen. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. For example, the mobile phone 100 displays a desktop interface, a voice assistant conversation page, etc. through the display screen 194.
[0060] In some implementations, the touch sensor can be disposed within the display screen 194 , with the touch sensor and display panel forming a touch screen, also known as a "touch screen." The touch sensor, also known as a "touch panel," is configured to detect touch operations, such as clicks and slides, applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to an application processor to determine the type of touch event. The mobile phone 100 can provide visual output related to the touch operations via the display screen 194 .
[0061] The mobile phone 100 implements a camera function through an ISP, a camera 193, a video codec, a GPU, a display 194, and an application processor. The ISP processes data fed back by the camera 193. The camera 193 is used to capture still images or videos. In some embodiments, the mobile phone 100 may include one or more cameras 193. For example, the camera 193 may include a front-facing camera. The mobile phone 100 can use a voice assistant to call a camera application to open the front-facing camera, which then provides footage for video production.
[0062] It is to be understood that the interface connection relationship between the modules illustrated in this embodiment is merely a schematic illustration and does not constitute a structural limitation on the electronic device. In other embodiments, the electronic device may include more or fewer modules than those provided in the above embodiments, and the modules may also adopt different interface connection methods from those in the above embodiments, or a combination of multiple interface connection methods. The hardware structure of the electronic device provided in the embodiments of the present application can refer to the hardware structure of the mobile phone 100. The methods in the following embodiments can all be implemented in an electronic device having the above hardware structure.
[0063] The method provided in the embodiment of the present application can provide a video production solution for specific scenarios, such as providing a video production solution for blessing scenarios such as birthdays, anniversaries, and holidays. Of course, the method provided in the embodiment of the present application can also be applied to other non-blessing scenarios, and the embodiment of the present application does not limit the application scenarios of video production.
[0064] The following describes the method provided by the embodiment of the present application, taking the electronic device as a mobile phone 100 as an example. As shown in FIG3 , the method provided by the embodiment of the present application includes the following steps:
[0065] S301, the mobile phone 100 displays the conversation page of the voice assistant.
[0066] Mobile phone 100 is equipped with a voice assistant. The voice assistant has a new video production function. Mobile phone 100 can display a dialogue page of the voice assistant in the interface, thereby providing guidance prompts for video production through dialogue, so that users can operate mobile phone 100 step by step to create a video according to the guidance prompts.
[0067] In some implementations, the mobile phone 100 enters a video creation dialog page in response to a user operation or voice command. For example, the mobile phone 100 desktop interface includes a recommendation card for the video creation function. If the mobile phone 100 receives a user click on the recommendation card for the video creation function, the mobile phone 100 activates the voice assistant's video creation function and displays the voice assistant's dialog page. For another example, the mobile phone 100 receives a voice command, such as a voice command "Generate Qiuqiu's birthday video." In response to the voice command for video creation, the mobile phone activates the voice assistant's video creation function and displays the voice assistant's dialog page.
[0068] In one example, as shown in the interface 401 in Figure 4, the voice assistant function is turned on when the mobile phone 100 displays the desktop. The voice assistant icon is displayed at the bottom of the desktop. When the voice assistant is turned on, the mobile phone 100 collects voice commands through the microphone. As shown in the interface 402 in Figure 4, the mobile phone 100 collects the voice command "Generate Qiuqiu's birthday video" and displays a text prompt "Generate Qiuqiu's birthday video" above the voice assistant icon. As shown in the interface 403 in Figure 4, the mobile phone 100 responds to the voice command "Generate Qiuqiu's birthday video" and enters the voice assistant's dialogue page.
[0069] The voice assistant's conversation page provides an interface for real-time interaction between the phone 100 and the user. In response to user actions or voice commands, the phone 100 can display user-informed messages on the conversation page. The phone 100 can also display user-entered messages or text corresponding to voice commands on the conversation page. Messages displayed on the phone 100 can include text, images, links, widgets, and more. Messages displayed on the conversation page are arranged chronologically, with later messages below earlier ones. For example, in 403 of Figure 4 , the phone 100 display interface includes a conversation page displaying the text message "The following photo albums have been selected for you. Please select one!" Below this text message are icons for multiple image collections, such as a "Group Photo" icon, a "Photo Album" icon, and a "Birthdays Over the Years" icon. If the conversation page contains a large amount of content, the phone 100 can scroll through the conversation page to display previous messages under user control.
[0070] It is understandable that the voice assistant can provide users with a variety of functions, including the video production function provided in the embodiment of the present application. The display interface of the different functions of the voice assistant can be different. As shown in 403 in Figure 4, the interface of the voice assistant can also include functions such as "recommendation", "smart film", and "text creation". After the voice assistant receives the user's left and right sliding operation or voice instruction, it can switch to display the page corresponding to each function.
[0071] Exemplarily, different voice commands received by the mobile phone 100 may result in different displayed pages. For example, when the mobile phone 100 receives the voice command of "generate Qiuqiu's birthday video", it enters the dialogue page of the voice assistant. If the mobile phone 100 receives the voice command of "make a video", the mobile phone 100 responds to the voice command of "make a video" and enters the recommendation page corresponding to the "recommendation" function. The recommendation page may include recommendation cards for multiple video themes, such as recommendation cards for birthday wishes, recommendation cards for travel videos, etc. If the mobile phone 100 receives a recommendation card for birthday wishes selected by the user, the mobile phone 100 will display the dialogue page for video production in the interface.
[0072] To quickly enable the video creation function when a user needs to create a video, in some implementations, the mobile phone 100 can also predict the user's video creation behavior. When the mobile phone 100 predicts that the user has a need to create a video, it can display a recommendation card on the desktop interface. In this way, the mobile phone 100 can provide a quick access to the voice assistant's video creation function through this recommendation card, providing convenience for the user. If the mobile phone 100 receives a user action of clicking on the recommendation card, the mobile phone 100 will enter the voice assistant's dialogue page.
[0073] In this implementation, the mobile phone 100 records one or more reminder events, each of which includes an event date and event subject. This reminder event triggers the mobile phone 100 to display a video creation recommendation card on the desktop interface. In a greeting scenario, the reminder event could be a birthday, anniversary, holiday, or other event. The user is likely to request a video creation on or before the reminder event date. Therefore, the mobile phone 100 displays a video creation recommendation card on the desktop interface within a preset time period before the reminder event date.
[0074] For example, if the reminder event is a birthday event, the event date of the birthday event is "January 1st" and the event theme is "Qiuqiu's birthday." One week before January 1st (an example of a preset time period), the mobile phone 100 starts to display a video production recommendation card on the desktop interface.
[0075] Optionally, the recommendation card displayed by the mobile phone 100 in the desktop interface may also carry the event theme of the reminder event. For example, as shown in 404 in Figure 4, the recommendation card displayed by the mobile phone 100 on the desktop carries "Qiuqiu's Birthday" (an example of an event theme) and a "Create Video" control. The "Create Video" control is the entrance to the conversation page. If the mobile phone 100 receives a click operation at the "Create Video" of the recommendation card, the mobile phone 100 enters the conversation page of the voice assistant (as shown in 405 in Figure 4).
[0076] S302, the mobile phone 100 generates a first video based on at least one image in response to a user operation on a video generation control, and displays a preview prompt window of the first video in a conversation page of the voice assistant.
[0077] The conversation page displayed by the mobile phone 100 provides a prompt box 3011 for generating a video. The prompt box includes a video generation control. If the mobile phone 100 receives a user click operation on the video generation control in the prompt box of the conversation page, the mobile phone 100 generates a first video and outputs a preview prompt window 3021 of the first video in the conversation page of the voice assistant.
[0078] The first video is a video generated based on at least one image. For example, in response to the first operation, the mobile phone 100 performs video synthesis on the at least one image to obtain the first video, and outputs a preview prompt window of the first video in the conversation page of the voice assistant.
[0079] To generate a video that meets user needs, in some implementations, the prompt box displayed by the mobile phone 100 on the conversation page may include at least one image collection item associated with the event theme. Each image collection item corresponds to an image collection. Each image collection includes at least one image. Images in different image collections can be different, or different image collections can contain the same image. The mobile phone 100 can provide the user with at least one image to select from among the at least one image collection item for synthesizing the first video.
[0080] It can be understood that the image collection item associated with the event theme refers to the image collection item corresponding to the image collection associated with the event theme. For example, as shown in 501 in Figure 5, the mobile phone 100 displays the image collection items of "Group Photo", "Photo" and "Birthdays over the Years" in the prompt box of the conversation page. The image collection associated with the event theme has an image collection with a collection theme that is consistent or similar to the event theme, or an image collection with a collection theme that has the same keyword as the event theme. Each image collection can have a collection theme, so that the mobile phone 100 can quickly find an image collection of a specified theme (such as an event theme). For example, the mobile phone 100 can cluster the saved images (or material clustering), such as clustering the images according to the shooting time, shooting location, shooting object, etc. of the images to obtain at least one image collection, and set a collection theme for each image collection, such as setting a collection theme of "festival", "autumn", "travel", etc.
[0081] In this implementation, if the phone 100 displays a recommendation card on the desktop interface, and the recommendation card carries the event subject of the reminder event, the phone 100 enters the voice assistant's conversation page in response to a user action received on the recommendation card, and the phone 100 can obtain the event subject carried in the recommendation card. If the phone 100 enters the voice assistant's conversation page in response to a voice command, the phone 100 obtains the event subject from the voice command. For example, if the voice command is "Generate Qiuqiu's birthday video," the event subject is "Qiuqiu" or "Qiuqiu's birthday."
[0082] In one example, as shown at 404 in FIG. 4 , the mobile phone 100 displays a video creation recommendation card on the desktop interface. The recommendation card carries the event theme "Qiuqiu's Birthday." If the mobile phone 100 receives a click on the "Create Video" section of the recommendation card, the mobile phone 100 enters the voice assistant's conversation page (as shown at 405 in FIG. 4 ). A prompt box appears on the conversation page, which includes multiple image collection items: "Group Photo," "Photo Album," and "Previous Birthdays," as well as a "Generate Video" video generation control. The image collections corresponding to these image collection items are associated with the event theme "Qiuqiu's Birthday." As shown at 501 in FIG. 5 , if the mobile phone 100 receives a user click on the "Generate Video" video generation control, the mobile phone 100 performs a video synthesis on the images selected from the multiple image collection items: "Group Photo," "Photo Album," and "Previous Birthdays," generating a first video. After the video synthesis is complete, as shown at 503 in FIG. 5 , the mobile phone 100 may also display a text notification on the conversation page indicating that the video creation is complete, and a preview window 5031 of the first video may be displayed on the conversation page.
[0083] In the embodiment of the present application, the image selected by the mobile phone 100 from the at least one image collection item provided on the conversation page may not be the image that the user desires to be composed into the first video. To ensure that the first video meets the user's needs as much as possible, in some implementations, the mobile phone 100 may further determine at least one image to be used to create the first video based on the user's selection operation.
[0084] For example, as shown in 501 of FIG. 5 , an image collection item is displayed as a collection icon. If the mobile phone 100 receives a user operation on the collection icon of an image collection item, the mobile phone 100 pops up the image corresponding to the image collection item. For example, if the mobile phone 100 receives a user operation of clicking "Birthdays of Previous Years," the mobile phone 100 displays the image corresponding to the image collection item "Birthdays of Previous Years." The user can select an image from the image collection. In response to the user's operation of selecting an image from at least one image collection, the mobile phone 100 determines at least one image selected from the image collection "Birthdays of Previous Years."
[0085] In other examples, in addition to providing at least one image collection item on the conversation page, the mobile phone 100 may also provide a custom item corresponding to all images in the mobile phone 100. As shown in 501 of Figure 5 , if the mobile phone 100 receives a user click operation on the custom item, as shown in 502 of Figure 5 , the mobile phone 100 displays all images stored in the mobile phone 100, such as all images recorded in the gallery application. The user can select an image in the image application. In response to the user's selection operation on the image corresponding to the custom item, the mobile phone 100 determines the at least one selected image.
[0086] S303: The mobile phone 100 displays a video adding card in the conversation page. The video adding card includes at least one control corresponding to a content adding mode.
[0087] After the mobile phone 100 outputs the first video on the conversation page, it may further pop up a video add card 3031 on the conversation page, thereby automatically recommending various video content addition options to the user. Each content addition mode corresponds to a different video content addition option. In some implementations, the video add card includes a control corresponding to at least one of the following content addition modes: text addition mode, audio addition mode, and video addition mode. For ease of distinction, the control for the text addition mode may be referred to as the first control, the control for the audio addition mode may be referred to as the second control, and the control for the video addition mode may be referred to as the third control.
[0088] The text addition mode provides a solution for adding text to video content. Users can add text to videos based on their preferences or needs, such as adding text-based greetings.
[0089] The audio addition mode provides a solution for adding audio content to videos. Users can add audio to videos based on their preferences or needs, such as adding an audio greeting to a video.
[0090] The video adding mode provides a solution for adding video content. Users can add video clips to videos based on their preferences or needs, such as adding a blessing video to a video.
[0091] In some implementations, the controls corresponding to the content adding mode included in the video adding card displayed by the mobile phone 100 on the conversation page may vary depending on the event theme. For example, when the event theme is a blessing scene such as a birthday or anniversary, the video adding card popped up by the mobile phone 100 on the conversation page may include controls for text adding mode, audio adding mode, and video adding mode. For another example, when the event theme is a non-blessing scene such as travel, the video adding card popped up by the mobile phone 100 on the conversation page may include controls for text adding mode, but not controls for audio adding mode and video adding mode.
[0092] For example, let's take the event theme of birthday as an example. As shown in 501 of Figure 5, if the mobile phone 100 receives a click operation of the user clicking "Generate Video", it generates a first video based on at least one image in the "Group Photo" and "Photo" selected by the user, and displays a preview prompt window of the first video on the conversation page. Furthermore, the mobile phone 100 includes controls for three content adding modes, namely "Text Blessing" (corresponding to the first control of the text adding mode), "Audio Blessing" (corresponding to the second control of the audio adding mode), and "Video Blessing" (corresponding to the third control of the video adding mode), in the video adding card that pops up on the conversation page.
[0093] In some implementations, to better provide video production services to users and meet their diverse needs, the mobile phone 100 may display multiple video production settings at the bottom of the conversation page after displaying a preview prompt window of a video (such as the first video) on the conversation page. As shown in 503 in Figure 5, after displaying the preview prompt window of the first video, the mobile phone 100 displays an "add blessing" setting item, a "change template" setting item, a "change music" setting item, and a "adjust duration" setting item at the bottom of the conversation page.
[0094] The "add blessing" setting item is used to call out a video adding card. If the mobile phone 100 receives a click operation from the user at the location of the "add blessing" setting item, the mobile phone 100 displays the video adding card.
[0095] The "Change Template" setting item is used to provide a video production template. The video production template is used to provide the display style of the video, such as providing a background image for displaying added content. If the mobile phone 100 receives a user click operation at the location of the "Change Template" setting item, multiple production templates are displayed to the user. Each production template has a different display style. The display style may include color, pattern, text style, animation effect, etc. The user can select a production template from multiple production templates according to his or her preferences. The mobile phone 100 can synthesize a video based on the video production template. For example, when the mobile phone 100 performs video synthesis on at least one image to obtain a first video, the production template can be used to perform video synthesis on at least one image to obtain the first video. The animation effect of switching between different images in the first video is consistent with the animation effect provided by the production template.
[0096] The "Change Music" setting item is used to provide music for video production. If the mobile phone 100 receives a user click operation at the location of the "Change Music" setting item, multiple music files are displayed to the user. The user can select a music file from the multiple music files according to their own preferences as the background music for the video.
[0097] The "Adjust duration" setting item is used to adjust the duration of the video. If the mobile phone 100 receives a user click operation at the location of the "Adjust duration" setting item, a video duration setting window is displayed to the user. The user can set the duration of the video.
[0098] S304: If a user operation on the first control is received, the mobile phone 100 displays a text editing window on the conversation page in response to the user operation on the first control.
[0099] The user can select a control for any content adding mode in the video adding card. If the mobile phone 100 receives a click operation on a control for any content adding mode on the conversation page, a content input window corresponding to the content adding mode indicated by the click operation will pop up on the conversation page. For example, if the mobile phone 100 receives a user operation of clicking the first control in the video adding card, the mobile phone 100 will respond to the user operation by displaying a text editing window on the conversation page. The text editing window is used to prompt the user to enter text content.
[0100] It is understood that different content adding modes correspond to different content input windows. The content input window and the added content correspond to the content adding mode selected by the user. For example, if the user selected the text adding mode, the content input window is a text editing window, and the added content is text content. If the user selected the audio adding mode, the content input window is an audio input window, and the added content is audio content. If the user selected the video adding mode, the content input window is a video capture window, and the added content is video content.
[0101] S305: The mobile phone 100 obtains the text content in the text editing window.
[0102] The mobile phone 100 obtains the added content through the content input window corresponding to the content adding mode selected by the user. In the case where the content adding mode selected by the user is the text adding mode, the mobile phone 100 obtains the text content through the text editing window.
[0103] In some implementations, the added content acquired by the mobile phone 100 is collected based on user operations. For example, the mobile phone 100 acquires text content, audio content, or video content input by the user. In other implementations, the added content acquired by the mobile phone 100 is recommended by the mobile phone 100. For example, the mobile phone 100 may provide recommended added content for the user to select in the content input window, such as recommended text content, audio content, or video content. The mobile phone 100 may acquire the added content selected by the user through the content input window. For example, the mobile phone 100 may include a recommendation in the text editing window. Upon user confirmation, the mobile phone 100 may use the recommendation in the text editing window as the text content.
[0104] S306, the mobile phone 100 generates a second video based on the text content and the first video, and displays a preview prompt window of the second video in the conversation page.
[0105] After acquiring the text content, the mobile phone 100 adds the text content to the first video to generate a second video. Further, the mobile phone 100 outputs a preview prompt window 3061 of the second video in the conversation page for the user to watch the second video.
[0106] For example, the mobile phone 100 can convert the acquired text content into a video (or referred to as a third video), and further synthesize the third video and the first video to obtain a second video. For example, the third video can be spliced with the first video to obtain the second video. Furthermore, the mobile phone 100 displays a preview prompt window of the second video on the conversation page. If the mobile phone 100 receives a user operation of clicking on the preview prompt window of the second video, the mobile phone 100 plays the second video for the user to view the generated second video.
[0107] As described above, in order to better provide video production services to users and meet their diverse needs, the mobile phone 100 may display multiple video production settings at the bottom of the conversation page after displaying the video preview prompt window. In some implementations, after displaying the preview prompt window of the second video, the mobile phone 100 may also display an "Add a greeting" setting item, a "Change template" setting item, a "Change music" setting item, and a "Adjust duration" setting item at the bottom of the conversation page.
[0108] For example, when the mobile phone 100 generates a second video based on text content and a first video, it can use the production template provided by the "Change Template" setting item to synthesize the second video based on the added content and the first video. For example, when the mobile phone 100 generates a second video based on text content and a first video, it can add text content to the selected production template to generate a third video with the display style of the production template. Furthermore, the mobile phone 100 synthesizes the third video with the first video to obtain the second video.
[0109] In some examples, if mobile phone 100 receives a user operation selecting a production template, mobile phone 100 may use the user-selected production template to produce the second video. If mobile phone 100 does not receive a user operation selecting a production template, mobile phone 100 may use a default production template to produce the second video. The default production template is a production template pre-specified in mobile phone 100. Alternatively, the default production template is the production template used by mobile phone 100 in the previous video production.
[0110] In other examples, the phone 100 can automatically select an appropriate production template based on the event theme to create the second video. For example, if the event theme is "Qiuqiu's Birthday," the phone 100 can select production templates with feminine preferences, such as pink or purple. In this way, the phone 100 can automatically configure the appropriate production template for the video being produced, achieving intelligent video production and improving the user experience.
[0111] Optionally, when the mobile phone 100 generates the second video based on the text content and the first video, it can use the music file provided by the "Change Music" setting item as background music to synthesize the second video together with the text content and the first video.
[0112] In some examples, if mobile phone 100 receives a user operation to select music, mobile phone 100 can use the user-selected music file to create the second video. If mobile phone 100 does not receive a user operation to select music, mobile phone 100 can use a default music file to create the second video. The default creation template is a music file pre-specified in mobile phone 100. Alternatively, the default creation template is the music file used by mobile phone 100 in the previous video creation.
[0113] In other examples, the phone 100 can automatically select an appropriate music file based on the event theme to create the second video. For example, if the event theme is "Qiuqiu's Birthday," the phone 100 can select birthday-related music files such as "Happy Birthday." In this way, the phone 100 can automatically configure appropriate background music for the created video, realizing intelligent video production and improving the user experience of video production.
[0114] Optionally, when the mobile phone 100 generates the second video based on the added content and the first video, it can use the video duration provided by the "adjust duration" setting item to synthesize the second video with the duration set by the user.
[0115] In some examples, if the mobile phone 100 receives a user operation to set a duration, the mobile phone 100 may use the user-set duration to create the second video. If the mobile phone 100 does not receive a user operation to set a duration, the mobile phone 100 creates the second video with a default duration. The default duration is pre-set by the mobile phone 100. Alternatively, the default duration is the duration used by the mobile phone 100 when creating a video last time.
[0116] In other examples, the mobile phone 100 can automatically set an appropriate duration for a produced video. For example, one image corresponds to a unit duration, such as 1 second, 2 seconds, and so on. For example, if the unit duration is 2 seconds and a video includes 10 images, the mobile phone 100 will set a duration of 10 seconds for the video. In this way, the mobile phone 100 can automatically set an appropriate duration for produced videos, achieving intelligent video production and improving the user experience of video production.
[0117] In other examples, if the mobile phone 100 receives a user click operation at the location of the "Add Blessing" setting item, the mobile phone 100 can display the video adding card again for the user to select from at least one content adding mode provided by the video adding card.
[0118] The method provided in the embodiment of the present application can provide guidance prompts for video production in a dialogue manner through the voice assistant, so that users can create videos according to the prompts output by the voice assistant in the dialogue page, reducing the difficulty of video production. In addition, the voice assistant also provides multiple content addition modes. The mobile phone 100 can add additional content corresponding to any content addition mode to the video under user control, meeting the user's diverse needs for video production and improving the user experience.
[0119] The following introduces the video production processes corresponding to the text adding mode, audio adding mode and video adding mode respectively.
[0120] In one implementation, taking the first control in which the user selects the text adding mode as an example, the video production process corresponding to the text adding mode is introduced in combination with a blessing scene.
[0121] As shown in Figure 6, the mobile phone 100 receives a click on the "Text Blessing" (an example of a first control) provided on the conversation page. In response to the user's click on the "Text Blessing" button, a "Text Blessing" bubble appears on the right side of the conversation page. Below the "Text Blessing" bubble, a bubble stating "A text blessing has been automatically generated for you. You can also click on the text to manually edit it" and a text editing window appear. The text editing window prompts the user to enter text content to be added to the video. After obtaining the text content in the text editing window, if the mobile phone 100 receives a click on the "Confirm" position in the text editing window, the mobile phone 100 generates a second video based on the text content and the first video. For example, the mobile phone 100 adds the text content to the first production template (an example of a production template) of the video to generate a third video. Furthermore, the mobile phone 100 splices the third video before the first video to generate the second video. The second video displays the text content at the beginning of the video. Furthermore, the mobile phone 100 displays a bubble stating "A text blessing has been added to the video" and a preview window 601 of the second video on the conversation page. The user can click on the preview prompt window of the second video to view the produced second video.
[0122] In this example, the user can input text in the content output window as text content added to the first video. The mobile phone 100 can obtain the text content input by the user in the text editing window.
[0123] Optionally, to provide users with a more convenient video production process, the mobile phone 100 can also automatically include a recommendation in the text editing window. For example, as shown in Figure 6, the mobile phone 100 includes the recommendation "Qiuqiu, happy birthday to you!" in the text editing window. If the mobile phone 100 receives a user click at the "Confirm" position in the text editing window, the mobile phone will use the recommendation in the text editing window as the text content. In this way, the mobile phone 100 can proactively provide users with text content to add to the video, saving users the time of entering text content in the text editing window.
[0124] In this example, as shown in FIG6 , if the mobile phone 100 receives a click operation from the user at the recommended word position in the text editing window, the mobile phone displays a keyboard control in the conversation page and obtains the text content input by the user through the keyboard control.
[0125] Optionally, the text editing window is also provided with a replacement option. If the mobile phone 100 receives a user operation to change the option, such as a click operation to change the option, it indicates that the mobile phone 100 has received a user operation to change the recommendation in the text editing window. In response to the third operation, the mobile phone 100 updates the recommendation in the text editing window. For example, as shown in FIG6 , “Change” (an example of a replacement option) is provided at the bottom of the text editing window. If the mobile phone 100 receives a click operation from the user at the “Change” position, the mobile phone 100 will change the first recommendation displayed in the text editing window “Qiuqiu, happy birthday to you!” to “Qiuqiu, I will always be by your side from now on and spend every birthday with you!”.
[0126] In this example, the recommendation displayed in the text editing window may be generated based on the video theme of the first video. The video theme of the first video is consistent with the aforementioned event theme. Alternatively, the first video may not be generated based on the recommended event. In this case, the video theme of the first video may be the video title.
[0127] For example, mobile phone 100 is configured with a recommendation model for generating recommendation phrases. This recommendation model can be a trained machine learning model. Mobile phone 100 can input the video theme of the first video into the recommendation model to obtain at least one recommendation phrase output by the recommendation model, such as 10 recommendation phrases output by the recommendation model. Mobile phone 100 can display any recommendation phrase generated by the recommendation model in a text editing window.
[0128] In another implementation, taking the second control in which the user selects the audio adding mode as an example, the video production process corresponding to the audio adding mode is introduced in combination with the blessing scene.
[0129] As shown in Figure 7, the mobile phone 100 receives a click on the "Audio Blessing" button on the conversation page. In response to the user's click on the "Audio Blessing" button, the mobile phone 100 displays an "Audio Blessing" bubble and an audio input window on the conversation page. The audio input window provides a recording function. Before recording begins, the audio input window features a record button. If the mobile phone 100 receives a click on the record button, the mobile phone 100 activates the microphone's recording function and captures the user's voice data through the microphone. This voice data is then used as the audio content. During recording, the record button in the audio input window becomes a recording completion button. If the mobile phone 100 receives a click on the recording completion button, the mobile phone 100 deactivates the microphone's recording function. After recording is complete, the audio input window features an OK button. If the mobile phone 100 receives a click on the OK button in the audio input window, the mobile phone 100 displays an "Audio Recording Completed" bubble in the conversation window and generates a fourth video based on the audio content and the first video. For example, the mobile phone 100 synthesizes the audio content and the second production template (an example of a production template) to generate a fifth video. Further, the mobile phone 100 splices the fifth video before the first video to obtain a fourth video. The fourth video provides audio content at the beginning of the video. Furthermore, the mobile phone 100 displays a bubble saying "Audio blessing has been added to the video" and a preview prompt window 701 of the fourth video on the conversation page. The user can click on the preview prompt window 701 of the fourth video to view the produced fourth video.
[0130] Optionally, a pause button is provided in the audio input window. This pause button is used to pause the recording of audio content. If, during recording, the mobile phone 100 receives a user click at the pause button location in the audio input window, the mobile phone 100, in response to the click, pauses the capture of audio content via the microphone. This allows the user to temporarily pause the recording of audio content. In some examples, after recording is completed, the mobile phone 100 can remove the pause button from the audio input window.
[0131] Optionally, an audition function key is further provided in the audio input window. The audition function key is used to provide an audition function for the audio content. For example, after the recording is completed, the mobile phone 100 cancels the recording completion function key displayed in the audio input window and displays the audition function key in the audio input window. If the mobile phone 100 receives a click operation from the user at the audition function key position in the audio input window, the mobile phone 100 plays the audio content collected by the microphone in response to the click operation. In this way, the user can audition the input audio content to determine whether the input audio content meets the requirements.
[0132] Optionally, a re-recording function key is provided in the audio input window. The re-recording function key is used to provide a function for re-entering audio content. If the mobile phone 100 receives a click operation from the user at the re-recording function key position in the audio input window, the mobile phone 100 re-collects the user's voice data through the microphone in response to the click operation. In this way, the user can repeatedly record audio content. For example, if the user finds that the recorded audio content does not meet the requirements after auditioning the audio content, the user can re-record the audio content until the user is satisfied.
[0133] Optionally, in order to present better video content to the user and provide a more convenient video production process, the mobile phone 100 can also provide a text conversion area in the audio input window. The text conversion area is used to provide text corresponding to the audio content. For example, as shown in Figure 7, the bottom of the audio input window is a text conversion area. While recording the audio content, the mobile phone 100 converts the audio content into text in real time and displays the text corresponding to the audio content in the text conversion area of the audio input window. For example, when the audio content collected by the mobile phone 100 is "Qiuqiu, happy birthday", the mobile phone 100 simultaneously displays the text "Qiuqiu, happy birthday" in the text conversion area of the audio input window.
[0134] In some examples, users can also modify the text displayed in the text conversion area. For example, if the mobile phone 100 receives a user action of clicking on the text conversion area, the mobile phone 100 displays a keyboard control and uses the keyboard control to receive the user's text editing action. The mobile phone 100 receives the text modified by the user in the text conversion area and uses this text as the text corresponding to the audio content.
[0135] In some implementations, when generating the fourth video, the mobile phone 100 may also combine the text corresponding to the audio content and the audio content with the first video to generate the fourth video. The fourth video includes not only the audio content but also the text corresponding to the audio content. The text corresponding to the audio content is played simultaneously with the audio content. For example, after obtaining the audio content and the text corresponding to the audio content, the mobile phone 100 adds the text corresponding to the audio content to a video production template and performs a video synthesis on the audio content and the production template containing the text corresponding to the audio content to generate the fifth video. The fifth video includes the audio content and text synchronized with the audio content. Furthermore, the mobile phone 100 splices the fifth video before the first video to generate the fourth video. Furthermore, the mobile phone 100 displays a preview window for the fourth video on the conversation page. The fourth video begins with the audio content and text synchronized with the audio content. For example, if the audio content is "Qiuqiu, happy birthday," the fourth video begins with the audio of "Qiuqiu, happy birthday" and the text synchronized with the audio of "Qiuqiu, happy birthday."
[0136] In this way, the mobile phone 100 can not only carry the audio content provided by the user in the produced video, but also actively add text corresponding to the audio content in the produced video, thereby presenting better video content to the user and providing a more convenient video production process.
[0137] In another implementation, taking the third control in which the user selects the video adding mode as an example, the video production process corresponding to the video adding mode is introduced in combination with the blessing scene.
[0138] As shown in Figure 8, the mobile phone 100 receives a click on the "Video Blessing" button on the conversation page. In response to the user's click on the "Video Blessing" button, the phone displays an "Add Video" bubble on the conversation page and pops up a video capture window. The video capture window provides video capture functionality. For example, in response to the click, the phone 100 invokes the recording function of the camera app through the voice assistant, displaying the camera app's capture page (an example of a video capture window). The video capture window is provided with a capture button. If the phone 100 receives a click on the capture button, the phone 100 activates the camera's capture function and captures video data using the camera (such as the front camera). This video data can be used as the video content to be added. If the phone 100 receives another click on the capture button, the phone 100 displays a video preview page. The video preview page is used to preview video content. The video preview page is provided with a preview button. If the phone 100 receives a click on the preview button, the phone 100 plays the recorded video content in response to the user's click on the preview button. The video preview page also includes a completion button. If the mobile phone 100 receives a user click operation at the location of the Done function key on the video preview page, the mobile phone 100, in response to the click operation, exits the video preview page and outputs a preview prompt window 801 of the video content on the conversation page. The user can click on the preview prompt window 801 of the video content to view the recorded video content. In addition, in response to the click operation, the mobile phone 100 also generates a sixth video based on the video content and the first video. For example, the mobile phone 100 splices the video content before the first video to obtain the sixth video. The sixth video provides video content at the beginning of the video. Further, the mobile phone 100 outputs a preview prompt window 802 of the sixth video on the conversation page. The user can click on the preview prompt window 802 of the sixth video to view the sixth video.
[0139] Optionally, during the process of collecting video data, mobile phone 100 can also convert the audio data in the video data into text, obtain the text corresponding to the video data, and synthesize the text corresponding to the video data with the video data to obtain video content. In this way, the video content also includes adapted text, such as the text "Qiuqiu, happy birthday." Ultimately, the sixth video presented to the user by mobile phone 100 not only provides the collected video data, but also includes the text corresponding to the video data, improving the user experience.
[0140] Optionally, a re-recording function key is provided on the video preview page. This re-recording function key is used to provide a function for re-recording video content. If the mobile phone 100 receives a user click operation at the re-recording function key position on the video preview page, the mobile phone 100 re-captures the user's video data via the camera in response to the click operation. In this way, the user can repeatedly record video content. For example, if the user finds that the recorded video content does not meet the user's requirements after previewing the video content, the user can re-record the video content until the user is satisfied.
[0141] The method provided in the embodiment of the present application can provide a video production process for a blessing scene through a voice assistant, and also provides a variety of content addition modes for adding video content, so as to meet the user's diverse needs for video production as much as possible and improve the user experience.
[0142] It should be noted that the personal information used in the technical solution of this application (such as the user's voice data, video data, etc.) is limited to information for which the individual's separate consent has been obtained, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) before the user uses the function, and signing the agreement (authorization) including authorization of relevant user information.
[0143] In other embodiments of the present application, an electronic device is provided, comprising: a screen, a memory, and one or more processors. The screen and the memory are respectively coupled to the processor. The screen is used to display an interface. The memory stores computer program code, which includes computer instructions. When the computer instructions are executed by the processor, the electronic device can perform the various functions or steps in the above method embodiments. Of course, the electronic device can also include other hardware structures. For example, the electronic device also includes hardware structures such as sensors and communication modules. The structure of the electronic device can refer to the structure of the mobile phone 100 shown in Figure 2.
[0144] An embodiment of the present application also provides a chip system, which is applied to an electronic device. The chip system includes at least one processor and at least one interface circuit. The processor and the interface circuit can be interconnected by lines. For example, the interface circuit can be used to receive signals from other devices (such as memories). For another example, the interface circuit can be used to send signals to other devices (such as processors). Exemplarily, the interface circuit can read instructions stored in the memory and send the instructions to the processor. When the instructions are executed by the processor, the electronic device can perform the various steps in the above embodiments. Of course, the chip system can also include other discrete devices, which are not specifically limited in the embodiments of the present application.
[0145] An embodiment of the present application also provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes each function or step in the above-mentioned method embodiment.
[0146] The present application also provides a computer program product, which, when executed on a computer, enables the computer to perform the functions or steps of the above method embodiment. For example, the computer may be the above electronic device.
[0147] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0148] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0149] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0150] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0151] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0152] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A video production method, characterized in that: Applied to electronic equipment, the method comprises: Displaying a conversation page of a voice assistant application, the conversation page including a prompt box for video generation, the prompt box including at least one image collection item and a video generation control, the at least one image collection item is used to provide at least one image, and the video generation control is used to generate a video; In response to a user operation on a video generation control, generating a first video based on the at least one image, and displaying a preview prompt window of the first video in a conversation page of the voice assistant application; Displaying a video adding card in the conversation page, wherein the video adding card includes a first control; If a user operation on the first control is received, in response to the user operation on the first control, displaying a text editing window on the dialog page; Obtaining text content in the text editing window; Based on the text content and the first video, a second video is generated, and a preview prompt window of the second video is displayed in the conversation page.
2. The method according to claim 1, characterized in that The text editing window includes a recommendation, and the recommendation is generated based on a video theme of the first video.
3. The method according to claim 2, characterized in that The text editing window also includes a replacement option, and the method further includes: In response to a user operation on the replacement option, the recommendation in the text editing window is updated.
4. The method according to claim 2 or 3, characterized in that: The method further comprises: In response to a user's editing operation on the recommendation words in the text editing window, the recommendation words are modified to obtain modified text content; Get the changed text content in the text editing window.
5. The method according to any one of claims 1 to 4, characterized in that The generating a second video based on the text content and the first video includes: Obtaining a first production template, where the first production template is used to provide a display style of a video; synthesizing the first production template and the text content to generate a third video, wherein the third video includes the text content; The third video and the first video are synthesized to generate a second video.
6. The method according to any one of claims 1 to 5, characterized in that The video adding card further includes a second control, and the method further includes: If a user operation on the second control is received, in response to the user operation on the second control, an audio input window is displayed on the conversation page, wherein the audio input window is used to provide a recording function, and the audio input window includes a recording function key; In response to a user operation on a recording function key, acquiring audio content; Based on the audio content and the first video, a fourth video is generated, and a preview prompt window of the fourth video is displayed in the conversation page.
7. The method according to claim 6, characterized in that The audio input window also includes a text conversion area, and the text conversion area is used to provide text corresponding to the audio content.
8. The method according to claim 6 or 7, characterized in that: The generating a fourth video based on the audio content and the first video includes: Get the second production template; synthesizing the audio content and the second production template to generate a fifth video, wherein the fifth video includes the audio content and text corresponding to the audio content; The fifth video and the first video are synthesized to generate a fourth video.
9. The method according to any one of claims 1 to 8, characterized in that The video adding card further includes a third control, and the method further includes: If a user operation on the third control is received, in response to the user operation on the third control, a video shooting window is displayed, wherein the video shooting window is used to provide a video shooting function, and the video shooting window includes a shooting function key; In response to a user operation on a shooting function key, acquiring video content; Based on the video content and the first video, a sixth video is generated, and a preview prompt window of the sixth video is displayed in the conversation page.
10. The method according to claim 9, characterized in that The video content includes text corresponding to the video data; and the obtaining of the video content in response to the user operation on the shooting function key includes: In response to a user operation on a shooting function key, recording video content; After the video content is shot, a video preview page of the video content is displayed, wherein the video preview page includes a completion function key; In response to a user operation on the completion function key, the video content is acquired.
11. The method according to any one of claims 1 to 10, characterized in that The electronic device records at least one reminder event, and the reminder event includes an event date and an event subject; the method further includes: Within a preset time period before the event date of the reminder event, a recommendation card for video production is provided in the desktop interface, and the recommendation card is used to provide a quick entry to the conversation page.
12. The method according to claim 11, characterized in that The reminder event is any one of a birthday event, an anniversary event, and a holiday event.
13. The method according to claim 11 or 12, characterized in that: The dialog page for displaying the voice assistant application includes: In response to a user operation on the recommendation card or a received voice instruction, a conversation page of the voice assistant application is entered; at least one image collection item is associated with the event theme, and the event theme is carried in the recommendation card or in the voice instruction.
14. An electronic device, characterized in that: include: A memory and one or more processors; the memory is coupled to the processor; The memory stores computer program code, which includes computer instructions. When the computer instructions are executed by the processor, the electronic device executes the method as claimed in any one of claims 1 to 13.
15. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 13.