Video generation method and electronic equipment

Abstract

The invention discloses a video generation method and electronic equipment. The method is applied to the electronic equipment, the electronic equipment comprises a first application and a second application, and the method comprises the steps that a first interface of the first application is displayed, and the first interface comprises a first control and a first picture set; and in response to a triggering operation on the first control, after a fragment service of the second application is called through the first application, a second interface of the first application is displayed, the fragment service is used for obtaining first video data generated according to the first picture set, and the first video data is used for displaying the second interface of the first application. The second interface comprises a thumbnail of the first video data. Based on the video generation method disclosed by the invention, the user experience can be improved.

Description

Technical Field

[0001] This application relates to the technical field of terminals, and more particularly, to a video generation method and an electronic device. Background Art

[0002] With the rapid development of electronic devices, the services provided by electronic devices to users (such as photo-taking services, video-playing services, or video-editing services, etc.) are also increasing. An electronic device can provide an interactive interface for a user to select or input the required services in the interactive interface.

[0003] Currently, the photo-taking function of an electronic device has become one of the most important functions of the electronic device. A user can take photos using the electronic device and store the obtained photos in the electronic device. In some scenarios, the user hopes to generate a video from the photos stored in the electronic device for viewing. However, in the process of generating a video from the photos stored in the electronic device based on traditional technologies, there is a problem of poor visual experience for the user, resulting in a poor user experience. Summary of the Invention

[0004] This application provides a video generation method and an electronic device, and this method can improve the user experience.

[0005] In a first aspect, this application provides a video generation method, which is applied to an electronic device. The electronic device includes a first application and a second application. The method includes: displaying a first interface of the first application, where the first interface includes a first control and a first set of pictures; in response to a trigger operation on the first control, after calling the video compilation service of the second application through the first application, displaying a second interface of the first application, where the video compilation service is used to obtain first video data generated according to the first set of pictures, and the second interface includes a thumbnail of the first video data.

[0006] The first video data is video data generated according to the first set of pictures, that is, the first video data is video data obtained by adding video effects to the first set of pictures. For example, the first video data may include a video generated based on the first set of pictures, a video cover, and a video duration. For example, the first video data may include a video generated based on the first set of pictures and a video cover.

[0007] In the above technical solution, after the user performs a triggering operation on the first control on the first interface of the first application, the first application can automatically call the video compilation service of the second application. After the first application successfully calls the video compilation service of the second application, the second interface of the first application displayed on the electronic device includes a thumbnail of the first video data generated by the video compilation service of the second application. Since the step of obtaining the first video data is implemented by the video compilation service of the second application, that is to say, this obtaining process is executed in the background of the electronic device, that is, the user is not aware of this obtaining process. This method avoids the problem of poor user visual experience in the traditional technology. Therefore, this method can improve the user experience.

[0008] In a possible implementation manner, after displaying the second interface of the first application, the method further includes: in response to a triggering operation on the thumbnail of the first video data, sending the first video data to the second application through the first application; after the second application processes the first video data, displaying a third interface, where the third interface is a preview playback interface of the first video data.

[0009] The first application stores the first video data, where the first video data stored by the first application is the video data obtained by the first application calling the video compilation service of the second application.

[0010] In the above technical solution, the second application located in the electronic device can restore the first video data obtained from the first application to the data in the playback format supported by the second application (i.e., the third video data), and perform a playback preview on the parsing result corresponding to the third video data to better meet the needs of users.

[0011] In another possible implementation manner, the electronic device further includes a third application different from the first application. The method further includes: displaying a fourth interface of the third application, where the fourth interface includes a second control and a second picture set; in response to a triggering operation on the second control, after calling the video compilation service through the third application, displaying a fifth interface of the third application, where the video compilation service is further used to obtain second video data generated according to the second picture set, and the fifth interface includes a thumbnail of the second video data.

[0012] The second video data is the video data generated according to the second picture set, that is, the second video data is the video data obtained by adding video effects to the second picture set.

[0013] In the above technical solution, the third application can also call the video compilation service of the second application, so as to display the second video data obtained by the video compilation service on the interface of the third application, which can meet the needs of users to call the video compilation service through the interfaces of different applications, thereby improving the user experience.

[0014] In another possible implementation, the electronic device further includes a media processing module. Moreover, in response to a triggering operation on the first control, after invoking the video compilation service of the second application through the first application, a second interface of the first application is displayed, including: in response to the triggering operation on the first control, the first application sends a first video compilation instruction to the media processing module, where the first video compilation instruction carries a first set of pictures; the media processing module determines a theme matching the first set of pictures according to the first set of pictures carried in the first video compilation instruction, and sends the first set of pictures and the theme to the video compilation service, so that the video compilation service sends the first video data to the media processing module; after receiving the first video data, the media processing module sends the first video data to the first application; after receiving the first video data, the first application displays the second interface.

[0015] In the above technical solution, the first application invokes the video compilation service of the second application through the media processing module, so that the first application can display the first video data generated based on the first set of pictures obtained by the video compilation service. Since the process of the video compilation service obtaining the first video data is executed in the background, that is, this process is not perceived by the user, the user experience can be improved.

[0016] In another possible implementation, the second application further includes a video compilation pipeline module. Moreover, the media processing module sends the first set of pictures and the theme to the video compilation service so that the video compilation service sends the first video data to the media processing module, including: the media processing module sends the first set of pictures and the theme to the video compilation service; the video compilation service sends a second video compilation instruction to the video compilation pipeline module, where the second video compilation instruction carries the first set of pictures and the theme; the video compilation pipeline module performs video compilation processing based on the first set of pictures and the theme to obtain third video data, where the format of the third video data is different from the format of the first video data; the video compilation pipeline module sends the third video data to the video compilation service; the video compilation service converts the third video data into the first video data and sends the first video data to the media processing module.

[0017] In the step of the above video compilation pipeline module performing video compilation processing based on the first set of pictures and the theme to obtain third video data, exemplarily, it may include: the video compilation pipeline module performs video compilation processing on the first set of pictures and the theme according to multiple preset processing nodes to obtain third video data, where the multiple preset processing nodes may include a video template material node, a template matching node according to the theme, a parsed template material node, a parsed music rhythm node, a music usage and beat synchronization node, a special effect usage node, and a cover generation node.

[0018] The above-mentioned multiple preset processing nodes are pre-configured. Each of the above-mentioned multiple preset processing nodes is used to execute a preset process corresponding to the function of each preset processing node. For example, taking the theme matching template node as an example, the theme matching template node is used to execute the process of matching a video template for the target theme to obtain a video template that matches the target theme.

[0019] In another possible implementation manner, the second application further includes a one-key blockbuster component, a restoration pipeline module, and a video playback module. And in response to a trigger operation on the thumbnail of the first video, the first application sends the first video data to the second application, including: in response to a trigger operation on the thumbnail of the first video, the first application sends the first video data to the one-key blockbuster component; after the second application processes the first video data, it displays a third interface, including: the one-key blockbuster component converts the first video data into third video data, where the format of the first video data is different from the format of the third video data; the one-key blockbuster component sends a restoration instruction to the restoration pipeline module, where the restoration instruction carries the third video data; after the restoration pipeline module parses and processes the third video data carried by the restoration instruction, it sends the obtained parsing result to the video playback module; in response to the video playback module loading the parsing result, the video playback module displays the third interface.

[0020] In another possible implementation manner, the first application is a voice application, and the second application is a video editing application.

[0021] In a second aspect, the present application provides a video generation device, which is applied to an electronic device, and the device is used to execute any one of the methods in the first aspect.

[0022] In a third aspect, an electronic device is provided, including a unit for executing any one of the methods in the first aspect. This device can be a terminal device or a chip inside the terminal device. This device can include an input unit and a processing unit.

[0023] When the device is a terminal device, the processing unit can be a processor, and the input unit can be a communication interface; the terminal device can further include a memory, and the memory is used to store computer program code. When the processor executes the computer program code stored in the memory, the terminal device executes any one of the video generation methods in the first aspect.

[0024] When the device is a chip in a terminal device, the processing unit may be a processing unit inside the chip, and the input unit may be an output interface, a pin, a circuit, etc.; the chip may further include a memory, and the memory may be a memory inside the chip (for example, a register, a cache, etc.), or may be a memory located outside the chip (for example, a read-only memory, a random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, the chip is caused to execute any of the video generation methods in the first aspect.

[0025] In a possible implementation, the memory is used to store computer program code; a processor, the processor executes the computer program code stored in the memory, and when the computer program code stored in the memory is executed, the processor is used to execute any of the video generation methods in the first aspect.

[0026] In a fourth aspect, there is provided a computer-readable storage medium storing computer program code, and when the computer program code is run by an electronic device, the electronic device is caused to execute any of the video generation methods in the first aspect.

[0027] In a fifth aspect, there is provided a computer program product, the computer program product including: computer program code, and when the computer program code is run by an electronic device, the electronic device is caused to execute any of the video generation methods in the first aspect.

[0028] It can be understood that the beneficial effects of the above second to fifth aspects can be referred to the relevant descriptions in the above first aspect, and will not be elaborated here.

[0029] It should be understood that the description of technical features, technical solutions, beneficial effects or similar languages in this application does not imply that all features and advantages can be achieved in any single embodiment. On the contrary, it can be understood that the description of features or beneficial effects means that at least one embodiment includes specific technical features, technical solutions or beneficial effects. Therefore, the descriptions of technical features, technical solutions or beneficial effects in this specification do not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in this embodiment can be combined in any appropriate manner. Those skilled in the art will understand that an embodiment can be implemented without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in specific embodiments that do not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 is a schematic diagram of the hardware system of the electronic device 100 provided in an embodiment of the present application.

[0031] Figure 2 It is a schematic diagram of the software system of the electronic device 100 provided by an embodiment of the present application.

[0032] Figure 3 It is a schematic diagram of a system architecture applicable to the video generation method provided by an embodiment of the present application.

[0033] Figure 4 It is a schematic diagram of a user interface provided by an embodiment of the present application.

[0034] Figure 5 It is a schematic diagram of a video generation method provided by an embodiment of the present application.

[0035] Figure 6 It is a schematic diagram of a user interface provided by an embodiment of the present application.

[0036] Figure 7 It is a schematic diagram of a video playback method provided by an embodiment of the present application.

[0037] Figure 8 It is a schematic diagram of a video generation method provided by an embodiment of the present application. Detailed implementation manners

[0038] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0039] To better understand the technical solutions provided by the present application, first, relevant terms involved in the embodiments of the present application will be introduced.

[0040] Activity

[0041] An activity is an application component. Specifically, an activity is a component responsible for interacting with users. In the Android system, an activity is usually a separate interface (also known as a screen), on which some controls can be displayed, and the interface can also listen to and process user events (such as touch events, etc.) and make responses. Activities communicate with each other through intents (i.e., a message passing mechanism).

[0042] Next, the technical solutions provided by the present application will be specifically elaborated.

[0043] The camera hardware testing method provided by the embodiments of this application can be applied to an electronic device. Next, the hardware structure and software structure of the electronic device will be introduced in detail with reference to the accompanying drawings.

[0044] Figure 1 It is a schematic diagram of the hardware system of the electronic device 100 provided by the embodiments of this application.

[0045] The type of the electronic device 100 is not specifically limited and can be selected according to the actual scenario. Exemplarily, the electronic device 100 can be a mobile phone, a smart screen, a tablet computer, a wearable electronic device, a vehicle-mounted electronic device, an augmented reality (AR) device, a virtual reality (VR) device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a projector, a vehicle-mounted device, etc. The embodiments of this application do not impose any restrictions on the specific type of the electronic device 100.

[0046] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0047] It should be noted that Figure 1 the structure shown does not specifically limit the electronic device 100. In some other embodiments of this application, the electronic device 100 may include more or fewer components than Figure 1 those shown, or the electronic device 100 may include Figure 1A combination of some of the components shown, or, the electronic device 100 may include Figure 1 sub-components of some of the components shown. Figure 1 The components shown may be implemented in hardware, software, or a combination of software and hardware.

[0048] The processor 110 may include one or more processing units. For example, the processor 110 may include at least one of the following processing units: an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated devices.

[0049] The controller may generate operation control signals according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0050] A memory can also be provided in the processor 110 for storing instructions and data. For example, instructions for executing the camera hardware test method provided by the embodiments of the present application can be stored in the processor 110. For example, data obtained by executing the camera hardware test method provided by the embodiments of the present application can be stored in the processor 110. In some embodiments, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system. In some embodiments, the processor 110 may include one or more interfaces. For example, the processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and a USB interface.

[0051] Figure 1 The connection relationships shown between the various modules are only illustrative and do not constitute a limitation on the connection relationships between the modules of the electronic device 100. Optionally, the various modules of the electronic device 100 may also adopt a combination of the various connection methods in the above embodiments.

[0052] The electronic device 100 can implement a display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0053] The display screen 194 can be used to display images or videos. For example, the display screen 194 can display images or videos captured by the camera application of the electronic device, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a Micro OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0054] The electronic device 100 can implement the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc.

[0055] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera sensor. The optical signal is converted into an electrical signal, and the camera sensor transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can perform algorithm optimization on the noise, brightness, and color of the image. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0056] The camera 193 is used to capture static images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in standard formats such as red green blue (RGB) and YUV. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0057] The external memory interface 120 can be used to connect to an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement the data storage function.

[0058] The internal memory 121 can be used to store computer-executable program codes, and the executable program codes include instructions. For example, the instructions for executing the camera hardware test method provided in the embodiments of the present application can be stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store the operating system and application programs required for at least one function (such as the sound playback function and the image playback function). The data storage area can store the data created during the use of the electronic device 100 (such as audio data and phone books). In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as: at least one disk storage device, a flash memory device, and a universal flash storage (UFS), etc. The processor 110 executes various processing methods of the electronic device 100 by running the instructions stored in the internal memory 121 and / or the instructions stored in the memory provided in the processor.

[0059] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, y-axis, and z-axis) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake during shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the shaking angle of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and makes the lens counteract the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used in scenarios such as navigation and motion sensing games.

[0060] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance through infrared or laser. In some embodiments, for example, in a shooting scenario, the electronic device 100 can use the distance sensor 180F to measure distance to achieve rapid focusing. For example, the distance sensor 180F can be but is not limited to a TOF sensor.

[0061] The touch sensor 180K, also known as a touch control device. The touch sensor 180K can be disposed on the display screen 194, and together with the display screen 194, it forms a touch screen, which is also called a touch control screen. The touch sensor 180K is used to detect touch operations acting on it or in its vicinity. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100 and be located at a different position from the display screen 194.

[0062] The motor 191 can generate vibrations. In some implementation manners, the motor 191 can be a camera automatic focus motor (AF). The camera AF is used to adjust the focus of the lens to make the object to be photographed clear and sharp. It can drive the lens assembly to move forward and backward according to the user's manual operation or the instructions of the automatic focus system. The camera AF is usually driven by the internal electronic control system or motor of the camera, and precisely controls the movement of each lens assembly according to the user's operation or the instructions of the automatic control algorithm to achieve the shooting requirements and the desired shooting effect. In some other implementation manners, the motor 191 can be used for incoming call reminders and can also be used for touch feedback. The motor 191 can produce different vibration feedback effects for touch operations acting on different application programs. For touch operations acting on different areas of the display screen 194, the motor 191 can also produce different vibration feedback effects. Different application scenarios (such as time reminders, receiving information, alarms, and games) can correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0063] The hardware system of the electronic device 100 has been described in detail above. Next, the software system of the electronic device 100 will be introduced. The software system can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of this application, taking the layered architecture as an example, the software system of the electronic device 100 will be described exemplarily.

[0064] Exemplarily, Figure 2 is a schematic diagram of the software system of the electronic device 100 provided by the embodiments of this application. Refer to Figure 2 and this software system adopts a layered architecture. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom, namely the application layer 210, the application framework layer 220, the Android Runtime and core library layer 230, the hardware abstract layer (HAL) 240, and the kernel layer 250.

[0065] The application layer 210 may include a series of application packages. For example, the application packages may include applications such as a voice assistant, a clip, a camera, a gallery, a chat, a call, a map, a navigation, a calendar, a Bluetooth, music, and a video.

[0066] Each of the above applications may include more specific functional modules. For example, the gallery may include a business module and a notification module. For example, the camera may include a photographing module.

[0067] Each of the above applications may be used to generate application data. For example, the gallery is used to generate photo data.

[0068] The application framework layer 220 provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer 220 includes some predefined functions.

[0069] As Figure 2 shown, the application framework layer 220 may include a window manager, a notification manager, an activity manager, an input manager, a view system, a content provider, a resource manager, etc.

[0070] The window manager provides a window manager service (WMS), and the WMS can be used for window management, window animation management, surface management, and as a transfer station for the input system.

[0071] The content provider is used to store and retrieve data and make this data accessible to applications. This data can include videos, images, audio, incoming and outgoing calls, browsing history and bookmarks, phone books, etc.

[0072] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures. For example, the display interface can be, but is not limited to, Figure 4 or Figure 6 the shown user interface.

[0073] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0074] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is complete, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of a background-running application, or a notification that appears in the form of a dialogue window on the screen. For example, prompting text information in the status bar, emitting a prompt tone, vibrating the electronic device, flashing the indicator light, etc.

[0075] The activity manager can provide an activity manager service (AMS). AMS can be used for the startup, switching, scheduling of system components (such as activities, services, content providers, broadcast receivers), as well as the management and scheduling of application processes.

[0076] The input manager can provide an input manager service (IMS). IMS can be used to manage system inputs, such as touch screen inputs, key inputs, sensor inputs, etc. IMS retrieves events from input device nodes and distributes the events to appropriate windows through interaction with the WMS.

[0077] Android Runtime includes core libraries and a virtual machine. Android Runtime is responsible for the scheduling and management of the Android system.

[0078] The core libraries contain two parts: one part is the functional functions that need to be called by programming languages (e.g., Java language), and the other part is the core libraries of Android.

[0079] The application layer 210 and the application framework layer 220 run in a virtual machine. The virtual machine executes the programming files (e.g., java files) of the application layer 210 and the application framework layer 220 as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0080] The core library layer 230 may include multiple functional modules. For example: surface manager, media framework, libc, SQLite, OpenGL ES, Webkit, etc.

[0081] The surface manager is used to manage the display subsystem and provides the fusion of two-dimensional (2D) and three-dimensional (3D) layers for multiple applications.

[0082] The media framework supports the playback and recording of various common audio and video formats, as well as static image files, etc.

[0083] Libc (C library) is the standard library of the C language. Libc is the most fundamental library in the system and is implemented through the system calls of Linux. For example, libc can be used to connect or disconnect the camera service, set the camera's shooting parameters, start, stop preview, take pictures, etc.

[0084] The Hardware Abstraction Layer (HAL) 240 is an interface layer located between the operating system kernel and the upper-layer software, and its purpose is to abstract the hardware. The hardware abstraction layer is an abstract interface for the device kernel driver and is used to implement an application programming interface for accessing the underlying device to a higher-level Java API framework. HAL contains multiple library modules, such as camera HAL (e.g., aperture, TOF sensor, lens, or focus motor, etc.), Vendor warehouse, display screen, Bluetooth, audio, etc. Each of these library modules implements an interface for a specific type of hardware component. It can be understood that the camera HAL can provide an interface for the camera FWK to access hardware components such as the camera. The Vendor warehouse can provide an interface for the media FWK to access hardware components such as the encoder. When the system framework layer API requests access to the hardware of a portable device, the Android operating system will load the library module for this hardware component.

[0085] The kernel layer 250 is the foundation of the Android operating system, and all the final functions of the Android operating system are completed through the kernel layer. The kernel layer may include a display driver, a camera driver, an audio driver, and a sensor driver.

[0086] It should be noted that what this application providesFigure 2 The schematic diagram of the software structure of the electronic device shown is only an example, and does not limit the specific module division in different layers of the Android operating system. Specifically, reference can be made to the introduction of the software structure of the Android operating system in the conventional technology. In addition, the shooting method provided in this application can also be implemented based on other operating systems (for example, IOS or HarmonyOS, etc.), and this application will not give examples one by one.

[0087] Figure 3 It is a schematic diagram of a system architecture applicable to the video generation method provided in the embodiments of this application. As Figure 3 shown, the system architecture includes a voice assistant 310, a media processing middleware 320, and a video editing application 330. It can be understood that based on Figure 3 the shown system architecture, the processes of the video generation method provided in the embodiments of this application and the video playback method provided in the embodiments of this application can be executed.

[0088] Next, the process of the video generation method provided in the embodiments of this application executed based on Figure 3 the shown system architecture will be introduced.

[0089] The voice assistant 310 is used to: in response to a trigger operation by the user on the video generation control in the dialogue interface of the voice assistant 310, send a finished video instruction 1 (carrying picture materials) to the media processing middleware 320, where the finished video instruction 1 is used to request to obtain a video generated based on the picture materials. The finished video instruction 1 will trigger the media processing middleware 320 to send the picture materials and the theme matching the picture materials to the automatic video editing service 331 located in the video editing application 330.

[0090] There is no specific limitation on the name of the voice assistant 310. For example, the voice assistant 310 can be but is not limited to the YOYO voice assistant. For example, the dialogue interface of the voice assistant 310 can be Figure 4 the intelligent video editing interface S4A shown in (1) of

[0091] The media processing middleware 320 includes a material selection module 321, a theme generation module 322, and an automatic video generation service toolkit 323. The material selection module 321 is used to screen and process the picture materials obtained from the voice assistant 310 to obtain the screened picture materials. The material selection module 321 is also used to perform processing such as aesthetic scoring on the picture materials. The screened picture materials are not specifically limited. For example, the screened picture materials may include some or all of the pictures in the picture materials. For example, the screened picture materials may include the highlight picture materials in the picture materials carried by the video generation instruction. The theme generation module 322 is used to determine a matching theme for the screened picture materials obtained from the material selection module 321. For example, different themes are stored in the theme generation module 322, and different themes correspond to different picture styles. Based on this, after the theme generation module 322 obtains the screened picture materials, it can select a theme that matches the screened picture materials from multiple different themes. The automatic video generation service toolkit 323 is bound to the automatic video generation service 331 in the video editing application 330. The automatic video generation service toolkit is used to call the automatic video generation service 331 in the video editing application 330.

[0092] The video editing application 330 includes an automatic video generation service 331, a video generation pipeline module 332, a one-key blockbuster activity component 333, a video restoration pipeline module 334, and a video playback module 335. The automatic video generation service 331 is used to send a video generation instruction 2 to the video generation pipeline module 332, where the video generation instruction 2 carries the screened picture materials and the theme that matches the screened picture materials. The video generation pipeline module 332 is used to perform video generation processing based on the screened picture materials and the theme that matches the screened picture materials to obtain video data 1, where the data format of the video data 1 is different from the data format of the video draft. The data structure of the video data 1 conforms to the internal video data structure of the video editing application. For example, the data format of the video draft may be the json string data format. Then, the video generation pipeline module 332 sends the obtained video data 1 to the automatic video generation service 331, and the automatic video generation service 331 converts the obtained video data 1 into a video draft. Thereafter, the video draft obtained by the automatic video generation service 331 is returned to the voice assistant 310 through the automatic video generation service toolkit 323 in the media processing middleware 320.

[0093] Next, introduce the Figure 3 process of executing the video playback method provided by the embodiments of the present application based on the system architecture shown.

[0094] The voice assistant 310 is further configured to: in response to a triggering operation by the user on a video in the dialogue interface of the voice assistant 310, send a draft finished video to the clip application 330, so that the clip application 330 plays the video corresponding to the draft finished video, wherein the draft finished video saved in the voice assistant 310 is generated by the automatic video generation service 331. The one-key blockbuster activity component 333 is configured to obtain the draft finished video from the voice assistant 310, and restore the draft finished video to video data 1, wherein the data structure of the video data 1 is the video data structure inside the clip application. Then, the one-key blockbuster activity component 333 sends the video data 1 to the restored video pipeline module 334. The restored video pipeline module 334 is configured to perform a restoration process on the video data 1, and send the obtained restoration result to the video playback module 335. In response to the video playback module 335 loading the restoration result obtained in the foregoing step, the video playback module 335 displays a preview interface for playing the restoration result. For example, the preview interface may be Figure 4 the interface S4B shown in FIG. (2).

[0095] It should be understood that the system architecture shown above Figure 3 applicable to the video generation method provided in the embodiments of the present application is only schematic and does not constitute any limitation. For example, the Figure 3 shown clip application 330 may further include an editing module, and the editing module is configured to add text, etc. to the generated video according to parameters input by the user. For example, the above-mentioned restored video pipeline module 334 and the finished video pipeline module 332 may also be a single module unit.

[0096] Next, the video generation method provided in the embodiments of the present application will be introduced in detail in combination with Figures 5 to 8 FIG.

[0097] Figure 5 FIG. is a schematic diagram of a video generation method provided in the embodiments of the present application. The video generation method provided in the embodiments of the present application can be executed by an electronic device. It can be understood that the electronic device can be implemented as software, or a combination of software and hardware. Exemplarily, the electronic device in the embodiments of the present application can be, but is not limited to, Figure 1 the electronic device 100 shown. As Figure 5 shown, the video generation method provided in the embodiments of the present application includes S500 to S515. Next, S500 to S515 will be introduced in detail.

[0098] S500, the YOYO intelligent assistant of the terminal device displays interface 1, wherein interface 1 includes target picture materials and a video generation control.

[0099] There is no specific limitation on the number of the target picture materials. For example, the target picture materials may be, but are not limited to, 10, 20, 30, etc.

[0100] The video generation control is used to trigger the electronic device to generate a video based on the target picture materials included in Interface 1.

[0101] The method for YOYO Smart Assistant to display Interface 1 is not specifically limited. Exemplarily, when YOYO Smart Assistant displays Interface 1, it includes: after the user performs an operation to open YOYO Smart Assistant, YOYO Smart Assistant displays a dialogue interface; after the user enters an instruction to obtain picture materials in the dialogue interface, YOYO Smart Assistant displays Interface 1.

[0102] Exemplarily, Interface 1 in S500 above can be Figure 6 the intelligent video composition interface S6 provided by the YOYO Smart Assistant of the mobile phone shown in, please refer to Figure 6 , the text box 600 includes multiple picture materials and a video generation control 610.

[0103] S501, in response to the user's trigger operation on the video generation control, YOYO Smart Assistant sends a video composition instruction 1 to the media processing middle platform of the terminal device. Correspondingly, the media processing middle platform receives the video composition instruction 1 (carrying the target picture materials) sent by YOYO Smart Assistant.

[0104] The video composition instruction 1 is used to request to obtain a video generated based on the target picture materials, where the video composition instruction 1 includes the target picture materials.

[0105] In this way, after YOYO Smart Assistant receives the user's trigger operation on the video generation control in Interface 1, YOYO Smart Assistant can act as a caller to send the video composition instruction 1 to the media processing middle platform. Thereafter, the media processing middle platform can obtain the video composition instruction 1.

[0106] S502, the media processing middle platform sends an initialization message to the automatic video composition service of the editing application. Correspondingly, the automatic video composition service receives the initialization message sent by the media processing middle platform.

[0107] The media processing middle platform integrates an automatic video composition service toolkit (kit). The purpose of the media processing middle platform sending an initialization message to the automatic video composition service of the editing application is to bind the automatic video composition service toolkit located in the media processing middle platform and the automatic video composition service in the editing application.

[0108] The automatic video composition service is a service component in the editing application. The automatic video composition service is also called the light editing service.

[0109] S503, the automatic video composition service sends an initialization success message to the media processing middle platform. Correspondingly, the media processing middle platform receives the initialization success message sent by the automatic video composition service.

[0110] The initialization success message is used to indicate that the automatic video generation service toolkit in the media processing middleware platform and the automatic video generation service in the editing application have been successfully bound.

[0111] The above S502 and S503 are optional steps. For example, in one example, before executing the embodiments of the present application, if the automatic video generation service toolkit in the media processing middleware platform and the automatic video generation service in the editing application have been successfully bound, in this case, after executing S501, S502 and S503 may not be executed.

[0112] S504, the media processing middleware platform obtains a target theme that matches the target picture material according to the video generation instruction 1.

[0113] In one example, the media processing middleware platform obtains a target theme that matches the target picture material according to the target picture material carried by the video generation instruction 1. Exemplarily, it may include the following steps: The media processing middleware platform selects a target theme that matches the target picture material from multiple themes according to the target picture material carried by the video generation instruction 1.

[0114] The target picture material and the target theme match, and the target picture material and the matching target theme are not specifically limited. For example, taking the target picture material including pictures of multiple portrait photos as an example, the target theme may be the "person" theme. Another example, taking the target picture material including pictures of multiple buildings as an example, the target theme may be the "architecture" theme. Still another example, taking the target picture material including pictures of multiple tourist attractions as an example, the target theme may be the "scenery" theme.

[0115] S505, the media processing middleware platform sends the target picture material and the target theme associated with the video generation instruction 1 to the automatic video generation service. Correspondingly, the automatic video generation service receives the target picture material and the target theme associated with the video generation instruction 1 sent by the media processing middleware platform.

[0116] In this way, after the media processing middleware platform receives the video generation instruction 1 and performs an initialization operation on the automatic video generation service of the editing application, the media processing middleware platform can send the target picture material and the target theme associated with the video generation instruction 1 to the automatic video generation service of the editing application, so that the automatic video generation service in the editing application is called to generate a corresponding video according to the target picture material and the target theme.

[0117] S506, the automatic video generation service sends a video generation instruction 2 (carrying the target picture material and the target theme) to the video generation pipeline module of the editing application. Correspondingly, the video generation pipeline module receives the video generation instruction 2 sent by the automatic video generation service.

[0118] S507, the video pipeline module sends an analysis instruction (carrying the target image material) to the media processing center. Correspondingly, the media processing center receives the analysis instruction sent by the video pipeline module.

[0119] The analysis instruction is used to obtain the highlight picture material in the target picture material, wherein the highlight picture material may be part of the picture or all of the picture in the target picture material, and there is no specific limitation on this. For example, a portrait picture of a person included in the target picture material may be identified as the highlight picture material included in the target picture material. For another example, a group photo of multiple people included in the target picture material may be identified as the highlight picture material included in the target picture material.

[0120] S508, the media processing center performs screening and processing on the target image material to obtain analysis results, wherein the sharing results include highlight image materials in the target image material.

[0121] S509, the media processing center sends the analysis result to the slice assembly line module. Correspondingly, the slice assembly line module receives the analysis result sent by the media processing center.

[0122] It should be noted that the above steps S507 to S509 are optional. That is, in some implementations, after executing the above steps S501 to S506, S510 to S515 may be directly executed. In this case, the highlight picture materials in the following S510 to S515 need to be replaced with the target picture materials.

[0123] S510, the film-forming pipeline module processes the highlight image material and the target theme into a film based on multiple preset processing nodes, and generates video data 1 that conforms to the video data structure inside the editing application, wherein the video data 1 includes the highlight image material, music, filters, transitions, video duration and video cover information.

[0124] The video data 1 is video data that conforms to the video data structure inside the editing application, and the video data structure inside the editing application can be called "TemplateModel". It is understandable that other applications in the terminal device except the editing application cannot parse the video data 1 that conforms to the video data structure inside the editing application, and perform video preview and playback based on the parsed content.

[0125] The video duration refers to the time length corresponding to the video data 1. The video cover information may include a picture of the video cover.

[0126] The plurality of preset processing nodes may include a video template material node, a template matching node based on a theme, a template material parsing node, a music rhythm parsing node, a music use and card point node, a special effect use node, and a cover generation node.

[0127] Each preset processing node among multiple preset processing nodes is used to execute a preset process for the function corresponding to each preset processing node. For example, taking the theme matching template node as an example, the theme matching template node is used to execute the process of matching a video template for the target theme to obtain a video template that matches the target theme.

[0128] Optionally, before the finished video pipeline module executes S510, the finished video pipeline module can also generate multiple preset processing nodes according to the configuration file. The method for the finished video pipeline module to obtain the configuration file is not specifically limited. For example, the configuration file can be a predefined file stored in the finished video pipeline module.

[0129] In the above S510, the video data 1 is described by taking it as an example that it includes highlight picture materials, music, filters, transitions, and video duration. The content included in the video data 1 in S510 is only for illustration and does not constitute any limitation. Optionally, the above video data 1 can also only include highlight picture materials, transitions, video duration, and video cover information.

[0130] In this way, after the finished video pipeline module obtains the target picture materials and the target theme, through the interaction between the finished video pipeline module and the media processing middle platform, the finished video pipeline module can obtain the highlight pictures in the target picture materials. Thereafter, based on multiple preset processing nodes, the finished video pipeline module processes the highlight clips and the target theme to generate video data 1 that conforms to the data format inside the editing application.

[0131] S511, the finished video pipeline module sends the video data 1 to the automatic video creation service. Correspondingly, the automatic video creation service receives the video data 1 sent by the finished video pipeline module.

[0132] S512, the automatic video creation service converts the video data 1 into a json string to obtain a draft video.

[0133] The difference between the draft video and the video data 1 lies in the different data formats. For example, the draft video includes highlight picture materials, music, filters, transitions, video duration, and video cover information.

[0134] The method for the automatic video creation service to convert the video data 1 into a json string to obtain a draft video is not specifically limited. For example, it can be converted based on existing data conversion methods.

[0135] It should be understood that the video data 1 is only applicable for internal use in the editing application, that is, the video data 1 cannot be called by a third-party application, but the draft video obtained after converting the video data 1 can be provided for a third-party application to call. For example, the third-party application can be but is not limited to the YOYO intelligent assistant in the terminal device.

[0136] S513. The automatic video production service sends the draft video to the media processing middle platform. Correspondingly, the media processing middle platform receives the draft video sent by the automatic video production service.

[0137] S514. The media processing middle platform sends the draft video to the YOYO intelligent assistant. Correspondingly, the YOYO intelligent assistant receives the draft video sent by the media processing middle platform.

[0138] It should be noted that in the above implementation process, the video data generated by the YOYO intelligent assistant by calling the automatic video production service in the editing application through the media processing middle platform. Since this implementation process is based on a service (i.e., the automatic video production service), that is, the above implementation process is executed in the background of the terminal device, and the user is not aware of the above implementation process.

[0139] S515. The YOYO intelligent assistant loads the draft video and displays Interface 2 including the video cover information and video duration in the draft video.

[0140] Optionally, Interface 2 may further include other information, and no specific limitation is imposed on the other information. For example, the other information may be but is not limited to at least one of the following: target picture materials, video generation controls, or text conversation information.

[0141] For example, Interface 2 in the above S514 may be Figure 4 the intelligent video production interface S4A shown in (1) of. The video cover information and video duration in the draft video in the above S514 may be the video cover and video duration displayed in the 410 text box shown in the intelligent video production interface S4A. The text 400 and thumbnail of the picture material are also displayed in the intelligent video production interface S4A.

[0142] It should be understood that after the YOYO intelligent assistant executes the above S515, the draft video is stored in the storage space corresponding to the YOYO intelligent assistant.

[0143] It should be understood that Figure 6 the video generation method shown above is only illustrative and does not impose any limitation on the video generation method provided by this application.

[0144] In an embodiment of the present application, after the user performs a triggering operation on the video generation control of Interface 1 of the YOYO intelligent assistant, the YOYO intelligent assistant can automatically call the automatic video generation service of the video editing application. After the YOYO intelligent assistant successfully calls the automatic video generation service of the video editing application, the Interface 2 of the YOYO intelligent assistant displayed on the electronic device includes a thumbnail of the rough video generated by the automatic video generation service of the video editing application. Since the step of obtaining the rough video is implemented by the automatic video generation service of the video editing application, that is to say, this obtaining process is executed in the background of the electronic device, that is, the user is not aware of this obtaining process. This method avoids the problem of poor user visual experience in the traditional technology. Therefore, this method can improve the user experience.

[0145] The above combines Figure 5 and introduces a video generation method provided by an embodiment of the present application. Next, in conjunction with the accompanying drawings, introduce how the YOYO intelligent assistant provided by an embodiment of the present application plays the rough video generated by the above Figure 5 provided video generation method.

[0146] Figure 7 is a schematic diagram of a video playing method provided by an embodiment of the present application. The video playing method provided by an embodiment of the present application can be executed by an electronic device. It can be understood that this electronic device can be implemented as software, or a combination of software and hardware. Exemplarily, the electronic device in an embodiment of the present application can be but is not limited to Figure 1 the electronic device 100 shown. As Figure 7 shown, the video playing method provided by an embodiment of the present application includes S701 to S709. Next, S701 to S709 will be introduced in detail. It should be understood that Figure 7 the methods S701 to S709 shown can be executed after the methods S500 to S515 shown above Figure 5 .

[0147] S701, the user clicks on the video cover in Interface 2.

[0148] Optionally, the video playing control is also included in Interface 2, and the above S701 can be replaced by the following steps: the user clicks on the video playing control in Interface 2. For example, taking the intelligent video generation interface S4A shown in (1) of Figure 4 as an example, the video playing control is the control 420 in the intelligent video generation interface S4A.

[0149] S702, in response to the user clicking on the video cover in Interface 2, the YOYO intelligent assistant obtains the rough video from the storage space corresponding to the YOYO intelligent assistant.

[0150] As described above Figure 5In the provided video method, the YOYO Smart Assistant stores the resulting finished video manuscript. Therefore, the YOYO Smart Assistant can obtain the finished video draft from the storage space corresponding to the YOYO Smart Assistant.

[0151] S703, the YOYO Smart Assistant sends the finished video draft to the one-click blockbuster activity component of the video editing application. Correspondingly, the one-click blockbuster activity component receives the finished video draft sent by the YOYO Smart Assistant.

[0152] S704, the one-click blockbuster activity component sends an initialization message to the video player of the video editing application.

[0153] The initialization message is used to initialize the video player. For example, initializing the buttons of the video player, etc.

[0154] S705, the one-click blockbuster activity component converts the finished video draft into video data that conforms to the internal video data structure of the video editing application, obtaining video data 1.

[0155] As mentioned above, the finished video draft is data in the form of a json string, and video data 1 is video data that conforms to the internal video data structure of the video editing application. The data format of the finished video draft is different from the data format of video data 1.

[0156] The process by which the one-click blockbuster activity component converts the finished video draft into video data 1 is Figure 5 The inverse process of the process in S512 of the provided video method where the automatic video generation service converts video data 1 into a finished video draft.

[0157] In this way, after the user clicks on the video cover of Interface 2, the YOYO Smart Assistant, as the caller, launches the one-click blockbuster activity component in the video editing application and passes the finished video draft (in the data format of a json string) to the video editing application through the Intent method. After the one-click blockbuster activity component initializes the video playback module in the video editing application, it restores the finished video draft to video data 1 (in the internal video data structure of the video editing application).

[0158] S706, the one-click blockbuster activity component sends a restoration instruction (carrying video data 1) to the video restoration pipeline module of the video editing application.

[0159] The restoration instruction is used to indicate the restoration of the content of video data 1.

[0160] The video restoration pipeline module and the Figure 6 Shown video generation pipeline module can be the same module or different modules, and no specific limitation is made in this regard.

[0161] S707, the video restoration pipeline module performs data restoration processing on video data 1 to obtain a restored result, where the restored result includes highlight picture materials, music, filters, transitions, and video duration.

[0162] S708, the video restoration pipeline module sends a play instruction (carrying the restored result) to the video play module of the editing application.

[0163] S709, in response to receiving the play instruction, the video play module plays the restored result in the preview interface.

[0164] For example, the above preview interface may be Figure 4 the interface S4B shown in (2) of

[0165] It should be understood that the above Figure 7 shown video generation method is only illustrative and does not impose any limitation on the video generation method provided by this application.

[0166] In the embodiments of this application, after the user clicks on the video cover in interface 2, the editing application located in the electronic device can restore the finished draft obtained from the YOYO intelligent assistant to the play format supported by the editing application, and perform a play preview on the content after the restoration of the finished draft, so as to better meet the needs of the user.

[0167] Figure 8 is a schematic diagram of a video generation method provided by the embodiments of this application. The video generation method provided by the embodiments of this application can be executed by an electronic device. It can be understood that the electronic device can be implemented as software, or a combination of software and hardware. Exemplarily, the electronic device in the embodiments of this application can be, but is not limited to, Figure 1 the electronic device 100 shown. The electronic device executing the video generation method provided by the embodiments of this application may include a first application and a second application. As Figure 8 shown, the video generation method provided by the embodiments of this application includes S810 and S820. Below, S810 and S820 will be introduced.

[0168] S810, the electronic device displays a first interface of the first application, where the first interface includes a first control and a first picture set.

[0169] The electronic device executing the video generation method provided by the embodiments of this application includes a first application and a second application, and no specific limitations are imposed on the names of the first application and the second application. In one example, the first application is a voice application and the second application is an editing application.

[0170] The first interface includes a first control and a first set of images. The images in the first set of images can be photos stored in the gallery of the electronic device. Optionally, the first interface may further include other content other than the first control and the first set of images, and no specific limitation is imposed on the other content. For example, the other content may be, but is not limited to, text information.

[0171] For example, the first interface may be as Figure 6 shown in the intelligent video creation interface S6. Please refer to Figure 6 , the text box 600 in the intelligent video creation interface S6 includes a plurality of picture materials and a video generation control 610.

[0172] Exemplarily, the electronic device in the above S810 may be the above Figure 5 shown terminal device, the first application in the above S810 may be the above Figure 5 shown YOYO intelligent assistant, the second application in the above S810 may be the above Figure 5 shown video editing application, and the first interface in the above S810 may be the above Figure 5 shown interface 1.

[0173] S820, in response to a triggering operation on the first control, after the electronic device calls the video creation service of the second application through the first application, the electronic device displays a second interface of the first application. Among them, the video creation service is used to obtain first video data generated according to the first set of images, and the second interface includes a thumbnail of the first video data.

[0174] The first video data is video data generated according to the first set of images, that is, the first video data is video data obtained by adding video effects to the first set of images. No specific limitation is imposed on the content included in the first video data. For example, the first video data may include a video generated based on the first set of images, a video cover, and a video duration. For example, the first video data may include a video generated based on the first set of images and a video cover.

[0175] The second interface includes a thumbnail of the first video data. For example, the thumbnail of the first video data may be the thumbnail shown in the text box 410 in the intelligent video creation interface S4A shown in (1) of Figure 4 . Optionally, the duration of the first video data may also be displayed on the thumbnail of the first video data. Optionally, the second interface may further include other information other than the thumbnail of the first video data. No specific limitation is imposed on the other information. For example, the other information may be, but is not limited to, the first set of images.

[0176] In the above S820, in response to a trigger operation on the first control, after the electronic device calls the video compilation service of the second application through the first application, the electronic device displays a second interface of the first application, which can be understood as the following: In response to a trigger operation on the first control, after the first application calls the video compilation service of the second application, the first application displays a second interface. That is to say, after the user triggers an operation on the first control in the first interface of the first application, the first application can automatically call the video compilation service of the second application.

[0177] In another example, the electronic device further includes a third application different from the first application, and the method further includes: The electronic device displays a fourth interface of the third application, where the fourth interface includes a second control and a second picture set; In response to a trigger operation on the second control, after the electronic device calls the video compilation service through the third application, the electronic device displays a fifth interface of the third application, where the video compilation service is further used to obtain second video data generated according to the second picture set, and the fifth interface includes a thumbnail of the second video data.

[0178] In response to a trigger operation on the second control, after the electronic device calls the video compilation service through the third application, the electronic device displays a fifth interface of the third application, which can be understood as the following: In response to a trigger operation on the second control, after the third application calls the video compilation service, the third application displays a fifth interface.

[0179] In the above implementation, when the third application in the electronic device meets certain conditions, the third application different from the first application can also call the video compilation service of the second application. The video compilation service of the second application is used to obtain second video data generated according to the second picture set in the background, so that the fifth interface of the third application that calls the second application can display a thumbnail of the second video data.

[0180] As an example of the present application, the electronic device further includes a media processing module, and in response to a trigger operation on the first control, after calling the video compilation service of the second application through the first application, displaying a second interface of the first application includes: In response to a trigger operation on the first control, the first application sends a video compilation instruction to the media processing module, where the video compilation instruction carries a first picture set; The media processing module determines a theme matching the first picture set according to the first picture set carried in the video compilation instruction, and sends the first picture set and the theme to the video compilation service, so that the video compilation service sends the first video data to the media processing module; After receiving the first video data, the media processing module sends the first video data to the first application; After receiving the first video data, the first application displays a second interface.

[0181] The second application described above may further include a video production pipeline module. In the step where the media processing module sends the first picture set and the theme to the video production service so that the video production service sends the first video data to the media processing module, exemplarily, the following steps may be included: The media processing module sends the first picture set and the theme to the video production service; the video production service sends a video production instruction to the video production pipeline module, where the video production instruction carries the first picture set and the theme; the video production pipeline module performs video production processing based on the first picture set and the theme to obtain third video data, where the format of the third video data is different from the format of the first video data; the video production pipeline module sends the third video data to the video production service; the video production service converts the third video data into the first video data and sends the first video data to the media processing module.

[0182] In the step where the above-mentioned video production pipeline module performs video production processing based on the first picture set and the theme to obtain third video data, where the format of the third video data is different from the format of the first video data, exemplarily, the following steps may be included: The video production pipeline module performs video production processing on the first picture set and the theme according to a plurality of preset processing nodes to obtain third video data, where the plurality of preset processing nodes may include a video template material node, a template matching node according to the theme, a parsed template material node, a parsed music rhythm node, a music usage and beat matching node, a special effect usage node, and a cover generation node.

[0183] The third video data is video data that conforms to the video data structure within the second application. For example, the third video data may include first picture materials, music, filters, transitions, end credits, video duration, and video cover information. For example, the third video data may include first picture materials, video duration, and video cover information.

[0184] Each of the above-mentioned plurality of preset processing nodes is used to execute a preset process corresponding to the function of each preset processing node. For example, taking the template matching node according to the theme as an example, the template matching node according to the theme is used to execute the process of matching a video template for the target theme to obtain a video template that matches the target theme.

[0185] Exemplarily, the above-mentioned video production service may be the Figure 5 shown automatic video production service, and the above-mentioned media processing module may be the Figure 5 shown media processing middle platform, and the above-mentioned first control may be the Figure 5 shown video generation control, and the above-mentioned video production instruction may be the Figure 5 shown video production instruction, and the above-mentioned first picture set may be the Figure 5 shown target picture materials, and the above-mentioned theme may be the Figure 5 shown target theme, and the above-mentioned first video data may be theFigure 5 The third video data may be the draft of the film shown. Figure 5 The video data 1 shown, the second interface can be the above Figure 5 Interface 2 is shown. For details not described in detail here, please refer to the above Figure 5 Related description in .

[0186] In an embodiment of the present application, after the electronic device displays a thumbnail including the first video data, the user can also trigger the electronic device to play the first video data. In one example, after displaying the second interface of the first application, the method further includes: in response to a triggering operation on the thumbnail of the first video data, the electronic device sends the first video data to the second application through the first application; after the second application processes the first video data, the electronic device displays a third interface, wherein the third interface is a preview playback interface of the first video data.

[0187] In the above implementation, the second application also includes a one-click blockbuster component, a restoration pipeline module and a video playback module, and, in response to a trigger operation on a thumbnail of the first video data, the first video data is sent to the second application through the first application, including: in response to a trigger operation on a thumbnail of the first video data, the first application sends the first video data to the one-click blockbuster component; after the second application processes the first video data, a third interface is displayed, including: the one-click blockbuster component converts the first video data into third video data, wherein the format of the first video data and the format of the third video data are different; the one-click blockbuster component sends a restoration instruction to the restoration pipeline module, wherein the restoration instruction carries the third video data; after the restoration pipeline module parses the third video data carried by the restoration instruction, the obtained parsing result is sent to the video playback module; in response to the video playback module loading the parsing result, the video playback module displays the third interface.

[0188] Exemplarily, the electronic device may be the Figure 7 The terminal device shown, the first application may be the Figure 7 The YOYO smart assistant shown, the second application can be the above Figure 7 The editing application shown, the one-key blockbuster component can be the above Figure 7 The one-key blockbuster activity component shown, the above-mentioned restoration pipeline module can be the above-mentioned Figure 7 The restored video pipeline module shown, the first video data can be the above Figure 7 The third video data may be the draft of the film shown. Figure 7 The video data 1 shown, the third interface can be the above Figure 7 The preview interface shown here, the content not described in detail here can be found above Figure 7 Related description in .

[0189] It should be understood that the above Figure 8 The video generation method shown is for illustration only and does not constitute any limitation to the video generation method provided in this application.

[0190] In an embodiment of the present application, after the user performs a trigger operation on the first control of the first interface of the first application, the first application can automatically call the film service of the second application, so that after the first application successfully calls the film service of the second application, the second interface of the first application displayed by the electronic device includes a thumbnail of the first video data generated by the film service of the second application. Since the step of acquiring the first video data is implemented by the film service of the second application, that is, the acquisition process is performed in the background of the electronic device, that is, the user is not aware of the acquisition process, this method avoids the problem of poor user visual experience existing in traditional technologies, and therefore, this method can improve the user experience. In addition, the second application located in the electronic device can restore the first video data acquired from the first application to data in a playback format supported by the second application (i.e., the third video data), and play and preview the analysis results corresponding to the third video data to better meet the needs of the user.

[0191] The present application also provides a computer program product, which, when executed by a processor, implements the video generation method described in any method embodiment of the present application.

[0192] The computer program product may be stored in a memory, for example, a program, which is finally converted into an executable target file that can be executed by a processor after preprocessing, compiling, assembling and linking.

[0193] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a computer, the video generation method described in any method embodiment of the present application is implemented. The computer program can be a high-level language program or an executable target program.

[0194] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can be represented by: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple.

[0195] It should be understood that in various embodiments of the present application, the sequence numbers of the above-mentioned processes do not imply the order of execution. The order of execution of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

[0196] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0197] Those skilled in the art can clearly understand that for the convenience and conciseness of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0198] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for example, the division of the units is only a logical function division, and there can be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces, and the indirect couplings or communication connections of devices or units can be in electrical, mechanical or other forms.

[0199] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they can be located in one place, or can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0200] In addition, the functional units in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit.

[0201] The above is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present application, and all should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A video generation method, characterized in that, Applied to an electronic device, the electronic device includes a first application and a second application, and the method includes: Display a first interface of the first application, where the first interface includes a first control and a first set of pictures; In response to a triggering operation on the first control, after the first application calls the video compilation service of the second application, display a second interface of the first application, where the video compilation service is used to obtain first video data generated according to the first set of pictures, and the second interface includes a thumbnail of the first video data.

2. The method according to claim 1, wherein After displaying the second interface of the first application, the method further includes: In response to a triggering operation on the thumbnail of the first video data, send the first video data to the second application through the first application; After the second application processes the first video data, display a third interface, where the third interface is a preview playback interface of the first video data.

3. The method according to claim 1 or 2, characterized in that, The electronic device further includes a third application different from the first application, and the method further includes: Display a fourth interface of the third application, where the fourth interface includes a second control and a second set of pictures; In response to a triggering operation on the second control, after the third application calls the video compilation service, display a fifth interface of the third application, where the video compilation service is further used to obtain second video data generated according to the second set of pictures, and the fifth interface includes a thumbnail of the second video data.

4. The method according to any one of claims 1 to 3, characterized in that, The electronic device further includes a media processing module, and, after responding to a triggering operation on the first control and the first application calls the video compilation service of the second application and displays the second interface of the first application, includes: In response to a triggering operation on the first control, the first application sends a first video compilation instruction to the media processing module, where the first video compilation instruction carries the first set of pictures; The media processing module determines a theme matching the first set of pictures according to the first set of pictures carried in the first video compilation instruction, and sends the first set of pictures and the theme to the video compilation service, so that the video compilation service sends the first video data to the media processing module; After receiving the first video data, the media processing module sends the first video data to the first application; After receiving the first video data, the first application displays the second interface.

5. The method according to claim 4, characterized in that, The second application further includes a video compilation pipeline module, and, the media processing module sends the first set of pictures and the theme to the video compilation service so that the video compilation service sends the first video data to the media processing module, includes: The media processing module sends the first set of pictures and the theme to the video compilation service; The video compilation service sends a second video compilation instruction to the video compilation pipeline module, where the second video compilation instruction carries the first set of pictures and the theme; The film assembly line module performs film processing based on the first picture set and the theme to obtain third video data, wherein the format of the third video data is different from the format of the first video data; The film assembly line module sends the third video data to the film service; The film forming service converts the third video data into the first video data and sends the first video data to the media processing module.

6. The method according to claim 2, wherein The second application also includes a one-click blockbuster component, a restoration pipeline module and a video playback module, as well as, The sending, in response to a triggering operation on a thumbnail of the first video data, the first video data to the second application through the first application includes: In response to a triggering operation on a thumbnail of the first video data, the first application sends the first video data to the one-key blockbuster component; After the second application processes the first video data, a third interface is displayed, including: The one-key blockbuster component converts the first video data into third video data, wherein the format of the first video data is different from the format of the third video data; The one-key blockbuster component sends a restoration instruction to the restoration pipeline module, wherein the restoration instruction carries the third video data; The restoration pipeline module parses the third video data carried by the restoration instruction and sends the parsing result to the video playback module; In response to the video playback module loading the parsing result, the video playback module displays the third interface.

7. The method according to any one of claims 1 to 6, characterized in that The first application is a voice application, and the second application is a clipping application.

8. An electronic device, characterized in that, The electronic device comprises: one or more processors, and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code comprises computer instructions, and the one or more processors call the computer instructions so that the electronic device executes the method as described in any one of claims 1 to 7.

9. A chip system, characterized in that, The chip system is applied to an electronic device, and the chip system includes one or more processors, and the one or more processors are used to call computer instructions so that the electronic device executes the method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium comprises instructions, which, when executed on an electronic device, cause the electronic device to perform the method as claimed in any one of claims 1 to 7.

Images