Background music replacement method, electronic equipment and storage medium

Abstract

The embodiment of the invention relates to the technical field of terminals, in particular to a background music replacement method, electronic equipment and a storage medium. According to the method, the electronic equipment can respond to the selection operation of the second music option, and different background music, such as the second background music and the third background music, can be replaced for the video to be edited. Moreover, the electronic equipment can also change fixed background music, such as the first background music, for the to-be-edited video in response to the selection operation on the first music option. In other words, the electronic device can switch diversified background music for the edited video through the second music option. Therefore, the electronic equipment can provide diversified background music for editing. Thus, in the process that the user uses the electronic equipment to clip, the user can flexibly switch diversified background music for the video to be clipped through the second music option, and the user can obtain better use experience.

Description

[0001] This application claims the priority of the Chinese patent application filed with the State Intellectual Property Office on November 3, 2023, with application number 202311465355.3 and invention name “A video production method based on large models”, all contents of which are incorporated by reference in this application. Technical Field

[0002] The embodiments of the present application relate to the field of terminal technology, and in particular to a method for replacing background music, an electronic device, and a storage medium. Background Art

[0003] With the development of terminal technology, users use electronic devices more and more frequently, and users will use electronic devices to take pictures. After the electronic device captures the captured image, the electronic device can generate a video based on the captured image and edit the video, such as adding background music, adding motion effects, adding text, etc. to the video to generate an edited image.

[0004] Currently, when users use electronic devices to edit videos, the background music provided by the electronic devices is relatively fixed and cannot provide diversified background music for editing. Summary of the invention

[0005] The embodiments of the present application provide a background music replacement method, an electronic device, and a storage medium, which can provide a variety of background music for editing, thereby improving the user experience.

[0006] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0007] In the first aspect, an embodiment of the present application provides a method for replacing background music, which can be applied to an electronic device. The electronic device can be an electronic device with the ability to display images, such as a mobile phone, a tablet computer, etc. In the method, the electronic device displays a first editing interface, and the electronic device plays a video to be edited with a first background music in the first editing interface, and the first editing interface also includes a music control. Next, in response to a first trigger operation on the music control, the electronic device displays a second editing interface, and the second editing interface includes a first music option and a second music option, and the first music option indicates the first background music. In the process of the electronic device displaying the second editing interface: in response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music; in response to the selection operation of the first music option, the electronic device plays the video to be edited with the first background music; in response to the selection operation of the second music option, the electronic device plays the video to be edited with the third background music. The third background music is different from the second background music.

[0008] In the above method, the electronic device can replace different background music for the video to be edited, such as the second background music and the third background music, in response to the selection operation of the second music option. And, the electronic device can also replace the fixed background music for the video to be edited, such as the first background music, in response to the selection operation of the first music option. In other words, the electronic device can switch a variety of background music for the edited video through the second music option. Thus, the electronic device can provide a variety of background music for editing. In this way, when the user uses the electronic device to edit, the user can flexibly switch a variety of background music for the video to be edited through the second music option, and the user will get a better user experience.

[0009] In a possible design of the first aspect, in response to a selection operation on a second music option, the electronic device plays the video to be edited with a third background music, including: after the electronic device plays the video to be edited with the second background music, when the number of times the electronic device switches the background music in response to the selection operation on the second music option is less than a first number, the electronic device plays the video to be edited with the third background music in response to the selection operation on the second music option.

[0010] In this design, the electronic device can change the background music switched by the selection operation of the second music option according to the number of selection operations on the second music option. It can be seen that the electronic device can provide a variety of background music for editing.

[0011] In another possible design of the first aspect, the method further includes: after the electronic device plays the video to be edited with the second background music, if the number of times the electronic device switches the background music in response to the selection operation of the second music option is greater than or equal to the first number, the electronic device plays the video to be edited with the second background music in response to the selection operation of the second music option.

[0012] In this design, the electronic device can switch the background music of the video to be edited back to the previous background music, such as the second background music, according to the number of times the second music option is selected. It can be seen that the electronic device can provide a variety of background music for editing.

[0013] In another possible design of the first aspect, in response to the selection operation of the second music option, playing the video to be edited with the second background music includes: when the electronic device meets the first condition, in response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music. The first condition includes: the electronic device is connected to the network; or the first condition includes: the electronic device is not connected to the network, and the number of times the background music is switched in response to the selection operation of the second music option reaches a first number.

[0014] In this design, the electronic device can play the video to be edited with the second background music according to the network status. In other words, the electronic device can provide a variety of background music for editing.

[0015] In another possible design of the first aspect, in response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music, including: when the electronic device is not connected to the network and the number of times the background music is switched in response to the selection operation of the second music option is less than the first number, the electronic device displays a network connection prompt in response to the selection operation of the second music option. Next, in response to the operation of connecting to the network, the electronic device establishes a network connection. After connecting to the network, the electronic device displays a second editing interface, and plays the video to be edited with the second background music in the second editing interface.

[0016] In another possible design of the first aspect, after the electronic device displays an Internet connection prompt, the method further includes: in response to confirming an operation of being disconnected from the Internet, the electronic device plays the video to be edited with the first background music in the second editing interface.

[0017] In this design, the electronic device can play the video to be edited with the first background music or the video to be edited with the second background music according to the network status of the electronic device. It can be seen that the electronic device can flexibly change the background music for the video to be edited according to the network status; then, the electronic device can provide a variety of background music for editing.

[0018] In another possible design of the first aspect, the second editing interface further includes a first return control. After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: in response to the second trigger operation of the first return control, the electronic device displays the first editing interface, and plays the video to be edited with the first background music in the first editing interface. Thereafter, in response to the third trigger operation of the music control, the electronic device displays the second editing interface, and plays the video to be edited with the first background music in the second editing interface.

[0019] In this design, the electronic device can respond to the triggering operation of the return control without saving the change of the background music of the video to be edited.

[0020] In another possible design of the first aspect, the second editing interface further includes a save control. After the electronic device plays the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: in response to a fourth trigger operation on the save control, the electronic device displays the first editing interface, and plays the video to be edited with the third background music in the first editing interface. Next, in response to a fifth trigger operation on the music control, the electronic device displays the second editing interface, and plays the video to be edited with the third background music in the second editing interface.

[0021] In this design, the electronic device can save the changes to the background music of the video to be edited in response to a trigger operation on the save control.

[0022] In another possible design of the first aspect, the first editing interface further includes a second return control. After the electronic device displays the first editing interface in response to the second trigger operation on the first return control, the method further includes: in response to the sixth trigger operation on the second return control, the electronic device displays a third interface, the third interface including an editing entry for the video to be edited. Next, in response to the seventh trigger operation on the editing entry, the electronic device displays the first editing interface, and plays the video to be edited with the first background music in the first editing interface.

[0023] In another possible design of the first aspect, the electronic device includes a protocol switch. In response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music, including: when the protocol switch is turned on, in response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music.

[0024] In another possible design of the first aspect, in response to the selection operation of the second music option, playing the video to be edited with the second background music includes: when the protocol switch is turned off, in response to the selection operation of the second music option, the electronic device displays a prompt to turn on the protocol switch. Afterwards, in response to the operation of turning on the protocol switch, the electronic device turns on the protocol switch. After the protocol switch is turned on, the electronic device displays a second editing interface, and plays the video to be edited with the second background music in the second editing interface.

[0025] In another possible design of the first aspect, after displaying a prompt to turn on the protocol switch, the method further includes: in response to confirming an operation not to turn on the protocol switch, the electronic device plays the video to be edited with the first background music in the second editing interface.

[0026] In another possible design of the first aspect, the electronic device includes a protocol switch. In response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music, which may include: when the electronic device meets the second condition: in response to the selection operation of the second music option, the electronic device displays a prompt to turn on the protocol switch. Afterwards, in response to the operation of starting the protocol switch, the electronic device turns on the protocol switch. After the protocol switch is turned on, the electronic device displays a network connection prompt. In response to the operation of connecting to the network, the electronic device establishes a network connection. After connecting to the network, the electronic device displays a second editing interface, and plays the video to be edited with the second background music in the second editing interface. Among them, the above-mentioned second condition includes: the electronic device is not connected to the network, and the protocol switch is not turned on.

[0027] In this design, under the second condition, the electronic device first displays a prompt to turn on the protocol switch, and then displays a prompt to connect to the Internet; thus, it can be more in line with the user's operating logic and can improve the user's experience.

[0028] In another possible design of the first aspect, the second editing interface further includes a save control. After the electronic device plays the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: in response to the eighth trigger operation of the save control, the electronic device displays the first editing interface; the first editing interface also includes the first editing control. Next, in response to the ninth trigger operation of the first editing control, the electronic device displays the third editing interface, plays the video to be edited with the third background music in the third editing interface, and the audio track of the third background music; the third editing interface includes the third music option. Afterwards, in response to the selection operation of the third music option, the electronic device plays the video to be edited with the third background music and the second background music, and displays the audio track of the second background music in the third editing interface.

[0029] In this design, the electronic device can set the background music of the video to be edited to multiple diverse background music in the third editing interface, such as the second background music and the third background music. In this way, the electronic device can provide diverse background music for editing.

[0030] In another possible design of the first aspect, in response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music, including: in response to the selection operation of the second music option, the electronic device displays the first music cover and / or the first music name in the second music option, and plays the video to be edited with the second background music; the first music cover and / or the first music name indicate the second background music. And, in response to the selection operation of the second music option, the electronic device plays the video to be edited with the third background music, including: in response to the selection operation of the second music option, the electronic device displays the second music cover and / or the second music name in the second music option, and plays the video to be edited with the third background music; the second music cover and / or the second music name indicate the third background music.

[0031] In this design, the electronic device can allow the user to visually and intuitively feel the switching of the background music of the video to be edited through the music cover or the music name.

[0032] According to a second aspect, an electronic device is provided, comprising a memory and one or more processors, wherein the memory is coupled to the processor; wherein computer program code is stored in the memory, and the computer program code comprises computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method provided by the first aspect and any possible design of the first aspect.

[0033] According to a third aspect, a computer-readable storage medium is provided, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method provided by the first aspect and any possible design of the first aspect.

[0034] According to a fourth aspect, a computer program product comprising instructions is provided. When the computer program product is run on an electronic device, the electronic device can execute the method provided by the first aspect and any possible design of the first aspect.

[0035] Among them, the technical effects brought about by any design method in the second to fourth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 A schematic diagram of a usage scenario provided for an embodiment of the present application;

[0037] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0038] Figure 3 A schematic diagram of a software architecture provided for an embodiment of the present application;

[0039] Figure 4 A flowchart of a method for replacing background music provided in an embodiment of the present application;

[0040] Figure 5 A schematic diagram of a process for generating clipping materials provided in an embodiment of the present application;

[0041] Figure 6 A set of interface schematic diagrams provided for embodiments of the present application;

[0042] Figure 7 A schematic diagram of an interface provided in an embodiment of the present application;

[0043] Figure 8 Another set of interface schematic diagrams provided for embodiments of the present application;

[0044] Fig. 9 Another set of interface schematic diagrams provided for embodiments of the present application;

[0045] Fig.10 Another set of interface schematic diagrams provided for embodiments of the present application;

[0046] Fig.11 Another set of interface schematic diagrams provided for embodiments of the present application;

[0047] Fig.12 Another set of interface schematic diagrams provided for embodiments of the present application;

[0048] Fig.13 Another set of interface schematic diagrams provided for embodiments of the present application;

[0049] Fig.14 Another set of interface schematic diagrams provided for embodiments of the present application;

[0050] Fig.15 Another set of interface schematic diagrams provided for embodiments of the present application;

[0051] Fig.16 Another set of interface schematic diagrams provided for embodiments of the present application;

[0052] Fig.17 Another set of interface schematic diagrams provided for embodiments of the present application;

[0053] Fig.18 A schematic diagram of the structure of an electronic device is provided for an embodiment of the present application. DETAILED DESCRIPTION

[0054] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship, for example, A / B can represent A or B; "and / or" in the present application is only a kind of association relationship describing the associated objects, indicating that there can be three relationships, for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. And, in the description of the embodiments of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or its similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish the same items or similar items with substantially the same functions and effects. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit the difference.

[0055] Meanwhile, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0056] In the technical solutions disclosed in this application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved are in compliance with the relevant laws and regulations and do not violate public order and good morals.

[0057] With the development of terminal technology, users use electronic devices more and more frequently, and users will use electronic devices to take pictures. After the electronic device captures the captured image, the electronic device can perform audio / video editing on the captured image, such as combining multiple photos into a video, adding background music, adding motion effects, adding text, combining photos and videos, etc., where the captured image includes: photos and / or videos. It can be understood that in actual use, the above-mentioned audio / video editing can also have more functions, and specifically, it can be set according to actual usage requirements. For the convenience of the following description, the above-mentioned audio / video editing can be referred to as editing.

[0058] In some scenarios, when a user uses an electronic device to perform editing, the electronic device can only provide relatively fixed background music.

[0059] For example, the electronic device may be pre-configured with a background music library, and a corresponding music control may be configured for each background music in the background music library. In response to a trigger operation on the music control, the electronic device may set the background music corresponding to the music control in the background music library as the background music of the video. Since the background music in the background music library is relatively fixed and single, the electronic device cannot provide a variety of background music for editing.

[0060] In view of this, an embodiment of the present application provides a method for changing background music, in which the electronic device can provide multiple different background music for the user to use through a music control; that is, the user can select different background music through the above-mentioned music control. Since the electronic device can provide multiple different background music through a music control, the electronic device can provide a variety of background music for editing.

[0061] For example, see Figure 1 The technical solution provided by the embodiment of the present application can be applied to the process of a user editing using the electronic device 100. It is particularly applicable to the process of a user editing the editing material generated by the "Moment" function on the electronic device. The "Moment" function of the electronic device can search for the captured image from the album according to the time or place where the user took the photo / video, and obtain the editing material based on the captured image.

[0062] The electronic device 100 may also be referred to as a terminal, terminal equipment, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The electronic device 100 may be a mobile phone, tablet computer, wearable device, smart screen, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), etc., which have a display screen; it may also be a vehicle-mounted device with a display screen such as a vehicle-mounted computer, a vehicle-mounted computer, etc.; it may also be some smart watches, smart bracelets, etc., which are IoT devices with a display screen. The embodiments of the present application do not impose any restrictions on the product form of the electronic device.

[0063] Next, the hardware structure and software architecture of the electronic device provided in the embodiments of the present application are introduced.

[0064] Figure 2 The hardware structure diagram of the electronic device 100 is shown, and the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180K, etc.

[0065] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0066] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0067] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0068] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0069] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0070] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0071] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0072] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0073] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0074] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0075] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0076] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0077] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0078] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with other devices through wireless communication technology and network.

[0079] For example, the electronic device 100 may obtain clipping materials generated by other devices through the antenna 1 and the mobile communication module 150 , or through the antenna 2 and the wireless communication module 160 .

[0080] Next, the software architecture of the electronic device 100 is introduced. The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0081] Figure 3 1 is a schematic diagram of the software structure of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer.

[0082] The application layer can include a series of application packages.

[0083] like Figure 3 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0084] Among them, the gallery is used to provide functions such as viewing photos, videos, generating editing materials and editing the editing materials.

[0085] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0086] like Figure 3 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0087] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0088] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0089] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0090] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0091] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0092] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0093] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0094] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0095] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0096] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0097] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0098] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0099] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0100] A 2D graphics engine is a drawing engine for 2D drawings.

[0101] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0102] The electronic device is a mobile phone, which has the above Figure 2 The hardware structure and Figure 3 Taking the software architecture shown as an example, the method for replacing background music provided in the embodiment of the present application is introduced.

[0103] For example, see Figure 4 The background music replacement method provided in the embodiment of the present application may include steps S400-S404.

[0104] S400. Get editing materials through mobile phone.

[0105] As a possible implementation, the mobile phone can generate editing materials according to the shooting time and shooting location of the photo or video. In some embodiments, the above-mentioned editing materials can also be called "moments", "wonderful moments" or videos to be edited.

[0106] For example, see Figure 5 , the shooting time of photo A is relatively close to the shooting time of photo B, such as, the time difference between the two is less than or equal to the preset duration threshold 1, then photo A and photo B are added to editing material A. The shooting location of photo B is relatively close to the shooting location of video A, such as, the distance between the two is less than or equal to the preset distance threshold 1, then photo B and video A are added to editing material A. Among them, the above-mentioned duration threshold 1 can be 1 hour, 2 hours, 4 hours, etc. The above-mentioned distance threshold 1 can be 1 kilometer, 2 kilometers, 4 kilometers, etc. Specifically, the above-mentioned duration threshold 1 and distance threshold 2 can be set according to actual usage requirements, and the embodiments of the present application do not impose any restrictions on this.

[0107] As another possible implementation, after the mobile phone searches for the editing material from the album, the mobile phone can also pre-edit the editing material. For example, according to a preset editing template, background music, transition effects, filters, etc. are automatically added to the photos or videos included in the editing material.

[0108] For example, see again Figure 5 After the mobile phone generates the clip material A, the mobile phone can also pre-cut the clip material A to obtain the clip material B. In the clip material B: photo A is displayed for 10 seconds and photo B is displayed for 5 seconds; and background music is accompanied during the display of photos A and B; then, after the transition effect, video A is displayed; among them, photo B has a filter.

[0109] In some embodiments, the mobile phone can generate tags according to the content of the photos or videos included in the clipping material, and obtain the background music, transition effects, filters, etc. that match the tags according to the tags. Next, the mobile phone pre-cuts the clipping material searched by the mobile phone according to the background music, transition effects, filters, etc. that match the tags.

[0110] It should be understood that the mobile phone can perform image recognition on the photos or videos on the mobile phone, identify the content of the photos or videos to obtain labels. Among them, the labels can be used to characterize the style, atmosphere, and content of the photos or videos. The specific implementation of this process can refer to the relevant technology, and the embodiments of this application will not be described in detail.

[0111] In some embodiments, the process of the mobile phone searching for clipping materials from the album and pre-cutting the clipping materials can be called a "moment" function, and the clipping materials can also be called wonderful moments. That is, the mobile phone can generate clipping materials through the "moment" function.

[0112] In some other embodiments, the mobile phone can also obtain editing materials from other devices (such as the cloud). For example, the mobile phone can obtain the editing materials under the user account from the cloud through the user account logged in by the mobile phone. It should be understood that the cloud can also generate editing materials through the photos and / or videos under the user account; the specific process of generating editing materials in the cloud can be referred to above. Figure 5 The corresponding description is not limited in any way in the embodiments of the present application.

[0113] It should be understood that in the embodiment of the present application, the mobile phone can also have more ways to obtain the editing material, for example, downloading the editing material from the network, or the user manually editing and generating the editing material, etc. The specific implementation process can be referred to the relevant technology, which will not be repeated here.

[0114] S401. The mobile phone displays the first editing interface.

[0115] It should be understood that the above-mentioned editing interface is an interface used to edit the above-mentioned editing materials, for example, combining multiple photos included in the above-mentioned editing materials into a video, adding background music to the above-mentioned editing materials, adding motion effects to the above-mentioned editing materials, adding text to the above-mentioned editing materials, etc.

[0116] As a possible implementation, in response to a click operation on a clipping material in a gallery application, the mobile phone displays a clipping interface.

[0117] For example, the user can instruct the mobile phone to open the gallery application by touching a specific control on the mobile phone screen, pressing a specific physical key or key combination, inputting voice, making air gestures, etc. The gallery application is also called an album, photo, etc. In response to receiving the user's instruction to open the gallery, the mobile phone displays the gallery main interface.

[0118] For example, see Figure 6 , the mobile phone displays the desktop 600. In response to the click operation on the icon 601 corresponding to the gallery application, the mobile phone displays the main interface 610 of the gallery application. The main interface 610 of the gallery application displays thumbnails of multiple pictures, thumbnails of multiple videos, and option buttons, such as the "Moments" option button 611.

[0119] Next, in response to a click operation on the "Moment" option button 611 in the main interface 610 of the gallery application, the mobile phone displays the "Moment" option menu 620 of the gallery application. The "Moment" option menu 620 of the gallery application displays a search box, option buttons, and thumbnails 621 of clip materials. In the "Moment" option menu 620, the text description corresponding to the moment option is filled with a slash to indicate the selected state.

[0120] Then, in response to a click operation on the thumbnail 621 of the clip material, the mobile phone displays the first clip interface 630. The first clip interface 630 includes: clip material 631, play control 632, clip menu 633, function button 634, exit button 635, etc. Among them, the play control 632 is used to control the playback parameters of the clip material 631, such as controlling the pause, play, volume, play progress, etc. of the clip material 631. The clip menu 633 is used to provide multiple clip options for the user to choose. The multiple clip options may include: template option 633a, music option 633b, filter option 633c and album option 633d. The function button 634 is used to provide multiple function options for the user to choose. The multiple function options may include: deep clip 634a, share 634b and expansion option 634c. The exit button 635 is used to provide the user to exit the current clip interface and return to display the "moment" option menu 620 of the gallery application. In some embodiments, the first clip interface may be referred to as the first clip interface. The above-mentioned music options may be referred to as music controls.

[0121] It should be noted that the above-mentioned editing menu 633 may include Figure 6 The names and / or icons of the included editing options may also be different. For example, a template may also be called a theme, a background, etc., without any limitation. Similarly, the function button 634 may also include more than Figure 6 More or fewer functional options may be shown in the figure, and the names and / or icons of the included functional options may also be different, without any limitation. Figure 6 In the following figures of the embodiments of the present application, for the underlined characters in the figures, for example, Figure 6634a, 634b, etc. are all reference numerals and should not be understood as elements in the display screen of the mobile phone.

[0122] Specifically, the template option 633a may provide editing templates for the user to select, and each editing template may include pre-set filters, transitions, music, texts, special effects, etc. The user may add an editing template to the clip material 631 through the template option 633a, that is, add filters, transitions, music, texts, special effects, etc. to the clip material 631 according to the editing template.

[0123] The music option 633b can provide multiple pieces of music for the user to choose from, and add background music to the clipped material.

[0124] The filter option 633c can provide a variety of filters for the user to choose from. By changing the filter, the color tone of the clip material can be changed, such as cold tone, warm tone, black and white tone, etc.

[0125] The album option 633d can provide the user with the ability to view the photos or videos included in the clip material 631 , as well as to add photos, add videos, delete photos, delete videos, and so on to the clip material 631 .

[0126] Compared with the above-mentioned first editing interface, deep editing 634a can provide more comprehensive and rich editing functions for users to edit editing materials.

[0127] For example, in response to a click operation on the depth clip 634a, the mobile phone displays a depth clip interface. Specifically, please refer to the following for a detailed description of the depth clip interface, which will not be repeated here.

[0128] Share 634b can provide multiple sharing channels for users to choose from. Users can analyze the editing materials to other software through the analysis channel.

[0129] The extended option 634c can provide the user with extended operations such as saving and renaming the above-mentioned editing material 631.

[0130] It should be noted that in some embodiments, in the first editing interface 630, the editing material 631 may be automatically played. That is, in response to a click operation on the thumbnail 621 of the editing material, the mobile phone displays the first editing interface 630, and the editing material 631 included in the first editing interface 630 is being played; and the background music of the editing material 631 is the background music added to the editing material 631 when the editing material is generated, such as the template default background music.

[0131] As another possible implementation, after the mobile phone obtains the editing material, the mobile phone can display a notification message, which includes a text description for prompting the user. Next, in response to the user clicking on the notification message, the mobile phone displays the editing interface. The notification message can be displayed on the mobile phone in the form of push, card, drop-down menu bar, etc. The embodiment of the present application does not impose any restrictions on the display form of the notification message.

[0132] For example, see Figure 7 After the mobile phone executes step S400, the mobile phone displays the notification message. For example, the notification message 701 is displayed in a push display form on the mobile phone desktop 700. Next, in response to the click operation on the notification message 701, the mobile phone displays the above Figure 6 The first editing interface 630 in.

[0133] After executing step S401, the mobile phone executes step S402.

[0134] S402. In response to a click operation on the first interface element, the mobile phone displays a second editing interface.

[0135] Among them, the first interface element can be the above Figure 6 Interface elements corresponding to the music option 633b in the first editing interface 630 are shown.

[0136] As a possible implementation, see Figure 6 and Figure 8 In response to the click operation on the music option 633b, the mobile phone displays the second editing interface 800. The second editing interface 800 includes: editing material 801, music material control 802, music material control menu 803 and play control 804. The user can change different background music for the editing material 801 through the second editing interface.

[0137] The music material control 802 is used to provide different music material controls for users to use. For example, the music material control 802 includes: the first music material control 802a, the first local music material control 802b, the second local music material control 802c and the third local music material control 802d, etc. Among them, the first music material control 802a is used to provide an entrance for triggering the mobile phone to generate artificial intelligence (AI) music. The above-mentioned local music material controls (such as the first local music material control 802b, the second local music material control 802c, and the third local music material control 802d) correspond to local music. The music material control menu 803 is used to classify the music material controls to provide different types of music material controls for users to use. For example, the music material control menu 803 may include: collection 803a, recommendation 803b, local 803c and music library 803d. The playback control 804 is used to control the playback parameters of the clip material 801. The generation process of AI music can be referred to the steps in the following embodiments, which will not be repeated here.

[0138] It should be understood that the above AI music is random and is generated based on the tags in the clip material. In some other embodiments, it can also be replaced with other music, such as music generated by some music generation algorithms, some music synthesized by music synthesis algorithms on local music, etc. Specifically, it can be designed according to actual usage requirements, and the embodiments of this application do not limit this.

[0139] It should be noted that after the mobile phone displays the second editing interface, the above-mentioned editing material 801 may be in a playing state, such as playing the editing material 801 with the template default music corresponding to the first local music material control 802b as the background music; the user can control the playing progress of the editing material 801, pause the playing of the editing material 801, etc. through the play control 804. Among them, the above-mentioned recommendation 803b is in a selected state, and the above-mentioned first local music material control 802b is indicated by a relatively thick border as being in a selected state. In some other embodiments, after the mobile phone is triggered to display the second editing interface, the editing material 801 may also be in a waiting state, for example, paused at the first frame of the editing material 801. Afterwards, in response to the triggering operation for the play control 804, the mobile phone plays the above-mentioned editing material with the template default music corresponding to the first local music material control 802b as the background music. It can be understood that the above-mentioned response to the triggering operation for the play control 804 can be to click the play button in the play control 804.

[0140] As another possible implementation, see Figure 6 and Figure 8In response to the click operation on the music option 633b, the mobile phone displays the second editing interface 810. In some scenarios, if the user has not used the AI ​​music function before the user triggers the mobile phone to display the interface 810, that is, the user uses the AI ​​music function for the first time, then in the second editing interface 810, a "new" icon is displayed on the interface element corresponding to the AI ​​created music 812a.

[0141] The user has not used the AI ​​music function, which can be understood as the user has not used the above-mentioned AI music creation before triggering the mobile phone to display the second editing interface; for example, the user has not clicked the interface element corresponding to the AI ​​music creation 812a in the second editing interface 810. It should be understood that the mobile phone can record whether the user uses the AI ​​music function for the first time through the configuration table; if the user uses the AI ​​music function for the first time, the "new" icon is displayed on the interface element corresponding to the AI ​​music creation.

[0142] In this embodiment, by displaying a "new" icon on the interface element corresponding to AI music creation, the user can directly perceive in the second editing interface that the new AI music function has been added, which can enhance the user experience.

[0143] Optionally, the second editing interface 810 may further include a favorite button 815, which is used to trigger a favorite operation on the currently selected music material control. It should be understood that after the music material control is favorited, the mobile phone can view the music in the favorites menu.

[0144] It should be understood that Figure 8 The “new” icon in the second editing interface 810 shown is only an example, and may have other forms in actual use, and the embodiments of the present application do not impose any limitations on this.

[0145] S403. In response to the click operation on the second interface element, the mobile phone displays the third editing interface.

[0146] Among them, the second interface element can be the above Figure 8 The interface element corresponding to the AI ​​music creation 802a in the second editing interface 800 shown in FIG. Figure 8 Interface elements corresponding to the AI ​​composed music 812a in the second editing interface 810 are shown.

[0147] It should be understood that one of the purposes of the above-mentioned click operation on the second interface element is to trigger the background music of the clip material to be replaced with AI music. In some other embodiments, it can also be replaced with other operations, such as voice commands input by the user, etc., and the embodiment of the present application does not impose any restrictions on this.

[0148] As a possible implementation, in response to a click operation on the second interface element, the mobile phone sends an AI music generation request based on the tag of the editing material, so that the mobile phone can obtain AI music generated locally on the mobile phone, or the mobile phone can obtain AI music generated in the cloud. Next, in response to receiving the AI ​​music, the mobile phone displays the third editing interface.

[0149] Among them, the label of the clip material can be obtained by the label of the photo included in the clip material or the label of the video included in the clip material. Exemplarily, the mobile phone can be deployed with an AI music model locally, and the mobile phone can generate AI music based on the AI ​​music model and the AI ​​music generation request. Alternatively, the mobile phone can also send the above-mentioned AI music generation request to other devices (such as the cloud) that have established a communication connection with the mobile phone, and other devices send AI music generated by other devices to the mobile phone in response to the above-mentioned AI music generation request.

[0150] It is understandable that there may be other more AI music generation processes in specific applications; specifically, regarding the AI ​​music generation process, please refer to the relevant technology, and the embodiments of this application do not impose any limitations on this.

[0151] In some embodiments, it is considered that it takes a certain amount of time to generate AI music locally or in the cloud; therefore, in these embodiments, the mobile phone can also display the fourth editing interface before displaying the third editing interface. That is, in response to the click operation on the second interface element, the mobile phone displays the fourth editing interface, which is used to show the status of AI music being created; while the mobile phone displays the fourth editing interface, the mobile phone waits for the AI ​​music to be generated; next, in response to the mobile phone obtaining the AI ​​music, that is, the AI ​​music is generated, the mobile phone displays the third editing interface.

[0152] In this embodiment, the mobile phone can display the fourth editing interface to enable the user to feel the process of the mobile phone creating AI music, which can enhance the user's immersion in using the editing interface and improve the user's experience.

[0153] For example, see Fig. 9, in response to the click operation on the second interface element, the mobile phone sends an AI music generation request and displays the fourth editing interface 900. The fourth editing interface 900 includes: editing material 901, music material control 902 and play control 904. The music material control 902 includes the first music material control 902a. Among them, the first music material control 902a is in a selected state, and the relative position of the first music material control 902a in the fourth editing interface 900 is the same as the relative position of the above-mentioned second interface element in the second editing interface 800; the first music material control 902a is used to show the state of AI music being created. For example, the first music material control 902a shows the state of AI music being created through an icon (cover) with loading content; for another example, the first music material control 902a shows the state of AI music being created through the text description of "Creating..."

[0154] It should be noted that the editing material 901 in the fourth editing interface 900 and the editing material 801 in the second editing interface 800 are played continuously; accordingly, the play control 904 in the fourth editing interface 900 and the play control 804 in the second editing interface 800 have a corresponding relationship. For example, in the second editing interface 800, when the editing material 801 is played to 00:06, the user clicks the second interface element, triggering the mobile phone to display the fourth editing interface 900; then, in the fourth editing interface 900, the editing material 901 is played continuously at 00:06; accordingly, in the fourth editing interface 900, the progress bar of the play control 804 is also at 00:06. At the same time, since the AI ​​music has not been generated (or is in the process of being generated) when the mobile phone is in the fourth editing interface 900, the background music of the editing material 901 is the same as the background music of the editing material 801 in the second editing interface 800, such as the template default music.

[0155] For example, see again Fig. 9In response to obtaining the AI ​​music, the mobile phone displays the third editing interface 910. The third editing interface 910 includes: editing material 911, music material control 912 and play control 914. The music material control 912 includes the second music material control 912a. Among them, the second music material control 912a is in a selected state, and the relative position of the second music material control 912a in the fourth editing interface 910 is the same as the relative position of the first music material control 902a in the fourth editing interface 900; the second music material control 912a is used to display AI music, and provides the user with the option of setting the background music of the editing material 911 to the AI ​​music corresponding to the second music material control 912a. For example, the second music material control displays AI music through a preset icon (cover); for another example, the second music material control displays AI music through a text description of "AI created music 1".

[0156] It should be noted that since the user triggers the switching of the background music of the clip material through the second interface element, the clip material 911 can be replayed in the third editing interface 910, for example, the clip material 911 starts playing from 00:00; correspondingly, the play control 904 in the third editing interface 910 is also in the replay state, for example, the progress bar of the play control 904 starts from 00:00. In addition, the background music of the clip material 911 is the AI-created music 1 corresponding to the second music material control 912a.

[0157] In some embodiments, the third editing interface may further include a plurality of local music material controls corresponding to local music; thus, the user may also trigger switching of the background music of the editing material to local music in the third editing interface.

[0158] For example, see again Fig. 9 The third editing interface 910 includes: editing material 911, music material control 912 and play control 914. The music material control 912 includes a second music material control 912a corresponding to AI music and a plurality of local music material controls corresponding to local music. The local music material controls include: a first local music material control 912b, a second local music material control 912c and a third local music material control 912d.

[0159] It should be understood that in some embodiments, the AI ​​music generated by the AI ​​music model may not have a cover, that is, the AI ​​music obtained by the mobile phone does not have a cover, but only includes music content and logo; therefore, several covers can be preset and displayed in the third editing interface 910, which can enhance the user experience.

[0160] In other embodiments, the above-mentioned AI music may be provided by other third-party suppliers. Therefore, by presetting a cover including the logo of the third-party supplier, users can feel that the AI ​​music is provided by the third-party supplier, which can meet the brand promotion needs of the third-party supplier.

[0161] It is understandable that in some other embodiments, AI music can be generated in advance, such as when the generation time of AI music is relatively short, or when the above-mentioned editing material is generated, the AI ​​music is generated according to the label of the editing material; then, the mobile phone may not display the 4th editing interface, but directly display the 3rd editing interface, and the embodiments of the present application are not limited to this. Alternatively, in some other embodiments, even if the AI ​​music is generated in advance, the mobile phone can display the 4th editing interface of a preset duration, such as 3 seconds or 5 seconds, and then the mobile phone displays the above-mentioned 3rd editing interface. This allows users to feel the process of the mobile phone creating AI music, enhances the user's sense of immersion in using the editing interface, and enhances the user's experience.

[0162] In some scenarios, if the user has not authorized (signed) the relevant user agreement and / or privacy agreement before step S403, the mobile phone can display an agreement pop-up window in step S403, and the agreement pop-up window is used to provide the user with authorization (signing) for the relevant user agreement and / or privacy agreement. Next, after the user authorizes (signs) the relevant user agreement and / or privacy agreement, the mobile phone displays the third editing interface mentioned above, or the user displays the third editing interface after displaying the fourth editing interface mentioned above.

[0163] It should be understood that the mobile phone may include a protocol switch, and whether the user authorizes (signs) the relevant user agreement and / or privacy agreement can be characterized by the state of the protocol switch. For example, if the protocol switch is turned on, it means that the user authorizes (signs) the relevant user agreement and / or privacy agreement. For another example, if the protocol switch is turned off, it means that the user does not authorize (sign) the relevant user agreement and / or privacy agreement.

[0164] As a possible implementation, the mobile phone can determine whether the user has authorized (signed) the relevant user agreement and / or privacy agreement through the user agreement flag. For example, if the user has signed the relevant user agreement and / or privacy agreement, the user agreement flag is set to 1; if the user has not signed the relevant user agreement and / or privacy agreement, the user agreement flag is set to 0.

[0165] For example, see Fig.10In response to the click operation of the second interface element, the mobile phone determines that the relevant user agreement and / or privacy agreement has not been signed through the user agreement flag, and the mobile phone displays an interface 1000 with an agreement pop-up window 1001. The agreement pop-up window 1001 includes: a first option 1001a, a second option 1001b and a third option 1001c.

[0166] Next, in response to a click operation on the first option 1001a, the mobile phone displays the second editing interface; or, in response to a click operation on the second option 1001b, the mobile phone sets the user agreement flag to 1, and the mobile phone displays the third editing interface; or, in response to a click operation on the third option 1001c, the mobile phone displays the agreement details interface 1010. The agreement details interface 1010 includes the fourth option 1011; in response to a click operation on the fourth option 1011, the mobile phone displays the second editing interface.

[0167] In some scenarios, the above-mentioned AI music is generated in the cloud that has established a communication connection with the mobile phone, and the mobile phone needs to be connected to the network; therefore, if the mobile phone's network is not connected, the mobile phone will display a network connection pop-up window, and the network connection pop-up window is used to prompt the user that the mobile phone is not connected to the network.

[0168] As a possible implementation, the mobile phone can obtain the network connection status of the mobile phone through the system service, and the network connection status includes network disconnected or network connected. When the mobile phone executes step S403, if the network connection status of the mobile phone is network disconnected, the mobile phone displays a network connection pop-up window.

[0169] For example, see again Fig.10 In response to the click operation of the second interface element, based on the network status of the mobile phone being that the network is not connected, the mobile phone displays an interface 1020 having a network connection pop-up window 1021. The network connection pop-up window 1021 includes: a sixth option 1021a and a fifth option 1021b.

[0170] Next, in response to the click operation on the sixth option 1021a, the mobile phone displays the second editing interface, and the editing materials included in the second editing interface are played continuously; or in response to the click operation on the fifth option 1021b, the mobile phone displays the network setting interface. For the relevant introduction of the network setting interface, reference can be made to the design of the relevant technology, and the embodiments of the present application will not be repeated here.

[0171] In some embodiments, the process of the mobile phone displaying a network connection pop-up window can be referred to as the mobile phone displaying a network connection prompt.

[0172] In some other embodiments, the click operation on the sixth option can also be described as an operation of confirming disconnection from the network. Also, the click operation on the fifth option can also be described as an operation of connecting to the network.

[0173] It should be noted that if the user has not authorized (signed) the relevant user agreement and / or privacy agreement before, and the mobile phone is not connected to the network when the mobile phone executes step S403, the mobile phone will first display the agreement pop-up window, and then display the network connection pop-up window. Fig.10 In response to the click operation on the second interface element, the mobile phone displays an interface 1000 having a protocol pop-up window 1001, which includes a third option 1001b. In response to the click operation on the third option 1001b, the mobile phone displays an interface 1020 having a network connection pop-up window 1021.

[0174] In some embodiments, the above-mentioned mobile phone network is not connected, and the protocol switch of the mobile phone is not turned on, which can be expressed as: the mobile phone meets the second condition.

[0175] In some embodiments, during the above-mentioned AI music generation process, the mobile phone (cloud) can generate multiple AI music at one time. After receiving multiple AI music, the mobile phone can analyze the matching degree between the multiple AI music and the editing materials, and sort the multiple AI music; next, the mobile phone displays the AI ​​music with the highest matching degree in the third editing interface. Alternatively, during the above-mentioned AI music generation process, multiple AI music and the matching degree between each AI music and the editing material are generated; next, the mobile phone displays the AI ​​music with the highest matching degree in the third editing interface.

[0176] For example, in the above AI music generation process, based on the tags of the editing materials, three AI musics are generated, such as AI created music 1, AI created music 2, AI created music 3, and so on. The mobile phone analyzes the matching degree between the above three AI musics and the editing materials, and AI created music 1 is the highest, AI created music 2 is the second, and AI created music 3 is the lowest. Then, the mobile phone displays the AI ​​music with the highest matching degree in the above third editing interface, that is, the second music material control included in the third editing interface corresponds to AI created music 1.

[0177] It is understandable that the number of AI music generated by the mobile phone (cloud) can be set according to actual usage requirements, for example, 3, 5, 6, etc. In the following embodiments of this application, the example of generating 3 AI music by the mobile phone (cloud) will be introduced. This embodiment of the application does not impose any restrictions on the number of AI music generated by the mobile phone (cloud).

[0178] In some scenarios, if the user uses the AI ​​music function for the first time, a prompt message is displayed at the first position in the third editing interface; wherein the first position is related to the second music material control, and the prompt message is used to prompt the user to switch the AI ​​music used for the background music of the editing material.

[0179] In this way, after observing the prompt information, the user can know how to switch the background music of the editing material in the third editing interface.

[0180] It is understandable that if the user uses the AI ​​music function for the first time, the user will mostly not sign the user agreement. Therefore, the third editing interface with prompt information can be displayed after the user signs the user agreement.

[0181] For example, see again Fig.10 After the mobile phone displays the interface 1000 with the protocol pop-up window 1001, in response to the click operation on the second optional item 1001b, the mobile phone displays the third editing interface 1030 with prompt information 1035. The third editing interface 1030 includes: a music material control 1032 and prompt information 1035. The music material control 1032 includes: a second music material control 1032a. The prompt information 1035 includes a text description of "Click to create music again, and 3 songs can be played in a loop", or "Click to create music again, and 5 songs can be played in a loop". Among them, the display position of the prompt information 1035 is related to the display position of the second music material control 1032a, for example, the display position of the prompt information 1035 is above the display position of the second music material control 1032a.

[0182] It should be understood that the text description included in the above prompt information 1035 may be related to the preset number of AI music on the mobile phone. For example, if the preset number of AI music is 5, the above text description may be "Click to create music again, and 5 songs can be played in a loop."

[0183] Next, after the mobile phone executes step S403, the mobile phone executes step S404.

[0184] S404. In response to the click operation on the third interface element, the mobile phone displays the fifth editing interface.

[0185] Among them, the third interface element can be the above Fig. 9 Interface elements corresponding to the second music material control 912a in the third editing interface 910 are shown.

[0186] In some embodiments, the third interface element may also be referred to as a second music option.

[0187] It should be understood that one of the purposes of the above-mentioned click operation on the third interface element is to trigger the switching of the AI ​​music used in the background music of the editing material, such as switching from AI created music 1 to AI created music 2. In some other embodiments, it can also be replaced by other operations, such as user inputting voice commands, etc., and the embodiment of the present application does not impose any restrictions on this.

[0188] As a possible implementation, in response to a click operation on the third interface element, the mobile phone displays the fifth editing interface. The fifth editing interface includes at least one music material control, and the third editing interface does not include the music material control, and the music material control corresponds to AI music; that is, compared with the third editing interface, the fifth editing interface switches to the music material control corresponding to AI music.

[0189] In this embodiment, the user can switch between multiple AI music through the third interface element, which allows the user to flexibly switch AI music for editing materials.

[0190] For example, see Fig.11 In response to the click operation on the third interface element, the mobile phone displays the fifth editing interface 1100. The fifth editing interface 1100 includes: editing material 1101, music material control 1102 and play control 1104. The music material control 1102 includes: the third music material control 1102a and the local music material control; the local music material control includes: the first local music material control 1102b, the second local music material control 1102c and the third local music material control 1102d. Among them, the third music material control 1102a is in a selected state, and the relative position of the third music material control 1102a in the fifth editing interface 1100 is the same as the relative position of the third interface element in the third editing interface; the third music material control 1102a is used to display AI music, and provides the user with the ability to set the background music of the editing material 1101 to the AI ​​music corresponding to the third music material control 1102a; the local music material control is used to display local music, and provides the user with the ability to set the background music of the editing material 1101 to the AI ​​music corresponding to the local music material control. For example, the third music material control displays AI music through a preset icon (cover); for another example, the third music material control displays AI music through a text description of "AI created music 2". It should be noted that since the user triggers the AI ​​music used to switch the background music of the editing material through the third interface element, the editing material 1101 can be played again in the fifth editing interface, such as the editing material 1101 starts playing from 00:00. Correspondingly, the progress bar of the play control 1104 starts at 00:00. Furthermore, the background music of the clip material 1101 is the AI ​​created music 2 corresponding to the third music material control mentioned above.

[0191] In some embodiments, the fifth editing interface 1100 described above may be referred to as a second editing interface.

[0192] As another possible implementation, before the mobile phone displays the 5th editing interface, the mobile phone can also display an interface for displaying the AI ​​music creation process, such as the 4th editing interface mentioned above; and after the display time of the interface for displaying the AI ​​music creation process exceeds a preset time, the mobile phone displays the 5th editing interface.

[0193] In this way, users can perceive the process of the mobile phone creating AI music, which can improve the user experience.

[0194] Optionally, after the mobile phone displays the fifth editing interface, the mobile phone may also display the sixth editing interface in response to a click operation on the fourth interface element.

[0195] Among them, the above-mentioned fourth interface element can be an interface element corresponding to the third music material control included in the fifth editing interface.

[0196] It should be understood that one of the purposes of the above-mentioned click operation on the fourth interface element is to trigger the switching of the AI ​​music used in the background music of the editing material, such as switching from AI created music 2 to AI created music 3. In some other embodiments, it can also be replaced by other operations, such as user inputting voice commands, etc., and the embodiment of the present application does not impose any restrictions on this.

[0197] As a possible implementation, in response to a click operation on the fourth interface element, the mobile phone displays the sixth editing interface. The sixth editing interface includes at least one music material control, and the fifth editing interface does not include the music material control, and the music material control corresponds to AI music; that is, compared with the fifth editing interface, the sixth editing interface has a switch of the music material control corresponding to AI music.

[0198] It should be understood that in this embodiment, the mobile phone can switch the background music of the editing material to multiple background music, such as AI created music 1, AI created music 2, etc., by responding to a trigger operation on a touch area, such as the above-mentioned click operation on the second music material control and the above-mentioned click operation on the fourth music material control. In other words, the electronic device can provide different background music for editing. In this way, the user can switch different background music for the editing material through a touch area in the editing interface, which can improve the convenience of the electronic device to change the background music for the video.

[0199] For example, see Fig.11In response to the click operation on the third music material control 1102a, the mobile phone displays the sixth editing interface 1110. The sixth editing interface 1110 includes: editing material 1111, music material control 1112 and play control 1114. The music material control 1112 includes: the fourth music material control 1112a, the first local music material control 1112b, the second local music material control 1112c and the third local music material control 1112d. Among them, the fourth music material control 1112a is in a selected state, and the relative position of the fourth music material control 1112a in the sixth editing interface 1110 is the same as the relative position of the third music material control in the fifth editing interface; the fourth music material control 1112a is used to display AI music, and provides the user with the ability to set the background music of the editing material 1111 to the AI ​​music corresponding to the fourth music material control 1112a. For example, the 4th music material control displays AI music through a preset icon (cover); for another example, the 4th music material control displays AI music through a text description of "AI created music 3".

[0200] In some embodiments, the template default music mentioned above can be called the first background music, the AI ​​created music 2 mentioned above can be called the second background music, and the AI ​​created music 3 mentioned above can be called the third background music.

[0201] It should be noted that since the user triggers the AI ​​music used to switch the background music of the editing material through the fourth interface element, the editing material 1111 can be replayed in the sixth editing interface, for example, the editing material 1111 starts playing from 00:00. Correspondingly, the progress bar of the play control 1114 starts from 00:00. In addition, the background music of the editing material 1111 is the AI ​​created music 3 corresponding to the fourth music material control.

[0202] After the mobile phone displays the sixth editing interface, the mobile phone may also display the third editing interface in response to a click operation on the fourth music material control included in the sixth editing interface, such as the above Fig. 9 The third editing interface 910 is shown. In this way, the mobile phone realizes the loop switching of AI music in the editing interface, and the user can flexibly switch the AI ​​music used in the editing material, which can improve the user experience.

[0203] It should be noted that after the mobile phone displays the 6th editing interface, the mobile phone can also display more other editing interfaces. Specifically, it can be determined according to actual usage needs, such as the preset number of AI music, and its display process and displayed interface are similar to the above. In the following embodiments of the present application, the preset number of AI music is 3, such as AI generated music 1, AI generated music 2, and AI generated music 3. For example, it will be introduced. It can be understood that in actual applications, the above preset number can be more or less, such as 2, 5, 8, etc. Specifically, the preset number can be set according to actual usage needs, and the embodiments of the present application do not impose any restrictions on this.

[0204] In some embodiments, the above-mentioned preset number may also be referred to as a first number.

[0205] As another possible implementation, the sixth editing interface may also include a return option and a confirmation option. The return option provides the user with an operation to trigger returning to the previous interface (e.g., the first editing interface), and the confirmation option is used to provide an operation to trigger saving the background music of the editing material in the current interface. It is understandable that not only the sixth editing interface may also include return information and confirmation options; correspondingly, the third editing interface, the fourth editing interface, or the fifth editing interface may also include the return option and confirmation option.

[0206] Below, taking the 6th editing interface as an example, the return option and the confirmation option are briefly introduced.

[0207] Optionally, the sixth editing interface 1110 also includes: a return option 1116a and a confirmation option 1116b. In response to a click operation on the return option 1116a, the mobile phone displays the first editing interface, and the background music of the editing material is the template default. In response to a click operation on the confirmation option 1116b, the mobile phone displays the first editing interface, and the background music of the editing material is the AI-created music 3 corresponding to the fourth music material control. In other words, the confirmation option can be used to save the change of the background music of the editing material in the current interface displayed by the mobile phone, and the return option does not save the change of the background music of the editing material in the current interface displayed by the mobile phone. It can be understood that similar operations can also be performed on the return option and confirmation option included in the third editing interface, the fourth editing interface or the fifth editing interface, and this application will not go into details here.

[0208] In some embodiments, after the user triggers a click operation on the return option, the mobile phone can also record the music material controls in the current interface; then, the mobile phone displays the first editing interface. And subsequently, in response to a click operation on the first interface element, the mobile phone displays an interface including the music material controls recorded by the mobile phone.

[0209] That is to say, in these embodiments, the mobile phone can memorize the display content in the interface displayed by the mobile phone before the user triggers the return option. In this way, the user can use the editing interface displayed by the mobile phone more flexibly, which can improve the user's experience.

[0210] As a possible implementation, in response to a click operation on the return option, the mobile phone uses the music material control included in the current interface as the target music material control, and the mobile phone displays the first editing interface. Next, in response to a click operation on the first interface element, the mobile phone displays the target editing interface, which is an editing interface including the target music material control.

[0211] For example, see Fig.12 , the mobile phone displays the sixth editing interface 2000, which includes the fourth music material control 2002a, the first local music material control 2002b and the return option 2006a. Afterwards, in response to the click operation on the return option 2006a, the mobile phone records the fourth music material control 2002a and displays the first editing interface 2010; that is, the mobile phone uses the fourth music material control 2002a as the target music material control. The first editing interface 2010 includes music options 2013b. Among them, the above-mentioned first editing interface 2010 also includes editing material 2011, and the background music of the editing material 2011 is the template default music corresponding to the above-mentioned first local music material control 2002b.

[0212] Next, in response to the click operation on the music option 2013b, the mobile phone displays the target editing interface including the target music material control, that is, the mobile phone displays the above-mentioned sixth editing interface 2020. The sixth editing interface 2020 includes the fourth music material control 2022a, that is, the target music material control. And, the sixth editing interface 2020 also includes: the first local music material control 2022b and the editing material 2021. Among them, the first local music material control 2022b is in a selected state, and the background music of the editing material 2021 is the template default music corresponding to the first local music material control 2022b.

[0213] In some other embodiments, the first editing interface may further include an exit button. In response to clicking the exit button, the mobile phone displays a "Moments" option menu of the gallery application. Afterwards, if the user opens the first editing interface again, the mobile phone may perform the above steps S401-S404 again.

[0214] For example, see Fig.13, the mobile phone displays the sixth editing interface 2100, and the sixth editing interface 2100 includes a return option 2106a. Afterwards, in response to a click operation on the return option 2106a, the mobile phone displays the first editing interface 2110. Among them, the first editing interface 2110 includes an exit button 2115. Next, in response to a click operation on the exit button 2115, the mobile phone displays a "moment" option menu 2120 of the gallery application. The "moment" option menu 2120 of the gallery application includes a thumbnail 2121 of a clip material. Afterwards, in response to a click operation on the thumbnail 2121 of the clip material, the mobile phone displays the first editing interface 2110; the first editing interface 2110 includes a music option 2113b. Then, in response to a click operation on the music option 2113b, the mobile phone displays the second editing interface 2130. Among them, the second editing interface 2130 includes a first local music material control 2132b and a clip material 2131. The first local music material control 2132b is in a selected state, and the background music of the editing material 2131 is the default music of the template corresponding to the first local music material control 2132b. Afterwards, if the user clicks the second interface element (e.g., the first music material control 2132a included in the second editing interface 2130) again to trigger the mobile phone to display the third editing interface, the mobile phone sends an AI generation request again, that is, the mobile phone (cloud) generates AI music again through the AI ​​music model.

[0215] In some embodiments, the AI ​​music corresponding to the third music material control, the AI ​​music corresponding to the second music material control, and the AI ​​music corresponding to the fourth music material control; all three can be generated by the mobile phone (cloud) at one time, or can be generated by the mobile phone (cloud) multiple times.

[0216] For example, the 4th music material control corresponds to AI created music 3, the 3rd music material control corresponds to AI created music 2, and the 2nd music material control corresponds to AI created music 1; AI created music 1, AI created music 2 and AI created music 3 can all be generated by the mobile phone (cloud) based on the AI ​​music generation request during the above step S402, that is, the mobile phone (cloud) generates multiple AI music at one time.

[0217] For another example, AI created music 1 may be generated by the mobile phone (cloud) based on the AI ​​music generation request in the above step S402; AI created music 2 may be generated by the mobile phone (cloud) again based on the AI ​​music generation request in step S403; AI created music 3 may be generated by the mobile phone (cloud) again based on the AI ​​music generation request after the above-mentioned click operation on the fourth interface element, that is to say, the mobile phone (cloud) generates multiple AI music in multiple times.

[0218] In the scenario where multiple AI music are generated at one time on a mobile phone (cloud), since the mobile phone has obtained multiple AI music after displaying the above-mentioned third editing interface, that is, the above-mentioned preset number of AI music, then if the mobile phone’s network is not connected subsequently, the mobile phone will not display a network connection pop-up window.

[0219] In the scenario where a mobile phone (cloud) generates multiple AI music in multiple times, if the network status of the mobile phone is not connected to the network after the mobile phone displays the above-mentioned 3rd editing interface or 5th editing interface, the mobile phone will display a network connection pop-up window, and the network connection pop-up window is used to prompt the user that the mobile phone is not connected to the network. If the network status of the mobile phone is not connected to the network after the mobile phone displays the above-mentioned 6th editing interface, the mobile phone will not display the network connection pop-up window. In other words, the mobile phone will determine whether to display the network connection pop-up window based on the network status and the amount of AI music obtained by the mobile phone.

[0220] It should be understood that in the scenario where a mobile phone (cloud) generates multiple AI music in multiple times, the mobile phone will switch the background music of the clip material in response to a click operation on the second music option. That is, the mobile phone will switch different background music for the clip material according to the number of selection operations on the second music option. Then, when the number of background music switching operations on the second music option reaches a first number, the mobile phone can also switch the background music even if the mobile phone is not connected to the network. That is to say, when the mobile phone meets the first condition, in response to the selection operation of the second music option, the mobile phone plays the clip material with the second background music. Among them, the first condition includes that the mobile phone is connected to the network, or the first condition includes that the mobile phone is not connected to the network and the number of background music switching operations on the second music option reaches a first number.

[0221] For example, see again Fig.11 After the mobile phone displays the fifth editing interface 1100, in response to a click operation on the third music material control 1102a, based on the mobile phone's network status being that the network is not connected, the mobile phone displays an interface with a network connection pop-up window. Fig.10 Next, in response to a click operation on the sixth option included in the network connection pop-up window, the mobile phone displays the fifth editing interface 1100, and the editing materials included in the fifth editing interface 1100 are played continuously.

[0222] Again, see Fig.11After the mobile phone displays the sixth editing interface 1110, in response to a click operation on the third music material control 1102a, based on the network status of the mobile phone being that the network is not connected, and the mobile phone has displayed a preset number (e.g., the preset number is 3) of AI music, the mobile phone does not display an interface with a network connection pop-up window, and the mobile phone displays the above-mentioned third editing interface. Among them, the above-mentioned mobile phone has displayed a preset number of AI music, which can be understood as the mobile phone has displayed the AI ​​creation music 1 corresponding to the second music material control through the third editing interface, the mobile phone has displayed the AI ​​creation music 2 corresponding to the third music material control through the fifth editing interface, and the mobile phone has displayed the AI ​​creation music 3 corresponding to the fourth music material control through the sixth editing interface.

[0223] Optionally, after executing step S404, the mobile phone may further execute step S405.

[0224] S405. In response to the sliding operation on the 5th interface element, the mobile phone displays the 7th editing interface.

[0225] Among them, the fifth interface element may include the above Fig.11 The interface elements corresponding to the local music material controls in the fifth editing interface 1100 are shown, such as the first local music material control 1102b, or the second local music material control 1102c, or the third local music material control 1102d.

[0226] It should be understood that one of the purposes of the sliding operation on the fifth interface element is to trigger the mobile phone to display other local music material controls. In some other embodiments, it can also be replaced by other operations, such as user inputting voice commands, etc., and the present application embodiment does not impose any restrictions on this.

[0227] As a possible implementation, in response to a sliding operation on the 5th interface element, the display position of the 5th interface element changes with the change of the real-time position of the sliding operation; next, in response to the end of the sliding operation, the mobile phone displays the 7th editing interface. The 7th editing interface includes at least one music material control, and the 5th editing interface does not include the music material control, and the music material control corresponds to local music; that is, compared with the 5th editing interface, the 7th editing interface switches to the music material control corresponding to the local music. The end of the above sliding operation can be understood as the user stops touching the mobile phone screen, that is, the user's hand leaves the screen.

[0228] In this implementation, the user can switch between multiple local music by sliding operations, which allows the user to flexibly switch local music for editing materials.

[0229] It should be pointed out that in an embodiment of the present application, the switching of AI music is performed by a click operation, and the switching of local music is performed by a sliding operation. In other words, for AI music and local music, the way in which the user switches between the two is different. Moreover, the display position of the music material control corresponding to the AI ​​music will not change with the change of the real-time touch position of the sliding operation, that is, the music material control corresponding to the AI ​​music can be fixedly displayed in the editing interface. In this way, it is convenient for users to trigger the replacement of the background music of the music material control with AI music in the editing interface. At the same time, it is also convenient for users to compare the editing materials whose background music is AI music and the editing materials whose background music is local music.

[0230] For example, see Fig.14 , the mobile phone displays the fifth editing interface 1200; the fifth editing interface 1200 includes the third music material control 1202a and the third local music material control 1202d; wherein the third music material control 1202a is in a selected state. In response to the drag operation on the third local music material control 1202d, the display position of the third local music material control 1202d changes with the change of the touch position of the drag operation; next, in response to ending the drag operation on the third local music material control 1202d, the mobile phone displays the seventh editing interface 1210.

[0231] It should be noted that, while the display position of the third local music material control 1202d changes with the change of the touch position during the drag operation, the display position of the third music material control 1202a remains fixed, and the selected state of the third music material control 1202a also remains unchanged. Fig.14 In the fifth editing interface 1200 shown, the display position of the third music material control 1202a remains fixed.

[0232] See again Fig.14 , the seventh editing interface 1210 may include: editing material 1211, the third local music material control 1212d, the fourth local music material control 1212e, the fifth local music material control 1212f, the third music material control 1212a and the play control 1214. The third music material control 1212a is in a selected state, and the editing material 1211 in the seventh editing interface 1210 and the editing material 1201 in the fifth editing interface 1200 are played continuously; accordingly, the play control 1214 in the seventh editing interface 1210 and the play control 1204 in the fifth editing interface have a corresponding relationship. Moreover, the background music of the editing material 1211 is the third music material control 1212a.

[0233] Optionally, after step S405, the user can also trigger the replacement of the background music of the editing material with local music, such as recommended music D, through the seventh editing interface displayed on the mobile phone.

[0234] Optionally, after step S405, the above-mentioned background music replacement method may further include step S406.

[0235] S406. In response to the click operation on the 6th interface element, the mobile phone displays the 8th editing interface.

[0236] It should be understood that one of the purposes of the above-mentioned click operation on the sixth interface element is to trigger the mobile phone to switch the background music of the clip material to local music. In some other embodiments, it can also be replaced by other operations, such as the user inputting a voice command, etc., and the embodiment of the present application does not impose any restrictions on this.

[0237] In some embodiments, the sixth interface element mentioned above may also be referred to as the first music option.

[0238] The click operation of the sixth interface element may include the above Fig.14 The third local music material control 1212d, the fourth local music material control 1212e or the fifth local music material control 1212f is shown. Compared with the seventh editing interface, the eighth editing interface has different music material controls in the selected state; and the background music of the editing material is different.

[0239] For example, see again Fig.14 , the mobile phone displays the seventh editing interface 1210, and in response to the click operation on the fifth local music material control 1212f, the mobile phone displays the eighth editing interface 1220; in the eighth editing interface 1220, the fifth local music material control 122f is selected. Among them, the eighth editing interface 1220 may include: editing material 1221, the third local music material control 1222d, the fourth local music material control 1222e, the fifth local music material control 1222f, the third music material control 1222a and the play control 1224. Among them, the third local music material control 1222d, the fourth local music material control 1222e, and the fifth local music material control 1222f all correspond to local music material controls, and the third music material control 1222a corresponds to AI music, such as the fifth local music material control 1222f corresponds to recommended music D. In addition, the clip material 1221 in the eighth clip interface 1220 is replayed; accordingly, the play control 1224 in the eighth clip interface 1220 is also in the replay state. At the same time, the background music of the clip material 1221 is the recommended music D corresponding to the fifth local music material control 1222f.

[0240] Next, the background music replacement method provided in the embodiment of the present application is supplemented with some embodiments.

[0241] In some embodiments, the user can enter the deep editing interface through the deep editing 634a of the first editing interface 630, and perform more comprehensive and rich editing of the editing material through the deep editing interface.

[0242] For example, see above Figure 6 and Fig.11 ; The mobile phone displays the sixth editing interface 1110. In response to the click operation on the confirmation option 1116b, the mobile phone displays the first editing interface 630. That is, the user triggers the saving of the editing of the editing material; then, the background music of the editing material is the AI ​​music corresponding to the fourth music material control 1112a in the sixth editing interface 1110, such as AI created music 3. Next, see Figure 6 and Fig.15 In response to the click operation on the deep editing 634a, the mobile phone displays the first deep editing interface 1300. The first deep editing interface 1300 includes a editing material 1301, and a music progress bar 1302. Among them, the editing material 1301 is in a paused state, such as paused at 00:00 seconds. And, if the editing material 1301 is played, the background music played by the editing material 1301 is the AI ​​music corresponding to the above-mentioned fourth music material control, such as AI created music 3. And, the above-mentioned music progress bar 1302 corresponds to the background music of the editing material, such as the music progress bar 1302 corresponds to AI created music 3. Specifically, the waveform shown in the music progress bar 1302 corresponds to the waveform of AI created music 3, or the text description included in the music progress bar is "AI created music 3" and the like.

[0243] It should be understood that there may be different designs for the above-mentioned deep editing interface. Fig.15, in response to a click operation on the deep editing, the mobile phone displays the second deep editing interface 1310. The second deep editing interface 1310 includes: editing material 1311 and adding AI music option 1313. Among them, the editing material 1311 can be in a playing state, that is, when the mobile phone displays the second deep editing interface, the editing material 1311 is automatically played. Adding AI music option 1313 can be used to trigger adding AI music to the editing material 1311. For example, in response to a click operation on adding AI music option 1313, the mobile phone displays the third deep editing interface 1320. The third deep editing interface 1320 includes: editing material 1311, adding AI music option 1313, the first music progress bar 1322a and the second music progress bar 1322b. That is, compared with the above-mentioned second deep editing interface 1310, the third deep editing page 1320 adds a music progress bar corresponding to the AI ​​music. The first music progress bar 1322a corresponds to AI music, and the second music progress bar 1322b corresponds to AI music. For example, the first music progress bar 1322a corresponds to AI music 3, and the second music progress bar 1322b corresponds to AI music 1. Moreover, the background music of the clip material 1321 is AI music 3 and AI music 1. The above "the background music of the clip material 1321 is AI music 3 and AI music 1" can be understood as that AI music 1 and AI music 3 are played at the same time, or AI music 1 and AI music 3 are played alternately, such as AI music 1 is played for 5 seconds, and then AI music 3 is played for 5 seconds, and so on.

[0244] Next, in response to a click operation on the second music progress bar 1322b, the mobile phone switches the AI ​​music corresponding to the second music progress bar 1322b, such as setting the AI ​​music corresponding to the second music progress bar 1322b to AI created music 2.

[0245] In some other embodiments, the user can enter the "Create" option menu of the gallery application through the gallery application. Afterwards, the user can manage the above-mentioned related user agreements and / or privacy agreements based on the "Create" option menu of the gallery application.

[0246] For example, see above Figure 6 and Fig.16, the mobile phone displays the main interface 610 of the gallery application. Afterwards, in response to a click operation on the "Create" option button in the main interface of the gallery application, the mobile phone displays a "Create" option menu 1400. The "Create" option menu 1400 includes a clipping option 1401. The clipping option 1401 is used to provide management of the clipping function of the gallery application. Next, in response to a click operation on the clipping option 1401, the mobile phone displays a first clipping management interface 1410. The clipping management interface 1410 is used to manage the clipping draft box, and to manage some historical clipping results such as AABB clipping results, CCDD clipping results, etc. The clipping management interface 1410 also includes an extension option 1411. In response to a click operation on the extension option 1411, the mobile phone displays additional display extension information in the clipping management interface 1410, for example, the mobile phone displays a second clipping management interface 1420. The second clipping management interface includes a clipping setting option 1422. In response to a click operation on the clipping setting option 1422, the mobile phone displays a clipping setting interface 1430. The editing setting interface 1430 includes a music service switch 1431 and a service agreement option 1432. The status of the music service switch 1431 includes an on state or an off state. The status of the music service switch 1431 is related to the above-mentioned protocol flag, that is, it is related to whether the user authorizes (signs) the relevant user agreement and / or privacy agreement. For example, if the above-mentioned protocol flag is 1, the status of the music service switch 1431 is on; if the above-mentioned protocol flag is 0, the status of the music service switch 1431 is off. Fig.16 In the example, the state of the music service switch 1431 is turned on. In response to a click operation on the music service switch 1431, the state of the music service switch 1431 changes to a turned off state. Alternatively, in response to a click operation on the service agreement option 1432, the mobile phone displays an agreement details interface. The above-mentioned agreement details interface can refer to the above-mentioned Fig.10 The protocol details interface 1010 shown in FIG. 1 is not described in detail here.

[0247] In some embodiments, the above-mentioned music service switch may also be referred to as a protocol switch.

[0248] It should be understood that in some scenarios, AI music is time-sensitive, that is, the AI ​​music added to the edited music is time-sensitive. Then, the AI ​​music function status of the mobile phone can be expired or not expired. When the AI ​​music function status of the mobile phone is expired, the mobile phone displays a service stop notification in the editing interface, and does not display the interface elements corresponding to the AI ​​music in the editing interface.

[0249] For example, after the clip material is edited by the user, the background music is AI-created music 2. Then the user Figure 6When the editing interface is opened in the corresponding process, the music material control corresponding to AI Music Creation 2 is selected. For example, the mobile phone displays the above Fig.11 The fifth editing interface 1100 is shown. In the fifth editing interface 1100, the third music material control 1102a is selected, and the background music of the editing material 1101 is the AI-created music 2 corresponding to the third music material control 1102a. Next, in response to the click operation on the third music material control 1102a, and the AI ​​music function status of the mobile phone is expired, the mobile phone displays a service stop notification. For example, see Fig.17 , the mobile phone displays an interface 1500 with a service stop notification 1501. The interface 1500 includes the service stop notification 1501, and the service stop notification 1501 includes the first option 1501a. In response to the click operation on the first option 1501a, the mobile phone displays the ninth editing interface 1510. The ninth editing interface 1510 includes a clip material 1511 and a music material control 1502. Among them, the music material control 1502 includes a music material control corresponding to local music, and does not include a music material control corresponding to AI music. The music material control 1502 includes: a first local music material control 1502b, a second local music material control 1502c, a third local music material control 1502d, and a fourth local music material control 1502e. Among them, the first local music material control 1502b is in a selected state, the clip material 1511 is in a playing state, and the background music played is the template default music corresponding to the first local music material control 1502b.

[0250] It should be noted that the personal information used in the technical solution of this application is limited to information for which the individual’s separate consent has been obtained, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) and sign the agreement (authorization) including authorization of relevant user information before the user uses the function.

[0251] In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0252] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0253] The present application also provides an electronic device, such as Fig.18 As shown, the electronic device may include one or more processors 1601 , a memory 1602 and a communication interface 1603 .

[0254] The memory 1602 and the communication interface 1603 are coupled to the processor 1601. For example, the memory 1602, the communication interface 1603 and the processor 1601 may be coupled together via a bus 1604.

[0255] The communication interface 1603 is used for data transmission with other devices. The memory 1602 stores computer program code. The computer program code includes computer instructions. When the computer instructions are executed by the processor 1601, the electronic device executes the relevant method steps in the above method embodiment of the present application.

[0256] Among them, the processor 1601 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the present disclosure. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0257] The bus 1604 may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus 1604 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.18 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0258] An embodiment of the present application further provides a computer-readable storage medium, in which a computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the method embodiment.

[0259] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the relevant method steps in the above method embodiment.

[0260] Among them, the electronic device, computer-readable storage medium or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0261] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0262] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0263] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0264] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0265] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0266] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application shall be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for replacing background music, characterized in that: The method comprises: Displaying a first editing interface, playing a video to be edited with a first background music in the first editing interface, wherein the first editing interface also includes a music control; In response to a first trigger operation on the music control, a second editing interface is displayed, wherein the second editing interface includes a first music option and a second music option, and the first music option indicates a first background music: In response to a selection operation of the second music option, playing the video to be edited with the second background music; In response to a selection operation of the first music option, playing the video to be edited with the first background music; In response to a selection operation on the second music option, the video to be edited with a third background music is played, and the third background music is different from the second background music.

2. The method according to claim 1, characterized in that In response to the selection operation of the second music option, playing the video to be edited with the third background music comprises: After playing the video to be edited with the second background music, when the number of times the background music is switched in response to the selection operation of the second music option is less than the first number, playing the video to be edited with the third background music in response to the selection operation of the second music option.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: After playing the video to be edited with the second background music, when the number of times the background music is switched in response to the selection operation of the second music option is greater than or equal to a first number, in response to the selection operation of the second music option, the video to be edited with the second background music is played.

4. The method according to any one of claims 1 to 3, characterized in that: The method is applied to electronic equipment; In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the electronic device satisfies the first condition, in response to a selection operation of the second music option, playing the video to be edited with the second background music; The first condition includes: The electronic device is connected to a network; or, The electronic device is not connected to a network, and the number of times the background music is switched in response to a selection operation of the second music option reaches a first number.

5. The method according to claim 4, characterized in that In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the electronic device is not connected to a network and the number of times the background music is switched in response to the selection operation of the second music option is less than a first number, displaying a network connection prompt in response to the selection operation of the second music option; In response to an operation of connecting to a network, establishing a network connection; After connecting to the network, the second editing interface is displayed, and the video to be edited with the second background music is played in the second editing interface.

6. The method according to claim 5, characterized in that After displaying the network connection prompt, the method further includes: In response to the operation of confirming that the network is not connected, the video to be edited with the first background music is played in the second editing interface.

7. The method according to any one of claims 1 to 6, characterized in that: The second editing interface also includes a first return control; After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: In response to a second trigger operation on the first return control, displaying the first editing interface, and playing the video to be edited with the first background music in the first editing interface; In response to a third trigger operation on the music control, the second editing interface is displayed, and the video to be edited with the first background music is played in the second editing interface.

8. The method according to any one of claims 1 to 6, characterized in that: The second editing interface also includes a save control; After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: In response to a fourth trigger operation on the save control, displaying the first editing interface, and playing the video to be edited with the third background music in the first editing interface; In response to the fifth trigger operation on the music control, a second editing interface is displayed, and the video to be edited with the third background music is played in the second editing interface.

9. The method according to claim 7, characterized in that: The first editing interface also includes a second return control; After displaying the first editing interface in response to the second triggering operation on the first return control, the method further includes: In response to a sixth trigger operation on the second return control, displaying a third interface, wherein the third interface includes an editing entry for the video to be edited; In response to the seventh trigger operation on the editing entry, the first editing interface is displayed, and the video to be edited with the first background music is played in the first editing interface.

10. The method according to any one of claims 1 to 3, characterized in that: The method is applied to an electronic device, wherein the electronic device includes a protocol switch; In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the protocol switch is turned on, in response to a selection operation of the second music option, the video to be edited with the second background music is played.

11. The method according to claim 10, characterized in that In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: In the case where the protocol switch is turned off, in response to a selection operation of the second music option, a prompt for turning on the protocol switch is displayed; In response to an operation of turning on a protocol switch, turning on the protocol switch; After the protocol switch is turned on, the second editing interface is displayed, and the video to be edited with the second background music is played in the second editing interface.

12. The method according to claim 11, characterized in that After the prompt for turning on the protocol switch is displayed, the method further includes: In response to confirming that the protocol switch is not turned on, the video to be edited with the first background music is played in the second editing interface.

13. The method according to any one of claims 1 to 3, characterized in that: The method is applied to an electronic device, wherein the electronic device includes a protocol switch; In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the electronic device satisfies the second condition: In response to the selection operation of the second music option, displaying a prompt for turning on a protocol switch; In response to starting the operation of the protocol switch, turning on the protocol switch; After the protocol switch is turned on, a network connection prompt is displayed; In response to an operation of connecting to a network, establishing a network connection; After connecting to the network, displaying the second editing interface, and playing the video to be edited with the second background music in the second editing interface; The second condition includes: the electronic device is not connected to the network, and the protocol switch is not turned on.

14. The method according to any one of claims 1 to 3, characterized in that: The second editing interface also includes a save control; After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: In response to an eighth trigger operation on the save control, displaying the first editing interface; the first editing interface also includes a first editing control; In response to a ninth trigger operation on the first editing control, a third editing interface is displayed, and a video to be edited with the third background music and an audio track of the third background music are played in the third editing interface; the third editing interface includes a third music option; In response to a selection operation on the third music option, the video to be edited having the third background music and the second background music is played, and the audio track of the second background music is displayed in the third editing interface.

15. The method according to any one of claims 1 to 3, characterized in that: In response to the selection operation of the second music option, playing the video to be edited with the second background music comprises: In response to a selection operation of the second music option, a first music cover and / or a first music name is displayed in the second music option, and the video to be edited with the second background music is played; the first music cover and / or the first music name indicates the second background music; The step of playing the video to be edited with the third background music in response to the selection operation of the second music option comprises: In response to a selection operation on the second music option, a second music cover and / or a second music name are displayed in the second music option, and the video to be edited with the third background music is played; the second music cover and / or the second music name indicate the third background music.

16. An electronic device, characterized in that: The electronic device includes a processor and a memory; the processor is coupled to the memory; the memory is used to store computer program code; the computer program code includes computer instructions, and when the processor executes the above-mentioned computer instructions, the electronic device executes the method described in any one of claims 1-15.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.

Images