Background music replacement method, electronic equipment and storage medium

Abstract

The embodiment of the invention relates to the technical field of terminals, in particular to a background music replacement method, electronic equipment and a storage medium. According to the method, the electronic equipment can respond to the selection operation of the second music option, and different background music, such as the second background music and the third background music, can be replaced for the video to be edited. Moreover, the electronic equipment can also change fixed background music, such as the first background music, for the to-be-edited video in response to the selection operation on the first music option. In other words, the electronic device can switch diversified background music for the edited video through the second music option. Therefore, the electronic equipment can provide diversified background music for editing. Thus, in the process that the user uses the electronic equipment to clip, the user can flexibly switch diversified background music for the video to be clipped through the second music option, and the user can obtain better use experience.

Description

Background music replacement method, electronic device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on November 3, 2023, with application number 202311465355.3, and invention name “A video production method based on a large model”, and the Chinese patent application filed with the State Intellectual Property Office on December 28, 2023, with application number 202311852130.3, and invention name “Background music replacement method, electronic device and storage medium”. All of the above contents are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of terminal technology, and in particular to a method for replacing background music, an electronic device, and a storage medium. Background Art

[0003] With the development of terminal technology, users are using electronic devices more and more frequently, and they often use electronic devices to take photos and keep them as souvenirs. After the electronic device captures the image, it can generate a video based on the captured image and edit the video, such as adding background music, animation, text, etc. to the video to generate an edited image.

[0004] Currently, when users use electronic devices to edit videos, the background music provided by the electronic devices is relatively fixed and cannot provide diverse background music for editing.

[0005] Summary of the Invention

[0006] The embodiments of the present application provide a background music replacement method, an electronic device, and a storage medium, which can provide a variety of background music for editing, thereby improving the user experience.

[0007] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0008] In a first aspect, an embodiment of the present application provides a method for replacing background music, which can be applied to electronic devices. The electronic device can be an electronic device with the ability to display images, such as a mobile phone, a tablet computer, etc. In this method, the electronic device displays a first editing interface, in which the electronic device plays a video to be edited with a first background music, and the first editing interface also includes a music control. Next, in response to a first trigger operation on the music control, the electronic device displays a second editing interface, in which the second editing interface includes a first music option and a second music option, and the first music option indicates the first background music. In the process of the electronic device displaying the second editing interface: in response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music; in response to the selection operation of the first music option, the electronic device plays the video to be edited with the first background music; in response to the selection operation of the second music option, the electronic device plays the video to be edited with the third background music. The third background music is different from the second background music.

[0009] In the above method, the electronic device can respond to the selection operation of the second music option and replace different background music for the video to be edited, such as the second background music and the third background music. In addition, the electronic device can also respond to the selection operation of the first music option and replace the fixed background music for the video to be edited, such as the first background music. In other words, the electronic device can switch to a variety of background music for the edited video through the second music option. In this way, the electronic device can provide a variety of background music for editing. In this way, when the user uses the electronic device to edit, the user can flexibly switch to a variety of background music for the video to be edited through the second music option, and the user will obtain a better user experience.

[0010] In a possible design of the first aspect, the above-mentioned electronic device plays the video to be edited with the third background music in response to the selection operation of the second music option, including: after the electronic device plays the video to be edited with the second background music, when the number of times the electronic device switches the background music in response to the selection operation of the second music option is less than the first number, the electronic device plays the video to be edited with the third background music in response to the selection operation of the second music option.

[0011] In this design, the electronic device can change the background music switched by the selection operation of the second music option according to the number of selection operations on the second music option. As can be seen, the electronic device can provide diverse background music for editing.

[0012] In another possible design of the first aspect, the above method also includes: after the electronic device plays the video to be edited with the second background music, if the number of times the electronic device switches the background music in response to the selection operation of the second music option is greater than or equal to the first number, the electronic device plays the video to be edited with the second background music in response to the selection operation of the second music option.

[0013] In this design, the electronic device can switch the background music of the video to be edited back to the previous background music, such as the second background music, according to the number of times the second music option is selected. As can be seen, the electronic device can provide a variety of background music for editing.

[0014] In another possible design of the first aspect, in response to a selection of the second music option, playing the video to be edited with the second background music includes: when the electronic device satisfies a first condition, in response to the selection of the second music option, the electronic device plays the video to be edited with the second background music. The first condition includes: the electronic device is connected to a network; or the first condition includes: the electronic device is not connected to a network, and the number of background music changes in response to the selection of the second music option reaches a first number.

[0015] In this design, the electronic device can play the video to be edited with the second background music according to the network status. In other words, the electronic device can provide a variety of background music for editing.

[0016] In another possible design of the first aspect, in response to a selection operation for a second music option, the electronic device plays a video to be edited with a second background music, including: when the electronic device is not connected to a network and the number of background music changes in response to the selection operation for the second music option is less than a first number, the electronic device displays a network connection prompt in response to the selection operation for the second music option. Next, in response to an operation to connect to a network, the electronic device establishes a network connection. After the network is connected, the electronic device displays a second editing interface, and plays the video to be edited with the second background music in the second editing interface.

[0017] In another possible design of the first aspect, after the electronic device displays a prompt to connect to the Internet, the above method also includes: in response to an operation to confirm that the network is not connected, the electronic device plays the video to be edited with the first background music in the second editing interface.

[0018] In this design, the electronic device can play either the first background music or the second background music for the video to be edited, depending on the network status of the electronic device. This allows the electronic device to flexibly change the background music for the video to be edited, depending on the network status. Thus, the electronic device can provide a variety of background music for editing.

[0019] In another possible design of the first aspect, the second editing interface further includes a first return control. After the video to be edited with the third background music is played in response to a selection of the second music option, the method further includes: in response to a second triggering operation on the first return control, the electronic device displays the first editing interface and plays the video to be edited with the first background music in the first editing interface. Thereafter, in response to a third triggering operation on the music control, the electronic device displays the second editing interface and plays the video to be edited with the first background music in the second editing interface.

[0020] In this design, the electronic device may not save the change of the background music of the video to be edited in response to the triggering operation of the return control.

[0021] In another possible design of the first aspect, the second editing interface further includes a save control. After the electronic device plays the video to be edited with the third background music in response to a selection of the second music option, the method further includes: in response to a fourth triggering operation on the save control, the electronic device displays the first editing interface and plays the video to be edited with the third background music in the first editing interface. Next, in response to a fifth triggering operation on the music control, the electronic device displays the second editing interface and plays the video to be edited with the third background music in the second editing interface.

[0022] In this design, the electronic device can save the changes to the background music of the video to be edited in response to a trigger operation on the save control.

[0023] In another possible design of the first aspect, the first editing interface further includes a second return control. After the electronic device displays the first editing interface in response to a second triggering operation on the first return control, the method further includes: in response to a sixth triggering operation on the second return control, the electronic device displays a third interface, the third interface including an editing entry for the video to be edited. Next, in response to a seventh triggering operation on the editing entry, the electronic device displays the first editing interface, and plays the video to be edited with the first background music in the first editing interface.

[0024] In another possible design of the first aspect, the electronic device includes a protocol switch. In response to a selection of the second music option, the electronic device plays the video to be edited with the second background music, including: when the protocol switch is turned on, in response to the selection of the second music option, the electronic device plays the video to be edited with the second background music.

[0025] In another possible design of the first aspect, in response to a selection of the second music option, playing the video to be edited with the second background music includes: when the protocol switch is off, in response to the selection of the second music option, the electronic device displays a prompt to turn on the protocol switch. Thereafter, in response to the operation to turn on the protocol switch, the electronic device turns on the protocol switch. After the protocol switch is turned on, the electronic device displays a second editing interface, and plays the video to be edited with the second background music in the second editing interface.

[0026] In another possible design of the first aspect, after displaying a prompt to turn on the protocol switch, the above method also includes: in response to confirming the operation of not turning on the protocol switch, the electronic device plays the video to be edited with the first background music in the second editing interface.

[0027] In another possible design of the first aspect, the electronic device includes a protocol switch. The above-mentioned response to the selection operation of the second music option, the electronic device plays the video to be edited with the second background music, which may include: when the electronic device meets the second condition: in response to the selection operation of the second music option, the electronic device displays a prompt to turn on the protocol switch. Afterwards, in response to the operation of starting the protocol switch, the electronic device turns on the protocol switch. After the protocol switch is turned on, the electronic device displays a network connection prompt. In response to the operation of connecting to the network, the electronic device establishes a network connection. After connecting to the network, the electronic device displays a second editing interface, and plays the video to be edited with the second background music in the second editing interface. Among them, the above-mentioned second condition includes: the electronic device is not connected to the network, and the protocol switch is not turned on.

[0028] In this design, under the second condition, the electronic device first displays a prompt to turn on the protocol switch, and then displays a prompt to connect to the Internet; this can be more in line with the user's operating logic and can improve the user experience.

[0029] In another possible design of the first aspect, the second editing interface further includes a save control. After the electronic device plays the video to be edited with the third background music in response to a selection operation for the second music option, the method further includes: in response to an eighth trigger operation on the save control, the electronic device displays the first editing interface; the first editing interface also includes a first editing control. Next, in response to a ninth trigger operation on the first editing control, the electronic device displays a third editing interface, plays the video to be edited with the third background music, and the audio track of the third background music in the third editing interface; the third editing interface includes a third music option. Thereafter, in response to a selection operation for the third music option, the electronic device plays the video to be edited with the third background music and the second background music, and displays the audio track of the second background music in the third editing interface.

[0030] In this design, the electronic device can set the background music of the video to be edited to multiple diversity background music in the third editing interface, such as the second background music and the third background music. In this way, the electronic device can provide diverse background music for editing.

[0031] In another possible design of the first aspect, in response to a selection operation on a second music option, the electronic device plays a video to be edited with a second background music, including: in response to the selection operation on the second music option, the electronic device displays a first music cover and / or a first music title in the second music option, and plays the video to be edited with the second background music; the first music cover and / or the first music title indicate the second background music. Furthermore, in response to the selection operation on the second music option, the electronic device plays a video to be edited with a third background music, including: in response to the selection operation on the second music option, the electronic device displays a second music cover and / or a second music title in the second music option, and plays the video to be edited with the third background music; the second music cover and / or the second music title indicate the third background music.

[0032] In this design, the electronic device can allow the user to visually and intuitively feel the switching of the background music of the video to be edited through the music cover or music name.

[0033] In a second aspect, an electronic device is provided, which includes a memory and one or more processors, and the memory is coupled to the processor; wherein computer program code is stored in the memory, and the computer program code includes computer instructions; when the computer instructions are executed by the processor, the electronic device executes the method provided by the above-mentioned first aspect and any possible design of the first aspect.

[0034] In a third aspect, a computer-readable storage medium is provided, comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the method provided by the first aspect and any possible design of the first aspect.

[0035] In a fourth aspect, a computer program product comprising instructions is provided. When the computer program product is run on an electronic device, the electronic device can execute the method provided by the first aspect and any possible design of the first aspect.

[0036] Among them, the technical effects brought about by any design method in the second to fourth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] FIG1 is a schematic diagram of a usage scenario provided by an embodiment of the present application;

[0038] FIG2 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0039] FIG3 is a schematic diagram of a software architecture provided in an embodiment of the present application;

[0040] FIG4 is a flow chart of a method for replacing background music according to an embodiment of the present application;

[0041] FIG5 is a flow chart of a process for generating clipping materials according to an embodiment of the present application;

[0042] FIG6 is a schematic diagram of a set of interfaces provided in an embodiment of the present application;

[0043] FIG7 is a schematic diagram of an interface provided by an embodiment of the present application;

[0044] FIG8 is another set of interface schematic diagrams provided in an embodiment of the present application;

[0045] FIG9 is another set of interface diagrams provided in an embodiment of the present application;

[0046] FIG10 is another set of interface schematic diagrams provided in an embodiment of the present application;

[0047] FIG11 is another set of interface diagrams provided in an embodiment of the present application;

[0048] FIG12 is another set of interface schematic diagrams provided in an embodiment of the present application;

[0049] FIG13 is another set of interface diagrams provided in an embodiment of the present application;

[0050] FIG14 is another set of interface schematic diagrams provided in an embodiment of the present application;

[0051] FIG15 is another set of interface diagrams provided in an embodiment of the present application;

[0052] FIG16 is another set of interface diagrams provided in an embodiment of the present application;

[0053] FIG17 is another set of interface diagrams provided in an embodiment of the present application;

[0054] FIG18 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the present application, unless otherwise specified, " / " indicates that the objects associated before and after are in an "or" relationship. For example, A / B can represent A or B; "and / or" in the present application is only a description of the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. In addition, in the description of the embodiments of the present application, unless otherwise specified, "multiple" refers to two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, c can be single or multiple. In addition, to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art will understand that the words "first" and "second" do not limit the quantity or execution order, and the words "first" and "second" do not necessarily mean different.

[0056] At the same time, in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner to facilitate understanding.

[0057] In the technical solutions disclosed in this application, the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0058] With the development of terminal technology, users are using electronic devices more and more frequently, and users will use electronic devices to take pictures as souvenirs. After the electronic device captures the captured image, the electronic device can perform audio / video editing on the captured image, such as combining multiple photos into a video, adding background music, adding motion effects, adding text, combining photos and videos, etc., where the captured image includes: photos and / or videos. It can be understood that in actual use, the above-mentioned audio / video editing can also have more functions, and specifically, it can be set according to actual usage needs. For the convenience of the following description, the above-mentioned audio / video editing can be referred to as editing.

[0059] In some solutions, when a user uses an electronic device to edit music, the electronic device can only provide relatively fixed background music.

[0060] For example, the electronic device may be pre-configured with a background music library and configured with a corresponding music control for each piece of background music in the library. In response to a triggering operation on a music control, the electronic device may set the background music corresponding to the music control in the library as the background music for the video. Because the background music in the background music library is relatively fixed and monotonous, the electronic device cannot provide a variety of background music for editing.

[0061] In view of this, an embodiment of the present application provides a method for changing background music. In this method, an electronic device can provide multiple different background music for a user to use through a single music control. In other words, a user can select different background music through the single music control. Since an electronic device can provide multiple different background music through a single music control, the electronic device can provide a variety of background music for editing.

[0062] For example, referring to FIG. 1 , the technical solution provided in the embodiments of the present application can be applied to the process of a user editing a video using an electronic device 100. In particular, it is applicable to the process of a user editing clips generated by the "Moments" function on the electronic device. The "Moments" function of the electronic device can search for images from an album based on the time or location of the user's photo / video capture, and generate clips based on the captured images.

[0063] The electronic device 100 may also be referred to as a terminal, terminal device, user equipment (UE), mobile station (MS), mobile terminal (MT), etc. The electronic device 100 may be a mobile phone, tablet computer, wearable device, smart screen, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), or other electronic device with a display screen; it may also be a vehicle-mounted device with a display screen, such as a car computer or a vehicle-mounted computer; it may also be some smart watches, smart bracelets, or other IoT devices with a display screen. The embodiments of the present application do not impose any restrictions on the product form of the electronic device.

[0064] Next, the hardware structure and software architecture of the electronic device provided in the embodiments of the present application are introduced.

[0065] FIG2 shows a schematic diagram of the hardware structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a touch sensor 180K, and the like.

[0066] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0067] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0068] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0069] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0070] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the electronic device 100. The processor 110 and the display 194 communicate via the DSI interface to implement the display function of the electronic device 100.

[0071] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods from the above embodiments, or a combination of multiple interface connection methods.

[0072] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as augmented reality devices.

[0073] Electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. A GPU is a microprocessor for image processing that connects display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0074] Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0075] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be located on display screen 194. There are many types of pressure sensors 180A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the location of the touch based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch location but with different touch operation intensities can correspond to different operation instructions. For example: When a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, an instruction to create a new short message is executed.

[0076] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.

[0077] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.

[0078] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0079] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150 , and antenna 2 is coupled to wireless communication module 160 , so that electronic device 100 can communicate with other devices through wireless communication technology and network.

[0080] For example, the electronic device 100 may obtain clipping materials generated by other devices through the antenna 1 and the mobile communication module 150 , or through the antenna 2 and the wireless communication module 160 .

[0081] Next, the software architecture of the electronic device 100 is introduced. The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a microservice architecture, or a cloud architecture. The embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software structure of the electronic device 100.

[0082] Figure 3 is a schematic diagram of the software structure of the electronic device 100 according to an embodiment of the present application. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0083] The application layer can include a series of application packages.

[0084] As shown in FIG3 , the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

[0085] The gallery is used to provide functions such as viewing photos and videos, generating editing materials, and editing the editing materials.

[0086] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0087] As shown in FIG3 , the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0088] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0089] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0090] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0091] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0092] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0093] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0094] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0095] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0096] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0097] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0098] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

[0099] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0100] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0101] A 2D graphics engine is a drawing engine for 2D drawings.

[0102] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0103] The following takes the electronic device being a mobile phone, which has the hardware structure shown in FIG2 and the software architecture shown in FIG3 as an example, to introduce the background music replacement method provided in the embodiment of the present application.

[0104] For example, referring to FIG. 4 , the background music replacement method provided in the embodiment of the present application may include steps S400 - S404 .

[0105] S400. Get editing materials via mobile phone.

[0106] As a possible implementation, the mobile phone can generate editing materials based on the shooting time and shooting location of the photo or video. In some embodiments, the above-mentioned editing materials can also be called "moments", "wonderful moments" or videos to be edited.

[0107] For example, referring to FIG5 , if the shooting time of photo A is relatively close to the shooting time of photo B, such as the time difference between the two is less than or equal to the preset duration threshold 1, then photos A and B are added to the editing material A. If the shooting location of photo B is relatively close to the shooting location of video A, such as the distance between the two is less than or equal to the preset distance threshold 1, then photos B and video A are added to the editing material A. Among them, the above-mentioned duration threshold 1 can be 1 hour, 2 hours, 4 hours, etc. The above-mentioned distance threshold 1 can be 1 kilometer, 2 kilometers, 4 kilometers, etc. Specifically, the above-mentioned duration threshold 1 and distance threshold 2 can be set according to actual usage requirements, and the embodiments of the present application do not impose any restrictions on this.

[0108] As another possible implementation, after the mobile phone searches for clip materials from the photo album, it can also pre-edit the clip materials. For example, according to a preset editing template, background music, transition effects, filters, etc. are automatically added to the photos or videos included in the clip materials.

[0109] For example, referring again to Figure 5 , after the mobile phone generates clip material A, it can also pre-edit clip material A to obtain clip material B. In clip material B, photo A is displayed for 10 seconds and photo B is displayed for 5 seconds; background music is played during the display of photos A and B; then, after a transition effect, video A is displayed; photo B has a filter.

[0110] In some embodiments, the mobile phone can generate tags based on the content of the photos or videos included in the clip material, and obtain background music, transition effects, filters, etc. that match the tags based on the tags. Next, the mobile phone pre-edits the clip material searched by the mobile phone based on the background music, transition effects, filters, etc. that match the tags.

[0111] It should be understood that the mobile phone can perform image recognition on the photos or videos on the mobile phone, identify the content of the photos or videos and obtain tags. Among them, the tags can be used to characterize the style, atmosphere, and content of the photos or videos. The specific implementation of this process can be referred to in related technologies, and this embodiment of the application will not be described in detail.

[0112] In some embodiments, the process of the mobile phone searching for clip materials from the photo album and pre-editing the clip materials can be called a "moment" function, and the clip materials can also be called wonderful moments. In other words, the mobile phone can generate clip materials through the "moment" function.

[0113] In other embodiments, the mobile phone can also obtain editing materials from other devices (such as the cloud). For example, the mobile phone can obtain the editing materials under the user account from the cloud through the user account logged in by the mobile phone. It should be understood that the cloud can also generate editing materials from the photos and / or videos under the user account. The specific process of generating editing materials in the cloud can be seen in the description corresponding to Figure 5 above, and this embodiment of the application does not impose any limitation on this.

[0114] It should be understood that in the embodiment of the present application, the mobile phone can also have more ways to obtain clip materials, for example, downloading clip materials from the Internet, or manually editing and generating clip materials by the user, etc. The specific implementation process can be referred to the relevant technology and will not be repeated here.

[0115] S401. The mobile phone displays the first editing interface.

[0116] It should be understood that the above-mentioned editing interface is an interface for editing the above-mentioned editing materials, for example, combining multiple photos included in the above-mentioned editing materials into a video, adding background music to the above-mentioned editing materials, adding motion effects to the above-mentioned editing materials, adding text to the above-mentioned editing materials, etc.

[0117] As a possible implementation, in response to a click operation on a clipping material in the gallery application, the mobile phone displays a clipping interface.

[0118] For example, a user can instruct the phone to open the Gallery app by touching a specific control on the phone screen, pressing a specific physical button or button combination, inputting a voice message, or performing an air gesture. The Gallery app is also known as an album, photo, etc. In response to receiving the user's instruction to open the Gallery app, the phone displays the Gallery main interface.

[0119] For example, referring to FIG6 , a mobile phone displays a desktop 600. In response to a click on an icon 601 corresponding to a gallery application, the mobile phone displays a main interface 610 of the gallery application. The main interface 610 of the gallery application displays thumbnails of multiple pictures and multiple videos, as well as option buttons, such as a "Moments" option button 611.

[0120] Next, in response to a click on the "Moments" option button 611 in the main interface 610 of the Gallery application, the mobile phone displays the Gallery application's "Moments" option menu 620. The Gallery application's "Moments" option menu 620 displays a search box, option buttons, and thumbnails 621 of clips. In the "Moments" option menu 620, the text descriptions of the moment options are filled with diagonal lines to indicate that they are selected.

[0121] Then, in response to a click on the clip thumbnail 621, the phone displays a first clipping interface 630. This first clipping interface 630 includes clipping material 631, playback controls 632, a clipping menu 633, function buttons 634, and an exit button 635. Playback controls 632 control playback parameters of clipping material 631, such as pausing, playing, volume, and progress. The clipping menu 633 provides multiple clipping options for the user to select. These options may include templates 633a, music 633b, filters 633c, and albums 633d. The function buttons 634 provide multiple function options for the user to select. These may include deep editing 634a, sharing 634b, and expansion 634c. The exit button 635 allows the user to exit the current clipping interface and return to the "Moments" options menu 620 of the gallery application. In some embodiments, this first clipping interface may be referred to as the first clipping interface. The above-mentioned music options may be referred to as music controls.

[0122] It should be noted that the above-mentioned clipping menu 633 may include more or fewer clipping options than those shown in FIG6 , and the names and / or icons of the included clipping options may also be different. For example, a template may also be called a theme, background, etc., without any limitation here. Similarly, the above-mentioned function button 634 may also include more or fewer function options than those shown in FIG6 , and the names and / or icons of the included function options may also be different, without any limitation here. It should be pointed out that in FIG6 and the following figures of the embodiments of the present application, the underlined text in the figures, for example, 634a, 634b, etc. in FIG6 , are all figure numbers and should not be understood as elements in the display screen of the mobile phone.

[0123] Specifically, the template option 633a may provide editing templates for the user to select, each of which may include pre-set filters, transitions, music, text, and special effects. The user may add an editing template to the clip material 631 through the template option 633a, that is, add filters, transitions, music, text, and special effects to the clip material 631 according to the editing template.

[0124] The music option 633b can provide multiple pieces of music for the user to choose from, and add background music to the clip material.

[0125] The filter option 633c provides a variety of filters for the user to choose from. By changing the filter, the color tone of the clip material can be changed, such as cold tone, warm tone, black and white tone, etc.

[0126] The album option 633d can provide the user with the ability to view the photos or videos included in the clip material 631 , as well as to add photos, add videos, delete photos, delete videos, and so on to the clip material 631 .

[0127] Deep editing 634a can provide users with more comprehensive and richer editing functions than the above-mentioned first editing interface for editing editing materials.

[0128] For example, in response to a click operation on the depth clip 634a, the mobile phone displays a depth clip interface. Specifically, a detailed description of the depth clip interface is given below, which will not be repeated here.

[0129] Share 634b can provide multiple sharing channels for users to choose from. Users can analyze the editing materials to other software through the analysis channel.

[0130] The extended option 634c can provide the user with extended operations such as saving and renaming the above-mentioned editing material 631.

[0131] It should be noted that in some embodiments, in the first editing interface 630, the clip material 631 can be automatically played. That is, in response to a click on the clip material thumbnail 621, the mobile phone displays the first editing interface 630, and the clip material 631 included in the first editing interface 630 is playing; and the background music of the clip material 631 is the background music added to the clip material 631 when the clip material was generated, such as the template default background music.

[0132] As another possible implementation, after the mobile phone obtains the editing material, the mobile phone can display a notification message, which includes a text description to prompt the user. Next, in response to the user clicking on the notification message, the mobile phone displays the editing interface. The notification message can be displayed on the mobile phone in the form of a push, a card, a drop-down menu bar, etc., and the embodiments of the present application do not impose any restrictions on the display format of the notification message.

[0133] For example, referring to FIG7 , after the mobile phone executes step S400 , the mobile phone displays a notification message. For example, a notification message 701 is displayed as a push notification on the mobile phone's desktop 700 . Next, in response to a click on notification message 701 , the mobile phone displays the first editing interface 630 shown in FIG6 .

[0134] After executing step S401, the mobile phone executes step S402.

[0135] S402. In response to a click operation on the first interface element, the mobile phone displays a second editing interface.

[0136] The first interface element may be the interface element corresponding to the music option 633b in the first editing interface 630 shown in FIG. 6 .

[0137] As a possible implementation, referring to Figures 6 and 8 , in response to a click on the music option 633b, the mobile phone displays a second editing interface 800. The second editing interface 800 includes: an editing material 801, a music material control 802, a music material control menu 803, and a play control 804. The user can use the second editing interface to change the background music for the editing material 801.

[0138] The music material control 802 is used to provide different music material controls for users to use. For example, the music material control 802 includes: a first music material control 802a, a first local music material control 802b, a second local music material control 802c, and a third local music material control 802d, etc. Among them, the first music material control 802a is used to provide an entry for triggering the mobile phone to generate artificial intelligence (AI) music. The above-mentioned local music material controls (such as the first local music material control 802b, the second local music material control 802c, and the third local music material control 802d) correspond to local music. The music material control menu 803 is used to classify the music material controls to provide different types of music material controls for users to use. For example, the music material control menu 803 may include: favorites 803a, recommendations 803b, local 803c, and music library 803d. The playback control 804 is used to control the playback parameters of the clip material 801. For the generation process of AI music, please refer to the steps in the following embodiment, which will not be repeated here.

[0139] It should be understood that the above AI music is random and is generated based on the tags in the clip material. In other embodiments, it can also be replaced with other music, such as music generated by some music generation algorithms, music synthesized by some music synthesis algorithms from local music, etc. Specifically, it can be designed according to actual usage requirements, and the embodiments of this application do not limit this.

[0140] It should be noted that after the mobile phone displays the second editing interface, the clip material 801 may be in a playback state, such as playing the clip material 801 with the template default music corresponding to the first local music material control 802b as the background music. The user can use the play control 804 to control the playback progress of the clip material 801, pause the clip material 801, and so on. The recommendation 803b is in a selected state, and the first local music material control 802b is indicated by a thicker border. In other embodiments, after the mobile phone is triggered to display the second editing interface, the clip material 801 may be in a waiting state, for example, paused at the first frame of the clip material 801. Thereafter, in response to a triggering operation on the play control 804, the mobile phone plays the clip material with the template default music corresponding to the first local music material control 802b as the background music. It is understood that the triggering operation on the play control 804 may be clicking the play button in the play control 804.

[0141] As another possible implementation, see Figures 6 and 8. In response to a click on music option 633b, the phone displays a second editing interface 810. In some scenarios, if the user has not used the AI ​​music function before triggering the phone to display interface 810, that is, if this is the user's first time using the AI ​​music function, a "new" icon will be displayed on the interface element corresponding to AI-created music 812a in the second editing interface 810.

[0142] The user's previous use of the AI ​​music function can be understood as indicating that the user had not used the AI ​​music creation function before triggering the second editing interface on the phone. For example, the user had not clicked on the interface element corresponding to AI music creation 812a in the second editing interface 810. It should be understood that the phone can record whether this is the user's first use of the AI ​​music function through a configuration table. If this is the user's first use of the AI ​​music function, a "new" icon will be displayed on the interface element corresponding to AI music creation.

[0143] In this embodiment, by displaying the "new" icon on the interface element corresponding to AI music creation, the user can directly perceive in the second editing interface that the new AI music function has been added, which can enhance the user experience.

[0144] Optionally, the second editing interface 810 may further include a favorite button 815, which is used to trigger a favorite operation on the currently selected music material control. It should be understood that after the music material control is favorited, the mobile phone can view the music in the favorite menu.

[0145] It should be understood that the “new” icon in the second editing interface 810 shown in FIG8 is merely an example and may have other forms in actual use, and the embodiments of the present application do not impose any limitations on this.

[0146] S403. In response to the click operation on the second interface element, the mobile phone displays the third editing interface.

[0147] The second interface element may be the interface element corresponding to the AI-created music 802a in the second editing interface 800 shown in FIG8 . Alternatively, the second interface element may be the interface element corresponding to the AI-created music 812a in the second editing interface 810 shown in FIG8 .

[0148] It should be understood that one of the purposes of the above-mentioned click operation on the second interface element is to trigger the replacement of the background music of the clip material with AI music. In some other embodiments, it can also be replaced by other operations, such as user-entered voice commands, etc., and the present application embodiment does not impose any restrictions on this.

[0149] As one possible implementation, in response to a click on the second interface element, the phone sends an AI music generation request based on the tags of the clip material, allowing the phone to obtain AI music generated locally on the phone or in the cloud. Next, in response to receiving the AI ​​music, the phone displays the third editing interface.

[0150] Among them, the label of the clip material can be obtained by the label of the photo included in the clip material or the label of the video included in the clip material. Exemplarily, the mobile phone can be deployed with an AI music model locally, and the mobile phone can generate AI music based on the AI ​​music model and the AI ​​music generation request. Alternatively, the mobile phone can also send the above-mentioned AI music generation request to other devices (such as the cloud) that have established a communication connection with the mobile phone, and the other devices send the AI ​​music generated by the other devices to the mobile phone in response to the above-mentioned AI music generation request.

[0151] It is understandable that there may be other more AI music generation processes in specific applications; specifically, regarding the process of AI music generation, please refer to the relevant technology, and the embodiments of this application do not impose any restrictions on this.

[0152] In some embodiments, considering that it takes a certain amount of time for AI music to be generated locally on the phone or in the cloud, in these embodiments, the phone may display a fourth editing interface before displaying the third editing interface. That is, in response to a click on the second interface element, the phone displays the fourth editing interface, which is used to show the status of the AI ​​music being created; while the phone displays the fourth editing interface, the phone waits for the AI ​​music to be generated. Next, in response to the phone acquiring the AI ​​music, that is, the AI ​​music generation is complete, the phone displays the third editing interface.

[0153] In this embodiment, the mobile phone can display the fourth editing interface to enable the user to feel the process of the mobile phone creating AI music, which can enhance the user's immersion in using the editing interface and improve the user's experience.

[0154] For example, referring to FIG9 , in response to a click operation on the second interface element, the mobile phone sends an AI music generation request and displays the fourth editing interface 900. The fourth editing interface 900 includes: editing material 901, music material control 902, and play control 904. The music material control 902 includes a first music material control 902a. Among them, the first music material control 902a is in a selected state, and the relative position of the first music material control 902a in the fourth editing interface 900 is the same as the relative position of the second interface element in the second editing interface 800; the first music material control 902a is used to display the status of AI music being created. For example, the first music material control 902a displays the status of AI music being created through an icon (cover) with loading content; for another example, the first music material control 902a displays the status of AI music being created through a text description of "Creating..."

[0155] It should be noted that the clip material 901 in the fourth editing interface 900 and the clip material 801 in the second editing interface 800 are played consecutively; accordingly, the play control 904 in the fourth editing interface 900 corresponds to the play control 804 in the second editing interface 800. For example, in the second editing interface 800, when the clip material 801 plays to 00:06, the user clicks the second interface element, triggering the phone to display the fourth editing interface 900; then, in the fourth editing interface 900, the clip material 901 continues to play at 00:06; accordingly, in the fourth editing interface 900, the progress bar of the play control 804 is also at 00:06. At the same time, because the AI ​​music has not been generated (or is in the process of being generated) when the phone displays the fourth editing interface 900, the background music of the clip material 901 is the same as the background music of the clip material 801 in the second editing interface 800, i.e., the template default music.

[0156] For example, referring again to FIG9 , in response to obtaining AI music, the mobile phone displays the third editing interface 910. The third editing interface 910 includes: editing material 911, music material control 912, and play control 914. The music material control 912 includes a second music material control 912a. Among them, the second music material control 912a is in a selected state, and the relative position of the second music material control 912a in the fourth editing interface 910 is the same as the relative position of the first music material control 902a in the fourth editing interface 900; the second music material control 912a is used to display AI music and provide users with the option of setting the background music of the editing material 911 to the AI ​​music corresponding to the second music material control 912a. For example, the second music material control displays AI music through a preset icon (cover); for another example, the second music material control displays AI music through a text description of "AI created music 1".

[0157] It should be noted that since the user triggered the switch of the background music of the clip material through the second interface element, clip material 911 can be played again in the third editing interface 910, for example, clip material 911 starts playing at 00:00; accordingly, the play control 904 in the third editing interface 910 is also in the play state, for example, the progress bar of play control 904 starts at 00:00. In addition, the background music of clip material 911 is the AI-composed music 1 corresponding to the second music material control 912a.

[0158] In some embodiments, the third editing interface may further include a plurality of local music material controls corresponding to local music; in this way, the user may also trigger switching the background music of the editing material to local music in the third editing interface.

[0159] For example, referring again to FIG9 , the third editing interface 910 includes: editing material 911, music material controls 912, and playback controls 914. The music material controls 912 include a second music material control 912a corresponding to AI music, and multiple local music material controls corresponding to local music. The local music material controls include a first local music material control 912b, a second local music material control 912c, and a third local music material control 912d.

[0160] It should be understood that in some embodiments, the AI ​​music generated by the AI ​​music model may not have a cover, that is, the AI ​​music obtained by the mobile phone does not have a cover, but only includes music content and logo; therefore, several covers can be preset and displayed in the third editing interface 910, which can enhance the user experience.

[0161] In other embodiments, the above-mentioned AI music may be provided by other third-party suppliers. Therefore, by presetting a cover including the logo of the third-party supplier, users can feel that the AI ​​music is provided by the third-party supplier, which can meet the brand promotion needs of the third-party supplier.

[0162] It is understandable that in some other embodiments, AI music can be generated in advance, such as when the generation time of AI music is relatively short, or when the above-mentioned editing material is generated, the AI ​​music is generated according to the label of the editing material; then, the mobile phone may not display the 4th editing interface and directly display the 3rd editing interface, and the embodiments of the present application are not limited to this. Alternatively, in other embodiments, even if the AI ​​music is generated in advance, the mobile phone can also display the 4th editing interface of a preset length, such as 3 seconds or 5 seconds, and then the mobile phone displays the above-mentioned 3rd editing interface. This allows users to feel the process of the mobile phone creating AI music, enhances the user's sense of immersion in using the editing interface, and enhances the user experience.

[0163] In some scenarios, if the user has not authorized (signed) the relevant user agreement and / or privacy agreement before step S403, the mobile phone may display an agreement pop-up window in step S403, which is used to provide the user with the opportunity to authorize (sign) the relevant user agreement and / or privacy agreement. Next, after the user authorizes (signs) the relevant user agreement and / or privacy agreement, the mobile phone displays the third editing interface described above, or the user displays the third editing interface after displaying the fourth editing interface described above.

[0164] It should be understood that the mobile phone may include a protocol switch, and whether the user has authorized (signed) the relevant user agreement and / or privacy agreement can be represented by the state of the protocol switch. For example, if the protocol switch is turned on, it means that the user has authorized (signed) the relevant user agreement and / or privacy agreement. For another example, if the protocol switch is turned off, it means that the user has not authorized (signed) the relevant user agreement and / or privacy agreement.

[0165] As a possible implementation, the mobile phone can use the user agreement flag to determine whether the user has authorized (signed) the relevant user agreement and / or privacy agreement. For example, if the user has signed the relevant user agreement and / or privacy agreement, the user agreement flag is set to 1; if the user has not signed the relevant user agreement and / or privacy agreement, the user agreement flag is set to 0.

[0166] For example, referring to FIG10 , in response to a click operation on the second interface element, the mobile phone determines, through the user agreement flag, that the relevant user agreement and / or privacy agreement has not been signed, and the mobile phone displays an interface 1000 having an agreement pop-up window 1001. The agreement pop-up window 1001 includes: a first option 1001a, a second option 1001b, and a third option 1001c.

[0167] Next, in response to a click on the first option 1001a, the phone displays the second editing interface. Alternatively, in response to a click on the second option 1001b, the phone sets the user agreement flag to 1 and displays the third editing interface. Alternatively, in response to a click on the third option 1001c, the phone displays the agreement details interface 1010. Agreement details interface 1010 includes a fourth option 1011. In response to a click on the fourth option 1011, the phone displays the second editing interface.

[0168] In some scenarios, the above-mentioned AI music is generated in the cloud that has established a communication connection with the mobile phone, and the mobile phone needs to be connected to the network; therefore, if the mobile phone's network is not connected, the mobile phone will display a network connection pop-up window, which is used to remind the user that the mobile phone is not connected to the network.

[0169] As a possible implementation, the mobile phone can obtain the network connection status of the mobile phone through the system service, and the network connection status includes network disconnected or network connected. When the mobile phone executes step S403, if the network connection status of the mobile phone is network disconnected, the mobile phone displays a network connection pop-up window.

[0170] 10 , in response to a click operation on the second interface element, based on the mobile phone's network status being disconnected, the mobile phone displays an interface 1020 having a network connection pop-up window 1021. The network connection pop-up window 1021 includes a sixth option 1021a and a fifth option 1021b.

[0171] Next, in response to a click on the sixth option 1021a, the mobile phone displays the second editing interface, and the editing material included in the second editing interface is played continuously; or in response to a click on the fifth option 1021b, the mobile phone displays the network settings interface. For an introduction to the network settings interface, please refer to the design of related technologies, and this embodiment of the application will not be repeated here.

[0172] In some embodiments, the process of the mobile phone displaying a network connection pop-up window may be referred to as the mobile phone displaying a network connection prompt.

[0173] In some other embodiments, the click operation on the sixth option can also be expressed as an operation of confirming disconnection from the network. Also, the click operation on the fifth option can also be expressed as an operation of connecting to the network.

[0174] It should be noted that if the user has not previously authorized (signed) the relevant user agreement and / or privacy agreement, and the phone is not connected to the network when the mobile phone executes step S403, the mobile phone will first display the agreement pop-up window, and then display the network connection pop-up window. For example, referring again to Figure 10, in response to a click operation on the second interface element, the mobile phone displays interface 1000 with an agreement pop-up window 1001, and agreement pop-up window 1001 includes a third option 1001b. In response to a click operation on the third option 1001b, the mobile phone displays interface 1020 with a network connection pop-up window 1021.

[0175] In some embodiments, the fact that the mobile phone network is not connected and the protocol switch of the mobile phone is not turned on can be expressed as: the mobile phone meets the second condition.

[0176] In some embodiments, during the above-mentioned AI music generation process, the mobile phone (cloud) can generate multiple AI music at one time. After receiving multiple AI music, the mobile phone can analyze the degree of matching between the multiple AI music and the editing materials, and sort the multiple AI music; then, the mobile phone displays the AI ​​music with the highest matching degree in the third editing interface. Alternatively, during the above-mentioned AI music generation process, multiple AI music and the degree of matching between each AI music and the editing materials are generated; then, the mobile phone displays the AI ​​music with the highest matching degree in the third editing interface.

[0177] For example, the AI ​​music generation process described above generates three AI music tracks based on the tags of the clip material: AI Music 1, AI Music 2, and AI Music 3, and so on. The phone analyzes the degree of match between these three AI music tracks and the clip material, finding AI Music 1 to be the highest, AI Music 2 to be the second highest, and AI Music 3 to be the lowest. Therefore, the phone displays the AI ​​music track with the highest degree of match in the third clip material interface. In other words, the second music track control included in the third clip material interface corresponds to AI Music 1.

[0178] It is understandable that the number of AI music generated by the mobile phone (cloud) can be set according to actual usage needs, for example, 3, 5, 6, etc. In the following embodiments of this application, the example of generating 3 AI music by the mobile phone (cloud) will be used for introduction. The embodiments of this application do not impose any restrictions on the number of AI music generated by the mobile phone (cloud).

[0179] In some scenarios, if the user uses the AI ​​music function for the first time, a prompt message will be displayed at the first position in the third editing interface; wherein the above-mentioned first position is related to the second music material control, and the above-mentioned prompt message is used to prompt the user to switch the AI ​​music used for the background music of the editing material.

[0180] In this way, after observing the prompt information, the user can know how to switch the background music of the editing material in the third editing interface.

[0181] It is understandable that if a user uses the AI ​​music function for the first time, most users will not sign the user agreement. Therefore, the third editing interface with prompt information can be displayed after the user signs the user agreement.

[0182] For example, referring again to FIG. 10 , after the mobile phone displays interface 1000 with an agreement pop-up window 1001, in response to a click on the second optional item 1001b, the mobile phone displays a third editing interface 1030 with a prompt message 1035. Third editing interface 1030 includes music material controls 1032 and prompt message 1035. Music material controls 1032 include a second music material control 1032a. Prompt message 1035 includes a text description such as "Click to create music again, and play three songs in a loop," or "Click to create music again, and play five songs in a loop." The display position of prompt message 1035 is relative to the display position of second music material control 1032a, for example, above the display position of second music material control 1032a.

[0183] It should be understood that the text description included in the above prompt information 1035 may be related to the preset number of AI music on the mobile phone. For example, if the preset number of AI music is 5, the above text description may be "Click to create music again, and 5 songs can be played in a loop."

[0184] Next, after the mobile phone executes step S403, the mobile phone executes step S404.

[0185] S404. In response to the click operation on the third interface element, the mobile phone displays the fifth editing interface.

[0186] The third interface element may be an interface element corresponding to the second music material control 912a in the third editing interface 910 shown in FIG. 9 .

[0187] In some embodiments, the third interface element may also be referred to as a second music option.

[0188] It should be understood that one of the purposes of the click operation on the third interface element is to trigger the switching of the AI ​​music used in the background music of the editing material, for example, switching from AI-composed music 1 to AI-composed music 2. In some other embodiments, other operations may be used instead, such as user input of voice commands, etc., and the present embodiment does not impose any limitation on this.

[0189] As a possible implementation, in response to a click on the third interface element, the mobile phone displays a fifth editing interface. The fifth editing interface includes at least one music material control, and the third editing interface does not include this music material control, and the music material control corresponds to AI music; that is, compared to the third editing interface, the fifth editing interface switches to the music material control corresponding to AI music.

[0190] In this embodiment, the user can switch between multiple AI music through the third interface element, which allows the user to flexibly switch AI music for editing materials.

[0191] For example, referring to FIG11 , in response to a click on the third interface element, the mobile phone displays the fifth editing interface 1100. The fifth editing interface 1100 includes: editing material 1101, music material controls 1102, and play controls 1104. The music material controls 1102 include: a third music material control 1102a and a local music material control; the local music material controls include: a first local music material control 1102b, a second local music material control 1102c, and a third local music material control 1102d. Among them, the third music material control 1102a is selected, and its relative position in the fifth editing interface 1100 is the same as the relative position of the third interface element in the third editing interface. The third music material control 1102a is used to display AI music and allows the user to set the background music of the editing material 1101 to the AI ​​music corresponding to the third music material control 1102a. The local music material control is used to display local music and allows the user to set the background music of the editing material 1101 to the AI ​​music corresponding to the local music material control. For example, the third music material control displays the AI ​​music using a preset icon (cover); for another example, the third music material control displays the AI ​​music using the text description "AI Created Music 2". It should be noted that since the user triggers the switching of the AI ​​music used for the background music of the editing material through the third interface element, the editing material 1101 can be played again in the fifth editing interface, for example, the editing material 1101 starts playing at 00:00. Correspondingly, the progress bar of the play control 1104 starts at 00:00. In addition, the background music of the clip material 1101 is the AI-created music 2 corresponding to the third music material control mentioned above.

[0192] In some embodiments, the fifth editing interface 1100 may be referred to as a second editing interface.

[0193] As another possible implementation, before the mobile phone displays the 5th editing interface, the mobile phone can also display an interface for displaying the AI ​​music creation process, such as the 4th editing interface mentioned above; and after the display time of the interface for displaying the AI ​​music creation process exceeds the preset time, the mobile phone displays the 5th editing interface.

[0194] In this way, users can perceive the process of their mobile phone creating AI music, which can improve the user experience.

[0195] Optionally, after the mobile phone displays the fifth editing interface, the mobile phone may also display the sixth editing interface in response to a click operation on the fourth interface element.

[0196] Among them, the above-mentioned fourth interface element can be an interface element corresponding to the third music material control included in the fifth editing interface.

[0197] It should be understood that one of the purposes of the click operation on the fourth interface element is to trigger the switching of the AI ​​music used in the background music of the editing material, for example, switching from AI-composed music 2 to AI-composed music 3. In some other embodiments, other operations may be used instead, such as user input of voice commands, etc., and the present embodiment does not impose any limitation on this.

[0198] As a possible implementation, in response to a click on the fourth interface element, the mobile phone displays the sixth editing interface. The sixth editing interface includes at least one music material control, and the fifth editing interface does not include the music material control, and the music material control corresponds to AI music; that is, compared with the fifth editing interface, the sixth editing interface switches to the music material control corresponding to AI music.

[0199] It should be understood that in this embodiment, the mobile phone can switch the background music of the editing material to multiple background music, such as AI-created music 1, AI-created music 2, etc., in response to a trigger operation on a touch area, such as the click operation on the second music material control and the click operation on the fourth music material control. In other words, the electronic device can provide different background music for editing. In this way, the user can switch different background music for the editing material through a touch area in the editing interface, which can improve the convenience of the electronic device in changing the background music for the video.

[0200] For example, referring to FIG11 , in response to a click on the third music material control 1102a, the mobile phone displays the sixth editing interface 1110. The sixth editing interface 1110 includes: editing material 1111, music material control 1112, and play control 1114. The music material control 1112 includes: a fourth music material control 1112a, a first local music material control 1112b, a second local music material control 1112c, and a third local music material control 1112d. The fourth music material control 1112a is selected, and its relative position in the sixth editing interface 1110 is the same as the relative position of the third music material control in the fifth editing interface. The fourth music material control 1112a is used to display AI music and allows the user to set the background music of the editing material 1111 to the AI ​​music corresponding to the fourth music material control 1112a. For example, the 4th music material control displays AI music through a preset icon (cover); for another example, the 4th music material control displays AI music through a text description of "AI created music 3".

[0201] In some embodiments, the template default music may be referred to as the first background music, the AI-created music 2 may be referred to as the second background music, and the AI-created music 3 may be referred to as the third background music.

[0202] It should be noted that because the user triggered the AI ​​music used to switch the background music of the clip material through the fourth interface element, in the sixth editing interface, clip material 1111 can be played again, for example, clip material 1111 starts playing at 00:00. Correspondingly, the progress bar of the playback control 1114 starts at 00:00. In addition, the background music of clip material 1111 is the AI-composed music 3 corresponding to the fourth music material control mentioned above.

[0203] After the phone displays the sixth editing interface, it can also respond to a click on the fourth music material control included in the sixth editing interface to display the third editing interface, such as the third editing interface 910 shown in Figure 9. In this way, the phone can cycle through the AI ​​music in the editing interface, allowing users to flexibly switch the AI ​​music used in the editing material, which can enhance the user experience.

[0204] It should be noted that after the mobile phone displays the 6th editing interface, the mobile phone can also display more other editing interfaces. Specifically, it can be determined according to actual usage needs, such as the preset number of AI music. The display process and the displayed interface are similar to the above. In the following embodiments of the present application, the preset number of AI music is 3, such as AI generated music 1, AI generated music 2, and AI generated music 3. For example, it will be introduced. It can be understood that in actual applications, the above preset number can be more or less, such as 2, 5, 8, etc. Specifically, the preset number can be set according to actual usage needs, and the embodiments of the present application do not impose any restrictions on this.

[0205] In some embodiments, the aforementioned preset number may also be referred to as a first number.

[0206] As another possible implementation, the sixth editing interface may further include a return option and a confirmation option. The return option allows the user to trigger an operation to return to the previous interface (e.g., the first editing interface), and the confirmation option is used to trigger an operation to save the background music of the editing material in the current interface. It is understandable that not only the sixth editing interface may also include return information and confirmation options; correspondingly, the third editing interface, the fourth editing interface, or the fifth editing interface may also include the return option and confirmation option.

[0207] Below, taking the 6th editing interface as an example, the return option and confirmation option are briefly introduced.

[0208] Optionally, the sixth editing interface 1110 further includes: a return option 1116a and a confirmation option 1116b. In response to a click on the return option 1116a, the mobile phone displays the first editing interface, and the background music of the editing material is the template default. In response to a click on the confirmation option 1116b, the mobile phone displays the first editing interface, and the background music of the editing material is the AI-created music 3 corresponding to the fourth music material control. In other words, the confirmation option can be used to save the background music change of the editing material in the current interface displayed by the mobile phone, and the return option does not save the background music change of the editing material in the current interface displayed by the mobile phone. It can be understood that similar operations can also be performed on the return option and confirmation option included in the third editing interface, the fourth editing interface or the fifth editing interface, and this application will not go into details here.

[0209] In some embodiments, after the user triggers a click operation on the return option, the mobile phone may also record the music material controls in the current interface; thereafter, the mobile phone displays the first editing interface. Subsequently, in response to a click operation on the first interface element, the mobile phone displays an interface including the music material controls recorded by the mobile phone.

[0210] That is to say, in these embodiments, the mobile phone can memorize the display content in the interface displayed by the mobile phone before the user triggers the return option. In this way, the user can use the editing interface displayed by the mobile phone more flexibly, which can improve the user's experience.

[0211] As a possible implementation, in response to clicking the return option, the mobile phone sets the music material control included in the current interface as the target music material control and displays the first editing interface. Next, in response to clicking the first interface element, the mobile phone displays the target editing interface, which is the editing interface including the target music material control.

[0212] For example, referring to FIG12 , the mobile phone displays the sixth editing interface 2000, which includes the fourth music material control 2002a, the first local music material control 2002b, and a return option 2006a. Subsequently, in response to a click on the return option 2006a, the mobile phone records the fourth music material control 2002a and displays the first editing interface 2010; that is, the mobile phone uses the fourth music material control 2002a as the target music material control. The first editing interface 2010 includes music options 2013b. The first editing interface 2010 also includes editing material 2011, and the background music of editing material 2011 is the template default music corresponding to the first local music material control 2002b.

[0213] Next, in response to a click on music option 2013b, the phone displays a target editing interface including a target music material control. Specifically, the phone displays the aforementioned sixth editing interface 2020. Sixth editing interface 2020 includes fourth music material control 2022a, which is the target music material control. Furthermore, sixth editing interface 2020 also includes a first local music material control 2022b and editing material 2021. First local music material control 2022b is selected, and the background music for editing material 2021 is the template default music corresponding to first local music material control 2022b.

[0214] In other embodiments, the first editing interface may further include an exit button. In response to clicking the exit button, the mobile phone displays a "Moments" option menu in the gallery app. Subsequently, if the user reopens the first editing interface, the mobile phone may re-execute steps S401-S404.

[0215] For example, referring to Figure 13 , the mobile phone displays the sixth editing interface 2100, which includes a return option 2106a. Subsequently, in response to clicking return option 2106a, the mobile phone displays the first editing interface 2110. First editing interface 2110 includes an exit button 2115. Next, in response to clicking exit button 2115, the mobile phone displays the "Moments" options menu 2120 of the gallery app. This menu 2120 includes thumbnails 2121 of clips. Subsequently, in response to clicking clip thumbnails 2121, the mobile phone displays the first editing interface 2110, which includes a music option 2113b. Next, in response to clicking music option 2113b, the mobile phone displays the second editing interface 2130. Second editing interface 2130 includes a first local music control 2132b and a clip 2131. First local music material control 2132b is selected, and the background music for clip material 2131 is the default music for the template corresponding to first local music material control 2132b. Subsequently, if the user clicks the second interface element (e.g., first music material control 2132a included in second clipping interface 2130), triggering the phone to display the third clipping interface, the phone sends another AI generation request, meaning that the phone (in the cloud) once again generates AI music using the AI ​​music model.

[0216] In some embodiments, the AI ​​music corresponding to the third music material control, the AI ​​music corresponding to the second music material control, and the AI ​​music corresponding to the fourth music material control can be generated by the mobile phone (cloud) at one time or multiple times.

[0217] For example, the 4th music material control corresponds to AI created music 3, the 3rd music material control corresponds to AI created music 2, and the 2nd music material control corresponds to AI created music 1; AI created music 1, AI created music 2 and AI created music 3 can all be generated by the mobile phone (cloud) based on the AI ​​music generation request during the above step S402, that is, the mobile phone (cloud) generates multiple AI music at one time.

[0218] For another example, AI created music 1 may be generated by the mobile phone (cloud) based on the AI ​​music generation request in the above step S402; AI created music 2 may be generated by the mobile phone (cloud) again based on the AI ​​music generation request in step S403; AI created music 3 may be generated by the mobile phone (cloud) again based on the AI ​​music generation request after the above-mentioned click operation on the fourth interface element, that is, the mobile phone (cloud) generates multiple AI music in multiple times.

[0219] In the scenario where multiple AI music pieces are generated at one time on a mobile phone (cloud), since the mobile phone has already obtained multiple AI music pieces after displaying the third editing interface mentioned above, that is, the preset number of AI music pieces mentioned above, then if the mobile phone's network is not connected subsequently, the mobile phone will not display the network connection pop-up window.

[0220] In the scenario where a mobile phone (cloud) generates multiple AI music in multiple times, if the mobile phone displays the above-mentioned third editing interface or the fifth editing interface, the network status of the mobile phone is not connected to the network, then the mobile phone will display a network connection pop-up window, which is used to prompt the user that the mobile phone is not connected to the network. If the mobile phone displays the above-mentioned sixth editing interface, the network status of the mobile phone is not connected to the network, then the mobile phone will not display the network connection pop-up window. In other words, the mobile phone will determine whether to display the network connection pop-up window based on the network status and the amount of AI music obtained by the mobile phone.

[0221] It should be understood that in a scenario where a mobile phone (cloud) generates multiple AI music in multiple times, the mobile phone will switch the background music of the clip material in response to a click operation on the second music option. That is, the mobile phone will switch different background music for the clip material according to the number of selection operations on the second music option. Then, when the number of times the background music is switched by the selection operation of the second music option reaches a first number, the mobile phone can also switch the background music even if the mobile phone is not connected to the network. That is to say, when the mobile phone meets the first condition, in response to the selection operation of the second music option, the mobile phone plays the clip material with the second background music. Among them, the first condition includes that the mobile phone is connected to the network, or the first condition includes that the mobile phone is not connected to the network and the number of times the background music is switched in response to the selection operation of the second music option reaches a first number.

[0222] For example, referring again to FIG11 , after the mobile phone displays the fifth editing interface 1100, in response to a click on the third music material control 1102a, based on the mobile phone's network status being disconnected, the mobile phone displays an interface with a network connection pop-up window. The interface with the network connection pop-up window can be found in the description corresponding to FIG10 above. Next, in response to a click on the sixth option included in the network connection pop-up window, the mobile phone displays the fifth editing interface 1100, and the editing material included in the fifth editing interface 1100 continues to play.

[0223] As another example, referring to FIG11 again, after the mobile phone displays the sixth editing interface 1110, in response to a click operation on the third music material control 1102a, based on the network status of the mobile phone being disconnected and the mobile phone having displayed a preset number (e.g., a preset number of 3) of AI music, the mobile phone does not display an interface with a network connection pop-up window, and the mobile phone displays the above-mentioned third editing interface. Among them, the above-mentioned mobile phone has displayed a preset number of AI music, which can be understood as the mobile phone has displayed the AI ​​creation music 1 corresponding to the second music material control through the third editing interface, the mobile phone has displayed the AI ​​creation music 2 corresponding to the third music material control through the fifth editing interface, and the mobile phone has displayed the AI ​​creation music 3 corresponding to the fourth music material control through the sixth editing interface.

[0224] Optionally, after executing step S404, the mobile phone may further execute step S405.

[0225] S405. In response to the sliding operation on the fifth interface element, the mobile phone displays the seventh editing interface.

[0226] Among them, the fifth interface element may include the interface element corresponding to the local music material control in the fifth editing interface 1100 shown in Figure 11 above, such as the first local music material control 1102b, or the second local music material control 1102c, or the third local music material control 1102d.

[0227] It should be understood that one of the purposes of the sliding operation on the fifth interface element is to trigger the mobile phone to display other local music material controls. In some other embodiments, it can also be replaced by other operations, such as user inputting voice commands, etc., and the present application embodiment does not impose any limitation on this.

[0228] As a possible implementation, in response to a sliding operation on the 5th interface element, the display position of the 5th interface element changes with the change of the real-time position of the sliding operation; next, in response to the end of the sliding operation, the mobile phone displays the 7th editing interface. The 7th editing interface includes at least one music material control, and the 5th editing interface does not include the music material control, and the music material control corresponds to local music; that is, compared with the 5th editing interface, the 7th editing interface has switched to the music material control corresponding to local music. The end of the above-mentioned sliding operation can be understood as the user stopping touching the mobile phone screen, that is, the user's hand leaves the screen.

[0229] In this embodiment, the user can switch between multiple local music by sliding operations, which allows the user to flexibly switch local music for editing materials.

[0230] It should be pointed out that in the embodiment of the present application, the switching of AI music is performed by a click operation, and the switching of local music is performed by a sliding operation. That is to say, for AI music and local music, the way users switch between the two is different. Moreover, the display position of the music material control corresponding to AI music will not change with the change of the real-time touch position of the sliding operation, that is, the music material control corresponding to AI music can be fixedly displayed in the editing interface. In this way, it is convenient for users to trigger the replacement of the background music of the music material control with AI music in the editing interface. At the same time, it is also convenient for users to compare the editing materials whose background music is AI music and the editing materials whose background music is local music.

[0231] For example, referring to FIG14 , the mobile phone displays fifth editing interface 1200 ; fifth editing interface 1200 includes third music material control 1202a and third local music material control 1202d ; third music material control 1202a is selected. In response to a drag operation on third local music material control 1202d , the display position of third local music material control 1202d changes according to the touch position during the drag operation. Next, in response to ending the drag operation on third local music material control 1202d , the mobile phone displays seventh editing interface 1210 .

[0232] It should be noted that while the display position of the third local music material control 1202d changes as the touch position changes during the drag operation, the display position of the third music material control 1202a remains fixed, and the selected state of the third music material control 1202a also remains unchanged. For example, in the fifth editing interface 1200 shown in Figure 14, the display position of the third music material control 1202a remains fixed.

[0233] Referring again to Figure 14 , the seventh editing interface 1210 may include: a clip 1211, a third local music material control 1212d, a fourth local music material control 1212e, a fifth local music material control 1212f, a third music material control 1212a, and a play control 1214. Third music material control 1212a is selected, and clip 1211 in the seventh editing interface 1210 and clip 1201 in the fifth editing interface 1200 are played consecutively. Accordingly, play control 1214 in the seventh editing interface 1210 corresponds to play control 1204 in the fifth editing interface. Furthermore, the background music for clip 1211 is the aforementioned third music material control 1212a.

[0234] Optionally, after step S405, the user can also trigger the replacement of the background music of the editing material with local music, such as recommended music D, through the seventh editing interface displayed on the mobile phone.

[0235] Optionally, after step S405, the background music replacement method may further include step S406.

[0236] S406. In response to the click operation on the sixth interface element, the mobile phone displays the eighth editing interface.

[0237] It should be understood that one of the purposes of the above-mentioned click operation on the sixth interface element is to trigger the mobile phone to switch the background music of the clip material to local music. In some other embodiments, it can also be replaced by other operations, such as the user inputting a voice command, etc., and the present application embodiment does not impose any limitation on this.

[0238] In some embodiments, the sixth interface element may also be referred to as the first music option.

[0239] The click operation of the sixth interface element may include the third local music material control 1212d, the fourth local music material control 1212e, or the fifth local music material control 1212f shown in Figure 14. The eighth editing interface has different music material controls in the selected state than the seventh editing interface; and the background music of the editing material is different.

[0240] For example, referring again to FIG. 14 , the mobile phone displays the seventh editing interface 1210. In response to a click on the fifth local music material control 1212f, the mobile phone displays the eighth editing interface 1220. In the eighth editing interface 1220, the fifth local music material control 122f is selected. The eighth editing interface 1220 may include: editing material 1221, the third local music material control 1222d, the fourth local music material control 1222e, the fifth local music material control 1222f, the third music material control 1222a, and the play control 1224. The third local music material control 1222d, the fourth local music material control 1222e, and the fifth local music material control 1222f all correspond to local music material controls. The third music material control 1222a corresponds to AI music, while the fifth local music material control 1222f corresponds to recommended music D. Furthermore, the clip material 1221 in the eighth clipping interface 1220 is being replayed; accordingly, the play control 1224 in the eighth clipping interface 1220 is also in the replaying state. Meanwhile, the background music of the clip material 1221 is the recommended music D corresponding to the fifth local music material control 1222f.

[0241] Next, the background music replacement method provided in the embodiment of the present application is supplemented with some embodiments.

[0242] In some embodiments, the user can enter the deep editing interface through the deep editing 634a of the first editing interface 630, and perform more comprehensive and rich editing of the editing material through the deep editing interface.

[0243] For example, see Figures 6 and 11 above; the mobile phone displays the 6th editing interface 1110. In response to the click operation on the confirmation option 1116b, the mobile phone displays the above-mentioned 1st editing interface 630. That is to say, the user triggers the save of the edit of the editing material; then, the background music of the editing material is the AI ​​music corresponding to the 4th music material control 1112a in the 6th editing interface 1110, such as AI creation music 3. Next, referring to Figures 6 and 15, in response to the click operation on the deep editing 634a, the mobile phone displays the 1st deep editing interface 1300. The 1st deep editing interface 1300 includes editing material 1301 and a music progress bar 1302. Among them, the editing material 1301 is in a paused state, such as paused at 00:00 seconds. And, if the editing material 1301 is played, the background music played by the editing material 1301 is the AI ​​music corresponding to the above-mentioned 4th music material control, such as AI creation music 3. Furthermore, the music progress bar 1302 corresponds to the background music of the editing material, for example, the music progress bar 1302 corresponds to AI-composed music 3. Specifically, the waveform shown in the music progress bar 1302 corresponds to the waveform of AI-composed music 3, or the text description included in the music progress bar is "AI-composed music 3" or the like.

[0244] It should be understood that different designs are possible for the aforementioned deep editing interface. For example, referring again to FIG15 , in response to a click on deep editing, the phone displays a second deep editing interface 1310 . This second deep editing interface 1310 includes: a clip material 1311 and an add AI music option 1313 . Clip material 1311 can be in a playing state, meaning that when the phone displays the second deep editing interface, clip material 1311 automatically plays. The add AI music option 1313 can be used to trigger the addition of AI music to clip material 1311. For example, in response to a click on the add AI music option 1313 , the phone displays a third deep editing interface 1320 . This third deep editing interface 1320 includes: a clip material 1311 , an add AI music option 1313 , a first music progress bar 1322a , and a second music progress bar 1322b . In other words, compared to the second deep editing interface 1310 , the third deep editing page 1320 additionally displays a music progress bar corresponding to the AI ​​music. The first music progress bar 1322a corresponds to AI music, and the second music progress bar 1322b corresponds to AI music. For example, the first music progress bar 1322a corresponds to AI music 3, and the second music progress bar 1322b corresponds to AI music 1. Furthermore, the background music for clip material 1321 is AI music 3 and AI music 1. The phrase "the background music for clip material 1321 is AI music 3 and AI music 1" can be understood to mean that AI music 1 and AI music 3 are played simultaneously, or that they are played interspersed, for example, AI music 1 plays for 5 seconds, followed by 5 seconds of AI music 3, and so on.

[0245] Next, in response to a click operation on the second music progress bar 1322b, the mobile phone switches the AI ​​music corresponding to the second music progress bar 1322b, for example, sets the AI ​​music corresponding to the second music progress bar 1322b to AI created music 2.

[0246] In some other embodiments, the user can access the "Create" option menu of the gallery application through the gallery application. The user can then manage the above-mentioned related user agreements and / or privacy agreements based on the "Create" option menu of the gallery application.

[0247] For example, referring to Figures 6 and 16 above, the mobile phone displays the main interface 610 of the gallery application. Afterwards, in response to a click on the "Create" option button in the main interface of the gallery application, the mobile phone displays a "Create" option menu 1400. The "Create" option menu 1400 includes a clipping option 1401. The clipping option 1401 is used to provide management of the clipping function of the gallery application. Next, in response to a click on the clipping option 1401, the mobile phone displays a first clipping management interface 1410. The clipping management interface 1410 is used to manage the clipping draft box and to manage some historical clipping results such as AABB clipping results, CCDD clipping results, etc. The clipping management interface 1410 also includes an extension option 1411. In response to a click on the extension option 1411, the mobile phone displays additional extended information on the clipping management interface 1410, for example, the mobile phone displays a second clipping management interface 1420. The second clipping management interface includes clipping setting options 1422. In response to a click on the clip settings option 1422, the phone displays a clip settings interface 1430. Clip settings interface 1430 includes a music service switch 1431 and a service agreement option 1432. The status of music service switch 1431 can be either on or off. The status of music service switch 1431 is related to the aforementioned agreement flag, that is, whether the user has authorized (signed) the relevant user agreement and / or privacy agreement. For example, if the agreement flag is 1, music service switch 1431 is on; if the agreement flag is 0, music service switch 1431 is off. FIG16 illustrates the on state of music service switch 1431 as an example. In response to a click on music service switch 1431, the status of music service switch 1431 changes to off. Alternatively, in response to a click on service agreement option 1432, the phone displays an agreement details interface. For details of this agreement details interface, reference may be made to agreement details interface 1010 shown in FIG10 , and will not be further described here.

[0248] In some embodiments, the above-mentioned music service switch may also be referred to as a protocol switch.

[0249] It should be understood that in some scenarios, AI music is time-sensitive, that is, the AI ​​music added to the edited music is time-sensitive. Therefore, the status of the mobile phone's AI music function can be expired or not expired. If the status of the mobile phone's AI music function is expired, the phone will display a service termination notification in the editing interface and will not display the corresponding AI music interface elements in the editing interface.

[0250] For example, after the user edits the clip, the background music is AI-created Music 2. Then, when the user opens the editing interface through the process described in FIG. 6 , the music material control corresponding to AI-created Music 2 is selected. For example, the phone displays the fifth editing interface 1100 shown in FIG. 11 . In this fifth editing interface 1100, the third music material control 1102a is selected, and the background music for clip 1101 is AI-created Music 2, which corresponds to the third music material control 1102a. Next, in response to a click on the third music material control 1102a, and the phone's AI music function is in an expired state, the phone displays a service stop notification. For example, referring to FIG. 17 , the phone displays an interface 1500 with a service stop notification 1501. This interface 1500 includes the service stop notification 1501, which includes a first option 1501a. In response to a click on the first option 1501a, the phone displays the ninth editing interface 1510. The ninth editing interface 1510 includes editing assets 1511 and music asset controls 1502. The music asset controls 1502 include those for local music, but not those for AI music. The music asset controls 1502 include a first local music asset control 1502b, a second local music asset control 1502c, a third local music asset control 1502d, and a fourth local music asset control 1502e. The first local music asset control 1502b is selected, the editing asset 1511 is playing, and the background music playing is the template default music corresponding to the first local music asset control 1502b.

[0251] It should be noted that the personal information used in the technical solution of this application is limited to information for which the individual’s separate consent has been obtained, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) and sign the agreement (authorization) including authorization of relevant user information before the user uses the function.

[0252] In conjunction with the algorithmic steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in hardware or in a manner driven by computer software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered to be beyond the scope of this application.

[0253] In this embodiment, the electronic device can be divided into functional modules according to the above-mentioned method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into a single processing module. The above-mentioned integrated modules can be implemented in the form of hardware. It should be noted that the module division in this embodiment is illustrative and is only a logical functional division. In actual implementation, other division methods may be used.

[0254] An embodiment of the present application also provides an electronic device, as shown in FIG18 , which may include one or more processors 1601 , a memory 1602 , and a communication interface 1603 .

[0255] The memory 1602 and the communication interface 1603 are coupled to the processor 1601. For example, the memory 1602, the communication interface 1603 and the processor 1601 may be coupled together via a bus 1604.

[0256] The communication interface 1603 is used to transmit data with other devices. The memory 1602 stores computer program code. The computer program code includes computer instructions. When the computer instructions are executed by the processor 1601, the electronic device performs the relevant method steps in the above-mentioned method embodiment of the present application.

[0257] The processor 1601 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the present disclosure. The processor may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

[0258] The bus 1604 may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The bus 1604 may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, FIG18 shows only one thick line, but this does not mean that there is only one bus or only one type of bus.

[0259] An embodiment of the present application further provides a computer-readable storage medium, in which computer program code is stored. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiment.

[0260] An embodiment of the present application further provides a computer program product, which, when executed on a computer, enables the computer to execute the relevant method steps in the above method embodiment.

[0261] Among them, the electronic device, computer-readable storage medium or computer program product provided in this application is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above, and will not be repeated here.

[0262] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0263] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0264] The units described as separate components may or may not be physically separate, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0265] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0266] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the contributing part or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a device (which can be a single-chip microcomputer, chip, etc.) or a processor to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0267] The above content is only a specific embodiment of this application, but the scope of protection of this application is not limited to this. Any changes or replacements within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A method for replacing background music, characterized in that: The method comprises: Displaying a first editing interface, playing a video to be edited with a first background music in the first editing interface, wherein the first editing interface also includes a music control; In response to a first trigger operation on the music control, a second editing interface is displayed, wherein the second editing interface includes a first music option and a second music option, and the first music option indicates a first background music: In response to a selection operation of the second music option, playing the video to be edited with the second background music; In response to a selection operation of the first music option, playing the video to be edited with the first background music; In response to a selection operation on the second music option, the video to be edited with a third background music is played, and the third background music is different from the second background music.

2. The method according to claim 1, characterized in that In response to the selection operation of the second music option, playing the video to be edited with the third background music comprises: After playing the video to be edited with the second background music, when the number of times the background music is switched in response to the selection operation of the second music option is less than the first number, playing the video to be edited with the third background music in response to the selection operation of the second music option.

3. The method according to claim 1 or 2, characterized in that: The method further comprises: After playing the video to be edited with the second background music, when the number of times the background music is switched in response to the selection operation of the second music option is greater than or equal to a first number, in response to the selection operation of the second music option, the video to be edited with the second background music is played.

4. The method according to any one of claims 1 to 3, characterized in that: The method is applied to electronic equipment; In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the electronic device satisfies the first condition, in response to a selection operation of the second music option, playing the video to be edited with the second background music; The first condition includes: The electronic device is connected to a network; or, The electronic device is not connected to a network, and the number of times the background music is switched in response to a selection operation of the second music option reaches a first number.

5. The method according to claim 4, characterized in that In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the electronic device is not connected to a network and the number of times the background music is switched in response to the selection operation of the second music option is less than a first number, displaying a network connection prompt in response to the selection operation of the second music option; In response to an operation of connecting to a network, establishing a network connection; After connecting to the network, the second editing interface is displayed, and the video to be edited with the second background music is played in the second editing interface.

6. The method according to claim 5, characterized in that After displaying the network connection prompt, the method further includes: In response to the operation of confirming that the network is not connected, the video to be edited with the first background music is played in the second editing interface.

7. The method according to any one of claims 1 to 6, characterized in that: The second editing interface also includes a first return control; After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: In response to a second trigger operation on the first return control, displaying the first editing interface, and playing the video to be edited with the first background music in the first editing interface; In response to a third trigger operation on the music control, the second editing interface is displayed, and the video to be edited with the first background music is played in the second editing interface.

8. The method according to any one of claims 1 to 6, characterized in that: The second editing interface also includes a save control; After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: In response to a fourth trigger operation on the save control, displaying the first editing interface, and playing the video to be edited with the third background music in the first editing interface; In response to the fifth trigger operation on the music control, a second editing interface is displayed, and the video to be edited with the third background music is played in the second editing interface.

9. The method according to claim 7, characterized in that: The first editing interface also includes a second return control; After displaying the first editing interface in response to the second triggering operation on the first return control, the method further includes: In response to a sixth trigger operation on the second return control, displaying a third interface, wherein the third interface includes an editing entry for the video to be edited; In response to the seventh trigger operation on the editing entry, the first editing interface is displayed, and the video to be edited with the first background music is played in the first editing interface.

10. The method according to any one of claims 1 to 3, characterized in that: The method is applied to an electronic device, wherein the electronic device includes a protocol switch; In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the protocol switch is turned on, in response to a selection operation of the second music option, the video to be edited with the second background music is played.

11. The method according to claim 10, characterized in that In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: In the case where the protocol switch is turned off, in response to a selection operation of the second music option, a prompt for turning on the protocol switch is displayed; In response to an operation of turning on a protocol switch, turning on the protocol switch; After the protocol switch is turned on, the second editing interface is displayed, and the video is played in the second editing interface. The video to be edited has the second background music.

12. The method according to claim 11, characterized in that After the prompt for turning on the protocol switch is displayed, the method further includes: In response to confirming that the protocol switch is not turned on, the video to be edited with the first background music is played in the second editing interface.

13. The method according to any one of claims 1 to 3, characterized in that: The method is applied to an electronic device, wherein the electronic device includes a protocol switch; In response to the selection operation of the second music option, playing the video to be edited with the second background music includes: When the electronic device satisfies the second condition: In response to the selection operation of the second music option, displaying a prompt for turning on a protocol switch; In response to starting the operation of the protocol switch, turning on the protocol switch; After the protocol switch is turned on, a network connection prompt is displayed; In response to an operation of connecting to a network, establishing a network connection; After connecting to the network, displaying the second editing interface, and playing the video to be edited with the second background music in the second editing interface; The second condition includes: the electronic device is not connected to the network, and the protocol switch is not turned on.

14. The method according to any one of claims 1 to 3, characterized in that: The second editing interface also includes a save control; After playing the video to be edited with the third background music in response to the selection operation of the second music option, the method further includes: In response to an eighth trigger operation on the save control, displaying the first editing interface; the first editing interface also includes a first editing control; In response to a ninth trigger operation on the first editing control, a third editing interface is displayed, and a video to be edited with the third background music and an audio track of the third background music are played in the third editing interface; the third editing interface includes a third music option; In response to a selection operation on the third music option, the video to be edited having the third background music and the second background music is played, and the audio track of the second background music is displayed in the third editing interface.

15. The method according to any one of claims 1 to 3, characterized in that: In response to the selection operation of the second music option, playing the video to be edited with the second background music comprises: In response to a selection operation of the second music option, a first music cover and / or a first music name is displayed in the second music option, and the video to be edited with the second background music is played; the first music cover and / or the first music name indicates the second background music; The step of playing the video to be edited with the third background music in response to the selection operation of the second music option comprises: In response to a selection operation on the second music option, a second music cover and / or a second music name are displayed in the second music option, and the video to be edited with the third background music is played; the second music cover and / or the second music name indicate the third background music.

16. An electronic device, characterized in that: The electronic device includes a processor and a memory; the processor is coupled to the memory; the memory is used to store computer program code; the computer program code includes computer instructions, and when the processor executes the above-mentioned computer instructions, the electronic device executes the method described in any one of claims 1-15.

17. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 15.

Images