Display method and apparatus

Abstract

The embodiment of the application provides a display method and device, relates to the technical field of terminals, and the method comprises the following steps: a terminal device displays a second interface, the second interface comprises an icon of a first material and an icon of a second material, the first material is audio, and the second material is an image, audio or video; the terminal device receives a second operation for the second interface; in response to the second operation, the terminal device displays a first icon in the second interface; the terminal device receives a third operation for the first icon; and in response to the third operation, the terminal device displays a third interface, and the third interface comprises the first material and the second material, so that a user can realize unified preview of an image, video and audio in a first application, the user can quickly locate the required material from the first application, and the user can also conveniently batch arrange the materials.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a display method and apparatus. Background Technology

[0002] With the popularization and development of the internet, people's functional needs for terminal devices are becoming increasingly diversified. For example, many terminal devices offer video editing functions, allowing users to create short videos by editing images, videos, and audio materials.

[0003] During video editing, the terminal device can acquire images, videos, and audio materials from different applications based on user operations. However, because these materials are scattered, users may not know where the materials they need are when importing materials, leading to the omission of important materials and affecting the user experience of video editing functions. Summary of the Invention

[0004] This application provides a display method and apparatus that enables users to preview images, videos, and audio in a unified manner within a first application. This facilitates users in quickly locating the required materials within the first application and also makes it easier for users to organize materials in batches.

[0005] In a first aspect, embodiments of this application provide a display method, the method comprising: a terminal device displaying a first interface, the first interface including an icon of a first application; the terminal device receiving a first operation on the icon of the first application; in response to the first operation, the terminal device displaying a second interface, the second interface including an icon of a first material and an icon of a second material, the first material being audio and the second material being an image, audio, or video; the terminal device receiving a second operation on the second interface; in response to the second operation, the terminal device displaying a first icon on the second interface; the terminal device receiving a third operation on the first icon; and in response to the third operation, the terminal device displaying a third interface, the third interface including a first material and a second material.

[0006] This allows users to preview images, videos, and audio in a unified manner within the first application, making it easy for them to quickly locate the materials they need and to organize the materials in batches.

[0007] In one possible implementation, the third interface also includes a first control, and the method further includes: in response to an operation on the first control, the terminal device displays a fourth interface, the fourth interface including a first video, the fourth interface being an interface for editing the video, and the first video being obtained by the terminal device by editing a first material and a second material.

[0008] In this way, compared to users from Figure 4The creation control shown in b in the interface allows users to access the creation function and insert the required materials. Accessing the creation function through the first control makes it convenient for users to create videos at any time based on the material organization and / or the text description of the material group, improving the convenience and flexibility of using the creation function.

[0009] In one possible implementation, the fourth interface may further include one or more of the following: a second control for adding material to the first video, a third control for exporting the video, a control for setting the resolution of the first video, a control for splitting the first video, or a control for setting transitions for the first video.

[0010] In this way, the terminal device can use a variety of functional controls in the fourth interface to perform comprehensive editing of the video.

[0011] In one possible implementation, after the terminal device displays the fourth interface, the method further includes: in response to an operation on the second control, the terminal device displays a fifth interface, the fifth interface including: a first icon and an icon for a third material, the third material being an image, audio, or video; in response to an operation to add the third material to the first video, the terminal device displays the third material in the fourth interface; in response to a user's operation on the third control, the terminal device exports a second video, the second video including the first material, the second material, and the third material; in response to a user's operation to open the third interface, the terminal device displays the third material in the third interface.

[0012] Understandably, since users may add new usable materials to the video during the video creation process, the terminal device can set the materials in the video into a group or add new materials to the original group when it detects that the user has exported the video. This makes it easier for users to view the content of the materials in the video or continue to use the materials in the group to create new videos.

[0013] In one possible implementation, the third interface also includes a control for adding descriptions, and the method further includes: in response to an operation on the control for adding descriptions, the terminal device displays a text box in the third interface; in response to an operation of entering first information in the text box, the terminal device displays the first information in the text box, the first information including: text information and / or to-do items.

[0014] In this way, users can add their creative ideas for the video and the editing progress of any material to the third interface at any time, making the grouping function more flexible and better suited to users' needs.

[0015] In one possible implementation, the second interface further includes a fourth control for viewing a set of materials. The method further includes: in response to an operation on the fourth control, the terminal device displays a sixth interface, which includes a fifth control for viewing more functions; in response to an operation on the fifth control, the terminal device displays a sixth control on the sixth interface for detecting similar materials; in response to an operation on the sixth control, the terminal device displays a second icon on the sixth interface; in response to an operation on the second icon, the terminal device displays a seventh interface, which includes an icon for a third material and an icon for a fourth material, wherein the third material and the fourth material are materials whose similarity meets preset conditions.

[0016] In this way, terminal devices can detect similar materials in multimedia applications, making it easier to organize similar materials in a unified manner and avoiding similar materials occupying too much display space.

[0017] In one possible implementation, the method further includes: in response to the selection of a third material and a fourth material, the terminal device displays a seventh control in a seventh interface for merging similar materials; in response to an operation on the seventh control, the terminal device displays a third icon in a second interface, the third icon displaying one or more of the following: an icon of the third material, an icon of the fourth material, or a third identifier, the third identifier indicating that the third icon corresponds to at least two similar materials.

[0018] Terminal devices can not only detect similar materials in multimedia applications, but also perform processes such as merging and deleting similar materials, improving the user experience of using the similarity detection function and facilitating the management of materials in multimedia applications.

[0019] In one possible implementation, when the seventh interface also includes a fifth material, and the third, fourth, and fifth materials are materials whose similarity meets a preset condition, the method further includes deleting the fifth material after responding to the operation on the seventh control.

[0020] In this way, since the materials that do not need to be merged are usually materials that users no longer need, the terminal device can delete the materials that do not need to be merged from similar materials while merging other materials, thus avoiding occupying storage space.

[0021] In one possible implementation, the method further includes: in response to an operation on a third icon, the terminal device displays an eighth interface, the eighth interface including: a scaled-down icon of a third material, a scaled-down icon of a fourth material, and an eighth control for viewing more functions; in response to an operation on the eighth control, the terminal device displays a first window in the eighth interface, the first window including one or more of the following: a ninth control for setting a cover, or a tenth control for removing a similar image; when the icon of the third material is selected, in response to an operation on the ninth control, the terminal device sets the icon of the third material as the cover, the third icon including the icon of the third material; or, when the icon of the third material is selected, in response to an operation on the tenth control, the terminal device removes the third material from the similar image, and after responding to an operation on the tenth control, the eighth interface does not include the scaled-down icon of the third material.

[0022] In this way, the terminal device can also provide multiple functions such as setting a cover and removing similar images, improving the user experience of using the similarity detection function.

[0023] In one possible implementation, when the third material is audio and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the similarity between the audio in the third material and the fourth material is greater than a first threshold; and / or, when the third material is an image and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the ratio of the number of the first image to the total number of images in the fourth material is greater than a second threshold, and the first image is an image in the fourth material whose similarity to the third material is greater than the third threshold.

[0024] In this way, the terminal device can not only perform similarity detection on materials of the same type, but also on materials of different types, improving the flexibility of the similarity detection function and making it easier for users to organize similar materials in a unified manner.

[0025] In one possible implementation, the sixth interface also includes a fourth icon, and the method further includes: in response to an operation on the fourth icon, the terminal device displays a ninth interface, which includes an icon for the first material, and when the second material is audio, the ninth interface also includes an icon for the second material.

[0026] In this way, the terminal device can not only preview the audio materials, but also organize the audio into a unified material collection, making it convenient for users to view all the audio materials.

[0027] In one possible implementation, the method further includes: in response to the operation of downloading the sixth material, the terminal device displays an icon of the sixth material in the second interface; and / or, in response to the operation of recording to obtain the seventh material, the terminal device displays an icon of the seventh material in the second interface, wherein both the sixth and seventh materials are audio.

[0028] In this way, terminal devices can view downloaded audio content in multimedia applications, solving the problem that it is difficult for users to locate audio files in file management applications, and / or, enabling users to view recordings in multimedia applications, facilitating unified management of all audio materials.

[0029] In one possible implementation, the first material carries at least one first tag, which indicates the type of audio, including one or more of the following: recording, dialogue, song, sound effect, or voiceprint. The method further includes: in response to a user's search for the first tag in a second interface, the terminal device displays a tenth interface, which includes an icon of the first material and the first tag.

[0030] In this way, multimedia applications on terminal devices can intelligently categorize audio files and provide filtering for any audio type, thereby improving the ease with which users can find audio in multimedia applications.

[0031] In one possible implementation, the second operation includes: dragging the icon of the first material to the icon of the second material, or dragging the icon of the second material to the icon of the first material.

[0032] In this way, terminal devices can integrate materials into material groups by dragging and dropping, and this method makes it easy for users to add new materials to the material groups at any time.

[0033] In one possible implementation, the terminal device receives a second operation on the second interface, including: in response to an operation on the icon of the first material in the second interface, the terminal device displays an eleventh interface, the eleventh interface including: an eleventh control for merging at least two materials into a material group, wherein the icon of the first material is selected and the icon of the second material is not selected; if the icon of the second material is selected, the terminal device receives a second operation on the eleventh control.

[0034] In this way, the terminal device can select materials to integrate at least two materials into a material group, and this method makes it easy for users to integrate multiple materials into one material group at once.

[0035] In one possible implementation, the icon of the first material displays a first identifier, which indicates that the first material is audio; the first icon displays one or more of the following: a scaled-down icon of the first material, a scaled-down icon of the second material, and a second identifier, which indicates that the first icon corresponds to at least two materials.

[0036] In this way, the terminal device can quickly locate the audio content through the first identifier, and can also quickly locate the material group through the second identifier, improving the user's flexibility in previewing materials.

[0037] In one possible implementation, the method further includes: in response to an operation on the icon of the first material in the second interface, the terminal device displays a twelfth interface, the twelfth interface including: the first material and a control for pinning the material; in response to an operation on the control for pinning the material, the terminal device displays the first material pinned to the top in the second interface.

[0038] In this way, terminal devices can pin media or media groups to the top of multimedia applications, allowing users to quickly find the media they need and improving the user experience of multimedia applications.

[0039] Secondly, embodiments of this application provide a display device, the device including a display unit and a processing unit. The display unit is used to display a first interface, the first interface including an icon of a first application; the processing unit is used to receive a first operation on the icon of the first application; in response to the first operation, the display unit is further used to display a second interface, the second interface including an icon of a first material and an icon of a second material, the first material being audio and the second material being an image, audio, or video; the processing unit is further used to receive a second operation on the second interface; in response to the second operation, the display unit is further used to display a first icon on the second interface; the processing unit is further used to receive a third operation on the first icon; in response to the third operation, the display unit is further used to display a third interface, the third interface including a first material and a second material.

[0040] Thirdly, embodiments of this application provide a terminal device, including a processor and a memory, wherein the memory is used to store code instructions; and the processor is used to run the code instructions, causing the terminal device to perform the method described in the first aspect or any implementation thereof.

[0041] Fourthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed, cause a computer to perform the method described in the first aspect or any implementation thereof.

[0042] Fifthly, a computer program product comprising a computer program that, when run, causes a computer to perform the methods described in the first aspect or any implementation thereof.

[0043] It should be understood that the second to fifth aspects of this application correspond to the technical solutions of the first aspect of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be repeated here. Attached Figure Description

[0044] Figure 1 A scenario diagram provided for an embodiment of this application;

[0045] Figure 2 This is another scenario illustration provided for an embodiment of this application;

[0046] Figure 3 This is a schematic diagram of the hardware structure of a terminal device provided in an embodiment of this application;

[0047] Figure 4 A schematic diagram of an interface for opening a multimedia application provided in an embodiment of this application;

[0048] Figure 5 A schematic diagram of an interface for downloading audio provided in an embodiment of this application;

[0049] Figure 6 A schematic diagram of an interface for uploading audio provided in an embodiment of this application;

[0050] Figure 7 A schematic diagram of an audio classification interface provided in an embodiment of this application;

[0051] Figure 8 A schematic diagram of an interface for identifying similar materials provided in an embodiment of this application;

[0052] Figure 9 A schematic diagram of an interface for processing similar materials provided in an embodiment of this application;

[0053] Figure 10 This application provides a schematic diagram of a split-screen interface in a multimedia application, as an embodiment of the present application.

[0054] Figure 11 This application provides an example of an interface diagram for integrating a set of materials.

[0055] Figure 12 This application provides an example of an interface diagram for integrating a set of materials.

[0056] Figure 13 This application provides an example of an interface diagram for previewing a set of materials.

[0057] Figure 14 A schematic diagram of an interface for adding materials provided in an embodiment of this application;

[0058] Figure 15 A schematic diagram of a pinned content provided in an embodiment of this application;

[0059] Figure 16 A schematic diagram of a process shown in an embodiment of this application;

[0060] Figure 17 This is a schematic diagram of the structure of a display device provided in an embodiment of this application;

[0061] Figure 18 This is a schematic diagram of the hardware structure of another terminal device provided in an embodiment of this application. Detailed Implementation

[0062] To facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with essentially the same function and effect. For example, the first value and the second value are only used to distinguish different values ​​and do not limit their order. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and the terms "first" and "second" are not necessarily different.

[0063] It should be noted that, in this application, the terms "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or illustration. Any embodiment or design described as "exemplary" or "for example" in this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0064] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0065] With the development of terminal technology and the rise of short videos, more and more users are using the video editing functions on their devices to edit images, videos, and audio materials to create short videos. Before editing a video, users can select the images, videos, and audio materials they want to edit. However, because images and videos are arranged chronologically in the gallery, the materials are scattered, making it difficult to find the materials they need when importing them, leading to the omission of important materials and affecting the user experience of the video editing function.

[0066] For example, Figure 1 This is a schematic diagram of an interface for viewing materials provided in an embodiment of this application. Figure 1 In the corresponding embodiments, a mobile phone is used as an example for illustration. This example does not constitute a limitation on the embodiments of this application.

[0067] When the terminal device receives a message that the user has opened the gallery application, the terminal device can display something like this: Figure 1 The interface shown in 'a' can be a photo display interface, which may include: at least one thumbnail corresponding to a photo, and a toolbar located at the bottom of the screen. The photos may include images and videos, and the at least one photo can be sorted chronologically from most recent to oldest. The toolbar may include a control 101 for viewing the photo album.

[0068] When the terminal device receives a click operation from the user on control 101, the terminal device displays as follows: Figure 1 The interface shown in b can be a photo album display interface, which may include: at least one thumbnail corresponding to a photo album, such as thumbnails corresponding to all photo albums, thumbnails corresponding to video albums, thumbnails corresponding to screenshot and screen recording albums, and thumbnails corresponding to my favorite albums, etc.

[0069] Understandably, to avoid users being unsure where to find the materials they need due to scattered resources, they can store relevant materials in an album. Then, before video editing, they can import the required materials from the album. However, as the number of videos to be edited increases, the number of albums storing the necessary materials will also grow, eventually affecting the user's ability to find materials before editing.

[0070] It is understandable that users have a need for unified management of their materials. Without affecting the album management logic, how to integrate the materials has become an urgent problem to be solved.

[0071] In view of this, embodiments of this application provide a display method that enables a terminal device to display information based on user operations. Figure 1 The interface shown in Figure 'a' integrates at least two materials into a material group, fulfilling the user's need for material integration. The terminal device can also display the materials in the material group based on the user's actions, enabling batch organization of materials within the group. These at least two materials may include audio.

[0072] In one possible implementation, when importing audio materials, the audio is usually stored in a file management application, and the file management application has many folders, deep paths, and messy file names, making it difficult for users to quickly locate the audio.

[0073] When users download audio from the internet or other sources, they may have difficulty quickly locating the audio file. Similarly, when users upload audio from other applications, it can be difficult to find the upload path in file management applications.

[0074] In some possible implementations, after a user downloads an audio file from a video editing application, the audio can only be viewed within that application. Furthermore, due to the limitations of the video editing application, the audio cannot be shared to other applications on the terminal device.

[0075] For example, Figure 2 This is a schematic diagram of another scenario provided for an embodiment of this application.

[0076] When a user needs to view downloaded audio, and the terminal device receives an instruction from the user to open a file management application, the terminal device can display something like this: Figure 2 The interface shown in 'a' allows users to search for audio by file type, file location, or file source.

[0077] Alternatively, if a user needs to upload audio to other applications, the terminal device can display something like this when it receives an action from the user in another application that triggers a control to find the file. Figure 2 The interface shown in b allows users to find the audio file they need to upload through at least one folder stored on their phone.

[0078] Understandably, the lack of unified management for audio files on terminal devices makes viewing, uploading, and using audio files cumbersome. Furthermore, users who frequently use video editing functions need to access audio even more often, and the cumbersome audio search process negatively impacts the user experience.

[0079] Therefore, the display method provided in this application embodiment can also enable a terminal device to achieve unified preview of images, videos, and audio in a first application, making it convenient for users to quickly locate the required audio in the first application. The first application can be the multimedia application described in this application embodiment.

[0080] It is understood that the aforementioned terminal devices can also be referred to as terminals, user equipment (UE), mobile stations (MS), mobile terminals (MT), etc. Terminal devices can be mobile phones, smart TVs, wearable devices, tablets, computers with wireless transceiver capabilities, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, and so on. The embodiments of this application do not limit the specific technologies or device forms used in the terminal devices.

[0081] Therefore, in order to better understand the embodiments of this application, the structure of the terminal device of the embodiments of this application will be described below. For example, Figure 3 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application.

[0082] The terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, an indicator 192, a camera 193, and a display screen 194, etc.

[0083] The sensor module 180 may include one or more of the following: pressure sensor, gyroscope sensor, barometric pressure sensor, magnetic sensor, accelerometer, distance sensor, proximity sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor, or bone conduction sensor, etc., which are not specifically limited in this embodiment.

[0084] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device. In other embodiments of this application, the terminal device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0085] The processor 110 may include one or more processing units. These processing units may be independent devices or integrated within one or more processors. The processor 110 may also include memory for storing instructions and data.

[0086] USB port 130 is a USB standard compliant interface, which can be a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge terminal devices, and can also be used for data transfer between terminal devices and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0087] The charging management module 140 receives charging input from the charger. The charger can be a wireless charger or a wired charger. The power management module 141 connects the charging management module 140 to the processor 110.

[0088] The wireless communication function of the terminal device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor.

[0089] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Antennas in terminal equipment can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization.

[0090] The mobile communication module 150 can provide solutions for wireless communication applications including 2G / 3G / 4G / 5G on terminal devices. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation.

[0091] The wireless communication module 160 can provide solutions for wireless communication applications on terminal devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), etc.

[0092] The terminal device implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering.

[0093] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the terminal device may include one or N display screens 194, where N is a positive integer greater than 1.

[0094] Terminal devices can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0095] Camera 193 is used to capture still images or videos. In some embodiments, the terminal device may include one or N cameras 193, where N is a positive integer greater than 1.

[0096] The external storage interface 120 can be used to connect an external storage card, such as a Micro SD card, to expand the storage capacity of the terminal device. The external storage card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external storage card.

[0097] Internal memory 121 can be used to store executable program code, including instructions. Internal memory 121 may include a program storage area and a data storage area.

[0098] The terminal device can implement audio functions such as music playback and recording through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, and an application processor.

[0099] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The speaker 170A, also called a "loudspeaker," is used to convert audio electrical signals into sound signals. The terminal device can listen to music or hands-free calls through the speaker 170A. The receiver 170B, also called a "handpiece," is used to convert audio electrical signals into sound signals. When the terminal device answers a phone call or voice message, it can listen to the voice by bringing the receiver 170B close to the ear. The headphone jack 170D is used to connect wired headphones. The microphone 170C, also called a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. In this embodiment, the terminal device may have one microphone 170C.

[0100] A pressure sensor is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor may be located on the display screen 194. A gyroscope sensor can be used to determine the motion posture of the terminal device. A barometric pressure sensor is used to measure air pressure. A magnetic sensor includes a Hall effect sensor. An accelerometer can detect the magnitude of acceleration of the terminal device in various directions (typically three axes). A distance sensor is used to measure distance. A proximity sensor may include, for example, a light-emitting diode (LED) and a photodetector, such as a photodiode. An ambient light sensor is used to sense ambient light intensity. A fingerprint sensor is used to collect fingerprints. A temperature sensor is used to detect temperature. A touch sensor, also known as a "touch device," is used. A bone conduction sensor can acquire vibration signals.

[0101] A touch sensor can be placed on the display screen 194, and the touch sensor and the display screen 194 together form a touch screen, also known as a "touchscreen".

[0102] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. The terminal device can receive button input and generate key signal inputs related to user settings and function control of the terminal device. Indicator 192 can be an indicator light, used to indicate charging status, power level changes, messages, missed calls, notifications, etc.

[0103] The software system of terminal devices can adopt layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture, etc., which will not be elaborated here.

[0104] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be implemented independently or in combination with each other. The same or similar concepts or processes may not be described again in some embodiments.

[0105] This application provides a display method that upgrades a gallery application to a multimedia application. The multimedia application can achieve unified management of images, videos, and audio (see [link]). Figure 4 Corresponding embodiments), such as in multimedia applications, can enable users to preview downloaded audio (see...). Figure 5 (Corresponding embodiments), and in multimedia applications, users can also quickly locate audio during the audio upload process (see...). Figure 6 (Corresponding implementation examples).

[0106] It is understandable that terminal devices can set the audio storage path to the folder corresponding to the multimedia application, so that users can view the audio in the multimedia application. Alternatively, it can be understood that the multimedia application can provide a shortcut for viewing audio, making it convenient for users to preview the audio in the multimedia application at any time.

[0107] For example, Figure 4 This is a schematic diagram of an interface for opening a multimedia application, provided as an embodiment of this application.

[0108] Terminal device display as follows Figure 4 The interface shown in 'a' can be called the desktop, and it may include icons 401 for multimedia applications.

[0109] A multimedia application can be an application on a terminal device such as a smartphone or tablet computer used to manage images, videos, and audio. This multimedia application can also edit images, videos, and audio materials. A multimedia application can also be called a "multimedia library" or "resource library," etc. This embodiment does not limit the name of the application.

[0110] When the terminal device receives a click operation from the user on the multimedia application icon 401, the terminal device can display as follows: Figure 4 The interface shown as b in the diagram can be called the "All Materials" interface. The word "Multimedia" may be displayed in the upper left corner of this interface. This interface can include: at least one thumbnail corresponding to a material, and a toolbar at the bottom of the screen. The thumbnails corresponding to at least one material can be sorted chronologically from most recent to oldest. These thumbnails can also be referred to as icons or labels.

[0111] Figure 4The interface shown in b can include a thumbnail 402 corresponding to audio A. The thumbnail 402 can display an audio identifier (such as a musical note-shaped identifier in the upper right corner of the thumbnail 402), the playback duration of audio A (such as the playback duration in the lower left corner of the thumbnail, such as 04:30), and the name or filename of audio A. This embodiment of the application does not limit the specific content displayed in the thumbnail 402.

[0112] The toolbar may include: a control 403 for viewing all materials, a control 404 for viewing the material set, a control for viewing photos by time (or time control), and a control for editing based on the materials (or creation control). Control 403 is selected and displays the word "All", while control 404 displays the word "Material Set".

[0113] When the terminal device receives a click operation from the user on control 404, the terminal device can display as follows: Figure 4 The interface shown as 'c' can be called the media collection interface. The word "Multimedia" may be displayed in the upper left corner of this interface. This interface can include at least one thumbnail corresponding to a media collection, which may include: a photo album media collection, an audio media collection, or a video media collection, etc.

[0114] Figure 4 The interface shown in c can include: thumbnails corresponding to album material sets, thumbnails corresponding to video material sets, and thumbnails 405 corresponding to audio material sets. Thumbnails 405 can display audio identifiers (such as the identifier in the lower left corner of thumbnail 405).

[0115] When the terminal device receives a click operation from the user on thumbnail 405, the terminal device can display as follows: Figure 4 The interface shown as 'd' displays a thumbnail corresponding to audio A. Furthermore, when the terminal device receives a user's trigger action regarding the thumbnail of audio A, it can play audio A and perform other functions. Figure 4 Not shown in the image.

[0116] Based on this, the terminal device can provide a multimedia application that enables unified management of image, video, and audio materials, making it convenient for users to view audio materials at any time.

[0117] exist Figure 4 Based on the corresponding embodiments, multimedia applications may include audio downloaded by the user and used by the terminal device, see details below. Figure 5 Corresponding implementation examples.

[0118] For example, Figure 5 This is a schematic diagram of an interface for downloading audio provided in an embodiment of this application.

[0119] Terminal device display as follows Figure 5 The interface shown in 'a' is a file download interface. This interface can include audio B and audio C, with audio B being selected. When the terminal device receives a user's trigger action on the download control at the bottom of the screen, the terminal device can download audio B to its local storage and provide a shortcut to audio B in the multimedia application, allowing the user to view audio B within the multimedia application.

[0120] In one possible implementation, when the terminal device receives a user's trigger action on the download control at the bottom of the screen, the terminal device can also... Figure 5 The interface shown in Figure 'a' displays a prompt message informing the user that audio B can be viewed from the multimedia application. Figure 5 The interface shown in 'a' is not shown.

[0121] When the terminal device receives a user's command to open the all media interface, the terminal device can display something like this: Figure 5 The interface shown as b in the figure may include: a thumbnail 501 corresponding to audio B, which may display an audio identifier and the playback duration of audio B, such as 3 minutes and 20 seconds. The operation to open the all-materials interface can be performed by the user swiping left or right along the bottom of the screen, or by the user triggering a multimedia application control from the desktop, or by the user triggering the thumbnail corresponding to the multimedia application from the background multitasking interface; this embodiment does not limit the specific actions taken in this application.

[0122] One possible implementation involves the terminal device downloading audio B. The device can then identify the timbre, pitch, and relative loudness of various objects in the audio through timbre recognition, and assign a label to audio B to indicate its type, enabling subsequent filtering of audio B. The audio filtering process can be found in [reference needed]. Figure 7 The corresponding implementation examples will not be described in detail here.

[0123] Based on this, terminal devices can view downloaded audio content in multimedia applications, thus solving the problem that it is difficult for users to locate audio files in file management applications.

[0124] exist Figure 4 Based on the corresponding embodiments, the terminal device can also search for audio in the directory corresponding to the multimedia application and upload the audio to other applications, see details below. Figure 6 Corresponding implementation examples.

[0125] For example, Figure 6This is a schematic diagram of an interface for uploading audio, provided as an embodiment of this application.

[0126] Terminal device display as follows Figure 6 The interface shown in 'a' can be an interface used for uploading materials in other applications. This interface can include a window for selecting a file directory. This window can include: controls for selecting files in the chat, controls for selecting files in the favorites, controls for selecting files from the phone's storage, and controls 601 for selecting files from the phone's multimedia applications. Other content displayed on this interface can be the file directory opened from the phone's storage.

[0127] When the terminal device receives a click operation from the user on control 601, the terminal device can display as follows: Figure 6 The interface shown in b can include thumbnails corresponding to materials in a multimedia application, such as thumbnail 602 for audio A and thumbnail 603 for audio B, etc. A selected control (such as a circular control in the upper right corner of the thumbnail) can be displayed within any thumbnail. Figure 6 The materials displayed in the interface shown in b can be included Figure 5 In the interface shown by b.

[0128] When the terminal device receives the user's request Figure 6 When a user clicks on at least one selected control in the interface shown in b, and then triggers a send control in the upper right corner, the terminal device can upload at least one material corresponding to the at least one selected control to other applications, enabling the uploading of images, videos, or audio.

[0129] Compared to based on Figure 2 In a corresponding embodiment, the terminal device can search for the audio to be uploaded from the directory where the multimedia application is located, thus solving the problem that it is difficult to quickly locate the required audio from at least one folder stored on the mobile phone.

[0130] This application provides a display method that enables multimedia applications to intelligently categorize audio and provide filtering functionality for any audio type.

[0131] For example, Figure 7 This is a schematic diagram of an audio classification interface provided in an embodiment of this application.

[0132] After storing any audio, the terminal device can identify the audio and set at least one tag for the audio according to the identification result to distinguish different types of audio. The type of tag may include one or more of the following: recording, dialogue, song, sound effect, or voiceprint, etc., which are not limited in this embodiment.

[0133] Audio with a recording type can be audio recorded by the terminal device using the recording function. Audio with a recording type can be displayed not only in the recorder application but also in multimedia applications. Audio with a dialogue type can be audio containing at least two speakers.

[0134] When the terminal device receives a message from the user opening the media collection interface, it can display something like this: Figure 7 The interface shown in 'a' may include: thumbnails 701 corresponding to all material sets, thumbnails 702 corresponding to audio material sets, and a search box 705. The all material sets may include all materials in the multimedia application, namely all images, videos, and audio content.

[0135] It is understandable that terminal devices can perform audio filtering not only in any set of materials, but also based on any search box in a multimedia application.

[0136] In one implementation, the terminal device can support audio filtering within any set of materials. For example, when the terminal device receives a user's click on thumbnail 701, the terminal device can display something like... Figure 7 The interface shown in b above displays materials that are similar to... Figure 5 The materials displayed in the interface shown in b are consistent with those in the image. Figure 5 The interface shown in b allows you to view the generation time of the materials.

[0137] Should Figure 7 The interface shown in b can display thumbnails of all materials. The name of the thumbnail 701 can be displayed in the upper left corner of the interface, such as "All Materials". The interface can also display controls 703 for filtering materials.

[0138] When the terminal device receives a click operation from the user on control 703, the terminal device can display as follows: Figure 7 The interface shown in c can include window 704, which includes controls for filtering material sources and controls for filtering audio types. For example, the controls for filtering material sources can include one or more of the following: controls for filtering all materials, controls for filtering materials from local sources, or controls for filtering materials from the cloud. The controls for filtering audio types can include one or more of the following: controls for filtering recordings, controls for filtering dialogues, controls for filtering songs, controls for filtering sound effects, or controls for filtering voiceprints.

[0139] When the terminal device receives a click from the user on the control used to filter songs, the terminal device can display... Figure 7 The interface shown in d can include a thumbnail of audio B, which may carry the song's tag.

[0140] In a possible implementation, when the terminal device receives a user's click on a control used to filter voiceprints, the terminal device can categorize the audio based on different voiceprints. For example, the terminal device can recognize the voiceprints of different users or the voiceprints of animals. In scenarios where the terminal device can recognize the voiceprints of different users, the terminal device can... Figure 7 The interface shown as 'd' displays audio containing user A and audio containing user B, etc. Figure 7 Not shown in the image.

[0141] In a possible implementation, when the terminal device receives a user's click on thumbnail 702, the terminal device can display thumbnails corresponding to all audio files in the multimedia application, as well as control 703, to achieve audio filtering within the audio material set. It is understood that the terminal device can also achieve audio filtering within any material set containing audio materials, or implement it within... Figure 5 Audio filtering is implemented in the interface shown in b, but this embodiment of the application does not limit it.

[0142] In another implementation, the terminal device implements audio filtering based on any search box in the multimedia application, and this search box can be... Figure 5 The search box in the interface shown by b can also be... Figure 7 The search box 705 is shown as a (or e) in the diagram. For example, when the terminal device receives a click operation from the user on the search box 705, the terminal device displays as shown in the diagram. Figure 7 The interface shown in 'e' can include: a search box 705, and a set of materials categorized based on time, portrait, location, and other types.

[0143] In possible implementations, the terminal device can also be based on Figure 5 The search box in the interface shown in b above enables audio filtering, for example, in response to user requests for specific audio content. Figure 5 The triggering action of the search box in the interface shown in b can also be displayed on the terminal device as follows. Figure 7 The interface shown in 'e'.

[0144] When the terminal device receives a user's input of the word "song" in the search box 705, the terminal device can display as follows: Figure 7 The interface shown in d is shown in the figure.

[0145] In a possible implementation, the terminal device can also filter audio types in the all-materials interface using a search box and / or controls for filtering audio types. The specific implementation process is similar to... Figure 7 The corresponding embodiments are similarly described and will not be repeated here.

[0146] Based on this, multimedia applications in terminal devices can intelligently categorize audio files and provide filtering for any audio type, thereby improving the ease with which users can find audio in multimedia applications.

[0147] This application provides a display method that enables multimedia applications to identify similar materials (see...). Figure 8 Corresponding embodiments), and processing of similar materials ( Figure 9 (Corresponding implementation examples).

[0148] For example, Figure 8 This is a schematic diagram of an interface for identifying similar materials, provided as an embodiment of this application.

[0149] When the terminal device receives the user's request Figure 7 When the "More functions" control (which can be displayed as "+") in the upper right corner of the interface shown in Figure 'a' is clicked, the terminal device displays the following: Figure 8 The interface shown in 'a' may include window 801, which may include a control (or test similarity control) 802 for testing similar materials.

[0150] When the terminal device receives a user's trigger operation on control 802, the terminal device can perform similarity detection on all materials in the multimedia application, and display the following when two similar items are detected: Figure 8 The interface shown in b can include thumbnails 803 corresponding to similar items. The upper right corner of the thumbnail 803 can display the number of detected similar items, such as 2.

[0151] The terminal device can detect the similarity between at least two materials, such as detecting the similarity between at least two images, at least two videos, at least two audio recordings, the similarity between an image and a video, and the similarity between a video and an audio recording.

[0152] A specific implementation of detecting the similarity between at least two images can be as follows: When at least two images are captured, the terminal device can assign a label to each photo to indicate the capture time, and during similarity detection, detect at least two images that meet a certain time threshold. Then, when it is determined that the similarity between the at least two images is greater than a first similarity threshold, the at least two images are marked as similar items. And / or, the terminal device can also detect images acquired at different time points, and when it detects that the similarity between at least two images is greater than the first similarity threshold, mark the at least two images as a similar item.

[0153] The specific implementation of detecting the similarity between an image and a video can be as follows: The terminal device can break down the video into single frames and compare the similarity between the image and each image in the video one by one. When the ratio of the number of images whose similarity meets the preset conditions to the number of all images in the video is greater than the third similarity threshold, it is determined that there is similarity between the image and the video, and it is marked as a similar item.

[0154] The specific implementation of detecting the similarity between video and audio can be as follows: the terminal device can extract the audio from the video and compare the similarity between the two audios. For example, when it is determined that the similarity between the two audios is greater than the fourth similarity threshold, it is determined that there is a similarity between the video and the audio, and it is marked as a similar item.

[0155] It is understood that the terminal device may perform similar material detection in response to the user's click operation on the control 802, or the terminal device may perform similar material detection periodically. This application embodiment does not limit this.

[0156] For example, Figure 9 This is a schematic diagram of an interface for processing similar materials, provided as an embodiment of this application. Figure 9 In the corresponding embodiment, the example of detecting at least one similar item containing an image is used for illustration. The processing procedure when the similar item contains video or audio is similar to that for images, and will not be repeated here.

[0157] When the terminal device receives the user's request Figure 8 When the thumbnail 803 in the interface shown in b is clicked, the terminal device can display as follows: Figure 9 The interface shown in 'a'. Figure 9 The interface shown in 'a' can include two detected similar items, such as a similar item containing 10 images and a similar item containing 6 images, which are sorted in chronological order from nearest to farthest.

[0158] When the terminal device receives the user's Figure 9When at least two images are selected (e.g., nine images are selected) in the interface shown in 'a', the terminal device can display as follows: Figure 9 The interface shown in b is... Figure 9 The interface shown in b can be understood as a similar item processing interface. The operation of selecting at least two images may include: a long press operation on any selected image, and a click operation on other images among the at least two images, etc., which are not limited in this embodiment.

[0159] In a possible implementation, when the terminal device receives a long-press operation from a user on any similar image within a certain similarity item, the terminal device can by default select an image within that similarity item whose similarity to the selected similar image is greater than a second similarity threshold, and then display it as shown below. Figure 9 The interface shown in b is an example. The second similarity threshold is greater than the first similarity threshold. For example, a similar item could be an item detected on July 25, 2023.

[0160] Understandably, terminal devices can assist users in filtering similar images by further identifying image similarity, so as to select the most similar image.

[0161] In one possible implementation, when the terminal device receives a long-press operation from a user on any similar image within a certain similar item, the terminal device can select all similar images within that similar item by default. Figure 9 Not shown in the image.

[0162] like Figure 9 The interface shown in b can include one or more of the following: thumbnail 900, a control for selecting all images (or a select all control) 901, a control for selecting all similar images in a similar item 902, a control for deleting selected similar images (or a delete control) 903, and a control for merging similar images (or a merge similar control) 904. The storage size of all images in the selected item can be displayed around the control 902, and the storage size of the selected images can be displayed in the control 903.

[0163] It is understood that in the embodiments of this application, controls 901, 902, 903, and 904 are... Figure 9 The position and form of the content shown in the interface (b) are not specifically limited.

[0164] The terminal device has already selected such Figure 9 In the case of nine similar images shown in b, when the terminal device receives a user's trigger operation on control 904, the terminal device can collapse the selected similar image and then display as shown in the image. Figure 9The interface shown in 'c'. Figure 9 The interface shown in 'c' includes unprocessed similar items.

[0165] Among the possible implementation methods, when the terminal device has already selected such as Figure 9 In the case of nine similar images shown in b, when the terminal device receives a user trigger operation on control 904, the terminal device can merge the nine selected images and delete the image corresponding to thumbnail 900 in the similar items. In this scenario, the image corresponding to thumbnail 900 can be moved to the recently deleted material set, making it easy for the user to retrieve and continue processing similar images at any time. Figure 9 Not shown in the image.

[0166] In one possible implementation, the terminal device may not delete unmerged similar images; that is, the user can manually delete them. Figure 9 In the interface shown in b, unwanted similar images are deleted.

[0167] In one implementation of similar image recovery, the terminal device can tag similar images when it detects them, and these tags remain even after the similar images are deleted. When the terminal device recovers similar images from the recently deleted set of materials, it can redisplay the similar images according to their tags, such as... Figure 9 The interface shown in 'a'.

[0168] In another implementation of similar image recovery, the terminal device can tag similar images when they are detected, and remove the tag when a similar image is deleted. When the terminal device recovers any image from the recently deleted content set, it can trigger a similarity detection process to perform similarity detection on the recovered image and all content in the multimedia application. This similarity detection process can be found in [reference needed]. Figure 8 The corresponding implementation examples will not be described in detail here.

[0169] When the terminal device receives a message from the user opening the all media interface, the terminal device can display something like this: Figure 9 The interface shown in d can include a thumbnail 905, which can display a thumbnail of any one of the merged at least two similar images. The thumbnail 905 can also display an identifier (or similar image identifier) ​​used to indicate that the image contains at least two similar images. In this embodiment, the specific display form of the similar images is not limited.

[0170] When the terminal device receives a trigger operation from the user on thumbnail 905, the terminal device displays as follows: Figure 9The interface shown in 'e' may include one or more of the following: any one of at least two similar images displayed in magnification (such as similar image 910), at least two similar images displayed in zoom-out, or a similar image identifier, which may be set in the following settings: Figure 9 The upper right corner of the interface shown by 'e'.

[0171] At least two similar images that are displayed at a reduced size can be shown Figure 9 Within the rectangle indicated by 'e', ​​the thumbnail corresponding to the similar image 910 can be selected by default, such as the thumbnail located in the middle of the rectangle.

[0172] In a possible implementation, when the terminal device receives an operation from the user selecting a thumbnail corresponding to another similar image within a rectangle, the terminal device can... Figure 9 The selected similar image 911 is magnified in the interface shown by 'e'.

[0173] Furthermore, when a similar image 911 is selected, when the terminal device receives a click operation from the user on control 906, the terminal device can display as follows: Figure 9 The interface shown in f can include: window 907, which can include: control 908 for setting any similar image as the cover, and control 909 for removing any similar image, etc.

[0174] In response to a click on control 908, the terminal device can set a similar image 911 as the cover and display it as such. Figure 9 The thumbnail shown as 'd' in '905' allows terminal devices to quickly locate a specific element by setting a cover for similar items.

[0175] In response to a click on control 909, the terminal device can remove the similar image 911. This removed similar image can be displayed independently in the all-materials interface, for example, in... Figure 9 The interface shown in 'd' displays a thumbnail corresponding to similar image 911. In this scenario, the similar items corresponding to thumbnail 905 may not include similar image 911. Figure 9 Not shown in the image.

[0176] Based on this, terminal devices can not only detect similar materials in multimedia applications, but also perform processing such as merging and deleting similar materials, improving the user experience of using the similarity detection function and facilitating the management of materials in multimedia applications.

[0177] This application provides a display method that enables multimedia applications in a terminal device to display thumbnails and single media corresponding to any thumbnail in the thumbnail in a split-screen format, making it convenient for users to view the media.

[0178] For example, Figure 10 This application provides a schematic diagram of a split-screen display interface in a multimedia application, using a tablet as an example. This example does not constitute a limitation on the embodiments of this application.

[0179] Terminal device display as follows Figure 10 The interface shown in 'a' can display content that is compatible with... Figure 7 The content displayed in the interface shown in b is similar, so it will not be described again here.

[0180] When the terminal device receives a click operation from the user on thumbnail 1001, the terminal device can display... Figure 7 The interface shown in b can include two windows and a control 1002 located between them. The left window 1003 can display thumbnails of all the materials, and the right window 1004 can display the video content corresponding to the thumbnails 1001, thus achieving split-screen display of the two windows. Users can control the display size of the left and right windows using the control 1002, and can also close the right window 1004 by sliding the control 1002 to the far right of the display screen.

[0181] Alternatively, when the terminal device receives an operation from the user dragging thumbnail 1001 to the right side of the display screen (at which point the user releases their grip), the terminal device can display... Figure 7 The interface shown in b is as follows. During the process of dragging thumbnail 1001 to the right side of the display screen, the terminal device... Figure 10 The content in the interface shown by 'a' can be gradually shrunk to... Figure 10 In the left window 1003 shown in b.

[0182] In a possible implementation, when the terminal device receives a user's click on thumbnail 1001 or a user's dragging of thumbnail 1001 to the right side of the display screen, the terminal device can determine whether the display screen resolution meets the preset resolution, and if it determines that the display screen resolution meets the preset resolution, it performs the following... Figure 10 The split-screen display is shown as b in the figure. The preset resolution can be understood as the display resolution that allows the split-screen display to be implemented. For example, the preset resolution can be the display resolution of a foldable screen device or the display resolution of a tablet. In this embodiment, the specific resolution value is not limited.

[0183] Understandably, terminal devices can also be used in... Figure 4 In the full material interface shown in b, split-screen display is achieved through the above-mentioned click or drag operation. In this embodiment, the interface for split-screen display is not limited.

[0184] Based on this, the terminal device can realize split-screen display of all materials as well as any material among all materials, making it easy for users to see the differences between similar materials.

[0185] This application provides a display method that enables multimedia applications in a terminal device to integrate images, videos, and audio into a media group (see...). Figure 11 as well as Figure 12 Corresponding embodiments), and implementation of processing for material groups (see Figure 13 (Corresponding implementation examples).

[0186] In this regard, terminal devices can integrate material groups by dragging and dropping (see...). Figure 11 (Corresponding embodiments), and / or terminal devices can also integrate media groups by triggering grouping controls (see...). Figure 12 (Corresponding implementation examples).

[0187] For example, Figure 11 This is a schematic diagram of an interface for integrating material groups provided in an embodiment of this application.

[0188] Terminal device display Figure 11 As shown in the interface 'a', when the terminal device receives an operation from the user dragging thumbnail 1101 to the area where thumbnail 1102 is located, the terminal device can display the following sequentially: Figure 11 The interface shown in b and Figure 11 The interface shown in 'c'.

[0189] As the user drags thumbnail 1101 to the area where thumbnail 1102 is located, the terminal device can display the identifier 1103 corresponding to thumbnail 1101. Identifier 1103 is used to indicate the position where thumbnail 1101 is moved. Identifier 1103 can be semi-transparent to prevent the application user from viewing other content in the interface.

[0190] Compared to Figure 11 The interface shown in 'a' is... Figure 11 The interface shown in 'c' can display thumbnail 1104. Thumbnail 1104 can display the material group identifier (the identifier displayed in the lower right corner of thumbnail 1104). Thumbnail 1104 can display thumbnails 1101 and 1102 in a reduced state, which are stacked on top of each other. The material group corresponding to thumbnail 1104 can include the image corresponding to thumbnail 1101 and the audio A corresponding to thumbnail 1102.

[0191] In one possible implementation, the terminal device can also add the materials corresponding to other thumbnails to the material group corresponding to thumbnail 1104 based on the user's operation of dragging other thumbnails to the area where thumbnail 1104 is located. As the content of the material group increases, the content of the thumbnails displayed in the stacked thumbnail in thumbnail 1104 also increases.

[0192] It is understood that the specific form of the content displayed in the thumbnail 1104 and the material group identifier is not specifically limited in the embodiments of this application.

[0193] For example, Figure 12 This is a schematic diagram of another integrated material group provided in an embodiment of this application.

[0194] Terminal device display Figure 12 As shown in the interface 'a', when the terminal device receives a long-press operation from the user on thumbnail 1201 (at which point the user releases the press), the terminal device can display as follows: Figure 12 The interface shown in b is shown in the image.

[0195] Figure 12 The interface shown in b can include: a control (or grouping control) 1202 for indicating that at least two materials are combined into a material group, a thumbnail 1201 is selected by default, and controls for selecting materials can be displayed around any thumbnail.

[0196] When the user Figure 12 When the image corresponding to thumbnail 1201, the audio corresponding to thumbnail 1203, and the video corresponding to thumbnail 1204 are selected in the interface shown in b, in response to a click operation on control 1202, the terminal device can integrate the selected three materials into a material group, and then display it as shown in the image. Figure 12 The interface shown in 'c'.

[0197] Compared to Figure 12 The interface shown in 'a' is... Figure 12 The interface shown in 'c' can display thumbnail 1205. Thumbnail 1205 can display material group identifiers. Thumbnail 1205 can display thumbnails 1201, 1203, and 1204 in a reduced state, which are stacked on top of each other. The material group corresponding to thumbnail 1205 can include: the image corresponding to thumbnail 1201, the audio A corresponding to thumbnail 1203, and the video corresponding to thumbnail 1204.

[0198] Understandably, terminal devices can also be used in... Figure 4 In the interface of all materials shown in b, based on Figure 11 as well as Figure 12The corresponding embodiments integrate the material groups, and the specific interface for integrating the material groups is not limited in the embodiments of this application.

[0199] Based on this, the terminal device can be based on Figure 11 as well as Figure 12 The corresponding implementation integrates at least two materials into a material group, making it easier for users to view related materials within the group. Among them, Figure 11 The solution described in the corresponding embodiments allows users to add new materials to the material group at any time. Figure 12 The solution described in the corresponding embodiment makes it easy for users to integrate multiple materials into a single material group at once.

[0200] exist Figure 11 or Figure 12 Based on the corresponding embodiments, the terminal device can also realize functions such as renaming the material group, previewing at least two materials in the material group at the same time, and adding text descriptions to the material group.

[0201] For example, Figure 13 This is a schematic diagram of a preview material group provided in an embodiment of this application.

[0202] Terminal device display as follows Figure 13 As shown in the interface 'a', when the terminal device receives a user's click action on thumbnail 1301, the terminal device can display as follows: Figure 13 The interface shown in b is shown in the image.

[0203] Figure 13 The interface shown in b can be a grouping interface, which may include one or more of the following: images in the material group, audio in the material group, video in the material group, a control 1303 for adding text descriptions to the material group, a control for deleting any material, a control 1302 for creating content using the materials in the material group, etc. In this embodiment of the application, Figure 13 The content displayed in the interface shown in b is not specifically limited.

[0204] Understandably, terminal devices can support users in Figure 13 In the interface shown in b, users can add group descriptions, add to-do items, or rename groups on the left side; furthermore, the terminal device can also support users in... Figure 13 The interface shown in b has options on the right side such as playing audio, playing video, muting multiple videos, and triggering the display of subtitles in the video.

[0205] When the terminal device receives a click operation from the user on the control 1303, the terminal device can display a text box in the area below the control 1303 (such as the area shown in the dashed box 1304). The text box can perform functions such as: information entry, creating to-do items, and marking to-do items as completed.

[0206] For example, in response to a user entering the text "This group contains materials needed for short video 1_12" in the text box, the terminal device creates three to-do items: "1. Need to edit audio and video length, 2. Modify image contrast, and 3. Submit before the afternoon of July 31st," and marks the second to-do item as completed. Figure 13 The interface shown in 'c'.

[0207] When the terminal device receives a click operation from the user on control 1302, the terminal device can automatically edit all the materials in the material group, such as merging the images or videos in the material group into a target video, and setting the audio of the target video to audio A, and then displaying it as shown. Figure 13 The interface shown as 'd' can be understood as a creation interface for editing the material set. The user's click operation on control 1302 can be... Figure 13 The operation of control 1302 in the interface shown in b, or it can also be for... Figure 13 The operation of control 1302 in the interface shown in c.

[0208] In this scenario, the terminal device can not only organize the media sets and add explanatory content for them, but also... Figure 13 In the interface shown by d, you can edit the materials in the material group into a video to achieve video creation.

[0209] like Figure 13 The interface shown in d may include one or more of the following: a control 1307 for adding material to the video, a control 1305 for exporting the video (displayed as "Export"), a control for setting the resolution of the video (displayed as "1080P"), a control for splitting the video (displayed as "Split"), or a control 1306 for setting transitions for the video, etc.

[0210] like Figure 13 As shown in d, the terminal device also supports users in editing videos, setting filters, setting music, adding text, setting special effects, setting picture-in-picture, setting aspect ratio, setting background, and making other adjustments to the video.

[0211] Understandably, compared to users from Figure 4The creation function can be accessed through the creation control shown in b of the interface, and the required materials can be inserted from the creation function. Alternatively, the creation function can be accessed through the control 1302 in the grouping interface, which makes it convenient for users to create videos at any time based on the material organization and / or the text description of the material group, thereby improving the convenience and flexibility of the user's use of the creation function.

[0212] exist Figure 13 Based on the corresponding embodiments, the terminal device can support users to add new materials in the creation interface and integrate the materials of the generated video into a material group.

[0213] For example, Figure 14 This is a schematic diagram of an interface for adding materials, provided as an embodiment of this application.

[0214] Terminal device display as follows Figure 14 The interface shown in 'a' is similar to... Figure 13 The interface shown in d is the same as the one shown in the previous example, so it will not be described again here.

[0215] When the terminal device receives a click operation from the user on control 1307, the terminal device displays as follows: Figure 14 The interface shown in b can include thumbnails 1401 and 1402. Thumbnail 1401 can display the word "Imported", indicating that the material corresponding to thumbnail 1401 has been imported into the video.

[0216] When the terminal device receives a user selection of thumbnail 1402, and subsequently receives a user click on the control 1403 used for adding materials, the terminal device displays as follows: Figure 14 The interface shown in 'c' can include a reduced thumbnail 1402. This can be understood as the terminal device automatically adding the image corresponding to thumbnail 1402 to the video to generate a new video.

[0217] When the terminal device receives a click operation from the user on control 1404, the terminal device can save the newly generated video to the device and, by default, add the image corresponding to thumbnail 1402 to the original group. That is, when the terminal device receives an operation from the user to open a group, the terminal device can display as follows: Figure 14 The interface shown in d can display image 1405, which is the image content corresponding to thumbnail 1402.

[0218] Understandably, when the terminal device does not receive a user's operation on control 1404 to export video content, the terminal device will not add the image corresponding to thumbnail 1402 to the original group.

[0219] Understandably, since users may add new usable materials to the video during the video creation process, the terminal device can set the materials in the video into a group or add new materials to the original group when it detects that the user has exported the video. This makes it easier for users to view the content of the materials in the video or continue to use the materials in the group to create new videos.

[0220] This application provides a display method that enables a terminal device to pin any material or group of materials to the top in a multimedia application.

[0221] For example, Figure 15 This is a schematic diagram of an interface for a pinned material provided in an embodiment of this application.

[0222] Terminal device display Figure 15 The interface shown in 'a' can display content that is compatible with... Figure 5 The content displayed in the interface shown in b is the same, and will not be repeated here. When the terminal device receives a user's click operation on thumbnail 1501, the terminal device can display Figure 15 The interface shown in b has a control 1502 in the upper right corner for pinning materials.

[0223] When the terminal device receives a click operation from the user on control 1502, the terminal device can pin the image corresponding to thumbnail 1501. For example, when the terminal device receives an operation from the user to exit the current interface (or receives an operation from the user to open the all materials interface), the terminal device displays as follows: Figure 15 The interface shown in 'c' can display a thumbnail 1501 on top, and a pinned icon can be displayed within the thumbnail 1501.

[0224] Understandably, terminal devices can not only pin images to the top, but also... Figure 15 The corresponding implementation allows for pinning video, audio, and media groups. When multiple media items are pinned in a multimedia application, these items can be sorted chronologically from most recent to oldest, for example, placing the most recently pinned item first, so that users can easily focus on the pinned item when viewing all media.

[0225] In one possible implementation, the pinned material can also be displayed at the top of the album. Since the pinned material can carry a pinned tag, in response to the user opening any material set, the terminal device can display the material with the pinned tag at the top of the material set.

[0226] Based on this, terminal devices can pin media or media groups to the top in multimedia applications, allowing users to quickly find the media they need and improving the user experience of multimedia applications.

[0227] It is understood that the interface provided in the embodiments of this application is only an example and does not constitute a limitation on the embodiments of this application.

[0228] exist Figures 5-15 Based on the corresponding embodiments, Figure 16 A schematic flowchart shown in an embodiment of this application is provided, such as Figure 16 As shown, the display method may include the following steps:

[0229] S1601. The terminal device displays a first interface, which includes the icon of the first application.

[0230] The first interface can be Figure 4 In the interface shown in Figure a, the first application can be a multimedia application, and the icon of the first application can be icon 401.

[0231] S1602, The terminal device receives a first operation on the icon of the first application.

[0232] The first action can be a click on icon 401.

[0233] S1603. In response to the first operation, the terminal device displays a second interface, which includes an icon for a first material and an icon for a second material. The first material is audio, and the second material is an image, audio, or video.

[0234] The second interface can be Figure 4 The interface shown in b, or Figure 11 The interface shown in 'a', or Figure 12 The interface shown as a (or b) in the diagram. When the second interface is... Figure 12 When the interface shown in b is displayed, the icon of the first material can be thumbnail 1203, and the icon of the second material can be thumbnail 1201 or thumbnail 1204.

[0235] S1604, The terminal device receives a second operation for the second interface.

[0236] The second operation is for the user to group the first and second materials, such as... Figure 11 The drag-and-drop method described in the corresponding embodiments forms groups, or as... Figure 12 The selected materials described in the corresponding embodiment are grouped.

[0237] S1605. In response to the second operation, the terminal device displays the first icon in the second interface.

[0238] The first icon can be Figure 12 The thumbnail 1205 in the interface shown by c in the figure Figure 13The thumbnail shown in 'a' is 1301.

[0239] S1606, The terminal device receives a third operation for the first icon.

[0240] The third operation is a click operation on thumbnail 1301.

[0241] S1607. In response to the third operation, the terminal device displays a third interface, which includes: the first material and the second material.

[0242] The third interface is Figure 13 The interface shown in b is shown in the image.

[0243] Based on this, users can preview images, videos, and audio in a unified manner within the first application, making it easy for users to quickly locate the materials they need and also facilitating batch organization and preview of materials.

[0244] In one possible implementation, the third interface also includes a first control, and the method further includes: in response to an operation on the first control, the terminal device displays a fourth interface, the fourth interface including a first video, the fourth interface being an interface for editing the video, and the first video being obtained by the terminal device by editing a first material and a second material.

[0245] The first control is Figure 13 The control 1302 shown in b (or c) can be the fourth interface. Figure 13 The interface shown in d is shown in the image.

[0246] In one possible implementation, the fourth interface may also include one or more of the following: a second control for adding material to the first video, a third control for exporting the video, a control for setting the resolution of the first video, a control for splitting the first video, or a control for setting transitions for the first video.

[0247] like Figure 13 In the interface shown by d, the second control is control 1307, the third control can be control 1305, the control used to set the resolution of the first video can be the control that displays "1080p", the control used to split the first video can be the control that displays the word "split", and the control used to set the transition for the first video can be control 1306.

[0248] In one possible implementation, after the terminal device displays the fourth interface, the method further includes: in response to an operation on the second control, the terminal device displays a fifth interface, the fifth interface including: a first icon and an icon for a third material, the third material being an image, audio, or video; in response to an operation to add the third material to the first video, the terminal device displays the third material in the fourth interface; in response to a user's operation on the third control, the terminal device exports a second video, the second video including the first material, the second material, and the third material; in response to a user's operation to open the third interface, the terminal device displays the third material in the third interface.

[0249] The fifth interface can be Figure 14 In the interface shown in b, the first icon can be thumbnail 1401, and the third icon can be thumbnail 1402.

[0250] like Figure 14 The interface shown as 'c' can include third-party materials; such as... Figure 14 The interface shown in d can include third-party materials, such as the material indicated by 1405.

[0251] In one possible implementation, the third interface also includes a control for adding descriptions, and the method further includes: in response to an operation on the control for adding descriptions, the terminal device displays a text box in the third interface; in response to an operation of entering first information in the text box, the terminal device displays the first information in the text box, the first information including: text information and / or to-do items.

[0252] The control used to add descriptions can be Figure 13 The control 1303 shown in b can be a text box displayed in area 1304, and the first information can be... Figure 13 The content displayed within the dashed box 1304 in the interface shown by c.

[0253] In one possible implementation, the second interface further includes a fourth control for viewing a set of materials. The method further includes: in response to an operation on the fourth control, the terminal device displays a sixth interface, which includes a fifth control for viewing more functions; in response to an operation on the fifth control, the terminal device displays a sixth control on the sixth interface for detecting similar materials; in response to an operation on the sixth control, the terminal device displays a second icon on the sixth interface; in response to an operation on the second icon, the terminal device displays a seventh interface, which includes an icon for a third material and an icon for a fourth material, wherein the third material and the fourth material are materials whose similarity meets preset conditions.

[0254] The fourth control can be Figure 4Control 404 in the interface shown in b; the sixth interface can be as follows Figure 8 The interface shown in 'a' (or Figure 4 The interface shown in 'c'); the fifth control can be... Figure 8 The top right corner of 'a' displays more functional controls (more functional controls can be displayed as "+"); the sixth control can be control 802; the second icon can be... Figure 8 The thumbnail shown in b is 803; the seventh interface can be... Figure 9 The interface shown in a (or b) of the diagram.

[0255] In one possible implementation, the method further includes: in response to the selection of a third material and a fourth material, the terminal device displays a seventh control in a seventh interface for merging similar materials; in response to an operation on the seventh control, the terminal device displays a third icon in a second interface, the third icon displaying one or more of the following: an icon of the third material, an icon of the fourth material, or a third identifier, the third identifier indicating that the third icon corresponds to at least two similar materials.

[0256] The seventh control can be Figure 9 The control 904 shown in b in the image, where the terminal device displays a third icon on the second interface, can be understood as the terminal device in... Figure 9 The interface shown in d displays thumbnail 905, and the third identifier can be a similar image identifier in thumbnail 905.

[0257] In one possible implementation, when the seventh interface also includes a fifth material, and the third, fourth, and fifth materials are materials whose similarity meets a preset condition, the method further includes deleting the fifth material after responding to the operation on the seventh control.

[0258] The fifth material can be Figure 9 The unselected material in the interface shown by b, such as the material corresponding to thumbnail 900.

[0259] In one possible implementation, the method further includes: in response to an operation on a third icon, the terminal device displays an eighth interface, the eighth interface including: a scaled-down icon of a third material, a scaled-down icon of a fourth material, and an eighth control for viewing more functions; in response to an operation on the eighth control, the terminal device displays a first window in the eighth interface, the first window including one or more of the following: a ninth control for setting a cover, or a tenth control for removing a similar image; when the icon of the third material is selected, in response to an operation on the ninth control, the terminal device sets the icon of the third material as the cover, the third icon including the icon of the third material; or, when the icon of the third material is selected, in response to an operation on the tenth control, the terminal device removes the third material from the similar image, and after responding to an operation on the tenth control, the eighth interface does not include the scaled-down icon of the third material.

[0260] The eighth interface can be Figure 9 The interface shown in 'e'; the eighth control can be control 906; the first window can be... Figure 9 In the window 907 shown by f, the ninth control can be control 908, and the tenth control can be control 909.

[0261] In one possible implementation, when the third material is audio and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the similarity between the audio in the third material and the fourth material is greater than a first threshold; and / or, when the third material is an image and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the ratio of the number of the first image to the total number of images in the fourth material is greater than a second threshold, and the first image is an image in the fourth material whose similarity to the third material is greater than the third threshold.

[0262] In one possible implementation, the sixth interface also includes a fourth icon, and the method further includes: in response to an operation on the fourth icon, the terminal device displays a ninth interface, which includes an icon for the first material, and when the second material is audio, the ninth interface also includes an icon for the second material.

[0263] The fourth icon can be Figure 4 The thumbnail shown in 'c' is 405; the ninth interface can be... Figure 4 The interface shown in d is shown in the figure.

[0264] In one possible implementation, the method further includes: in response to the operation of downloading the sixth material, the terminal device displays an icon of the sixth material in the second interface; and / or, in response to the operation of recording to obtain the seventh material, the terminal device displays an icon of the seventh material in the second interface, wherein both the sixth and seventh materials are audio.

[0265] In one possible implementation, the first material carries at least one first tag, which indicates the type of audio, including one or more of the following: recording, dialogue, song, sound effect, or voiceprint. The method further includes: in response to a user's search for the first tag in a second interface, the terminal device displays a tenth interface, which includes an icon of the first material and the first tag.

[0266] The tenth interface is Figure 7 The interface shown in d is shown in the figure.

[0267] In one possible implementation, the second operation includes: dragging the icon of the first material to the icon of the second material, or dragging the icon of the second material to the icon of the first material.

[0268] In one possible implementation, the terminal device receives a second operation on the second interface, including: in response to an operation on the icon of the first material in the second interface, the terminal device displays an eleventh interface, the eleventh interface including: an eleventh control for merging at least two materials into a material group, wherein the icon of the first material is selected and the icon of the second material is not selected; if the icon of the second material is selected, the terminal device receives a second operation on the eleventh control.

[0269] The eleventh interface is Figure 12 In the interface shown by b, the eleventh control can be control 1202.

[0270] In one possible implementation, the icon of the first material displays a first identifier, which indicates that the first material is audio; the first icon displays one or more of the following: a scaled-down icon of the first material, a scaled-down icon of the second material, and a second identifier, which indicates that the first icon corresponds to at least two materials.

[0271] The first identifier is the audio identifier described in the embodiments of this application, and the second identifier is the material group identifier described in the embodiments of this application.

[0272] In one possible implementation, the method further includes: in response to an operation on the icon of the first material in the second interface, the terminal device displays a twelfth interface, the twelfth interface including: the first material and a control for pinning the material; in response to an operation on the control for pinning the material, the terminal device displays the first material pinned to the top in the second interface.

[0273] The twelfth interface can be... Figure 15 In the interface shown in 'a', the control used to pin the material is control 1502.

[0274] The above combination Figures 4-16The methods provided in the embodiments of this application have been described. The apparatus for executing the above methods, provided in the embodiments of this application, is described below. Figure 17 As shown, Figure 17 This is a schematic diagram of the structure of a display device provided in an embodiment of this application. The display device may be a terminal device in the embodiment of this application, or a chip or chip system within a terminal device.

[0275] like Figure 17 As shown, the display device 1700 can be used in communication equipment, circuits, hardware components, or chips. The display device 1700 includes a display unit 1701 and a processing unit 1702. The display unit 1701 supports the display steps performed by the display method; the processing unit 1702 supports the information processing steps performed by the display device 1700.

[0276] In one possible implementation, the display device 1700 may further include a communication unit 1703, which supports the display device 1700 in performing steps such as receiving or sending messages.

[0277] The display devices described in the embodiments of this application may include all of the following: Figure 17 The units described in the corresponding embodiments.

[0278] Specifically, the processing unit 1702 can be integrated with the display unit 1701, and the processing unit 1702 and the display unit 1701 may communicate with each other.

[0279] In one possible implementation, the display device 1700 may further include a storage unit 1704. The storage unit 1704 may include one or more memories, which may be devices in one or more devices or circuits used to store programs or data.

[0280] The storage unit 1704 can exist independently or be connected to the processing unit 1702 via a communication bus. Alternatively, the storage unit 1704 can be integrated with the processing unit 1702.

[0281] Taking the display device 1700 as an example, which may be a chip or chip system of the terminal device in the embodiments of this application, the storage unit 1704 may store computer execution instructions of the method of the terminal device, so that the processing unit 1702 executes the method of the terminal device in the above embodiments. The storage unit 1704 may be a register, cache, or random access memory (RAM), etc., and the storage unit 1704 may be integrated with the processing unit 1702. The storage unit 1704 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and the storage unit 1704 may be independent of the processing unit 1702.

[0282] In one possible implementation, the display device 1700 may further include a communication unit 1703. The communication unit 1703 supports interaction between the display device 1700 and other devices. For example, when the display device 1700 is a terminal device, the communication unit 1703 may be a communication interface or interface circuit. When the display device 1700 is a chip or chip system within a terminal device, the communication unit 1703 may be a communication interface. For example, the communication interface may be an input / output interface, pins, or circuits.

[0283] The apparatus in this embodiment can be used to execute the steps performed in the above method embodiments, and its implementation principle and technical effect are similar, so they will not be described again here.

[0284] Figure 18 This is a schematic diagram of the hardware structure of another terminal device provided in an embodiment of this application.

[0285] The terminal device includes a processor 1801, a communication line 1804, and at least one communication interface. Figure 18 (The example is illustrated using communication interface 1803).

[0286] The processor 1801 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits used to control the execution of programs according to the present application.

[0287] Communication line 1804 may include circuitry for transmitting information between the aforementioned components.

[0288] The communication interface 1803 uses any transceiver-like device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0289] The terminal device may also include a memory 1802.

[0290] The memory 1802 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed discs, laser discs, optical discs, digital universal discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. The memory may exist independently and be connected to the processor via communication line 1804. The memory may also be integrated with the processor.

[0291] The memory 1802 stores computer execution instructions for implementing the scheme of this application, and its execution is controlled by the processor 1801. The processor 1801 executes the computer execution instructions stored in the memory 1802 to implement the method provided in the embodiments of this application.

[0292] It is possible that the computer execution instructions in the embodiments of this application may also be referred to as application code, and the embodiments of this application do not specifically limit this.

[0293] In a specific implementation, as one example, the processor 1801 may include one or more CPUs, for example... Figure 18 CPU0 and CPU1 in the CPU.

[0294] In a specific implementation, as one example, the terminal device may include multiple processors, for example... Figure 18Processors 1801 and 1805 are mentioned. Each of these processors can be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. A processor here can refer to one or more devices, circuits, and / or processing cores used to process data (such as computer program instructions).

[0295] In the above embodiments, the instructions stored in the memory for execution by the processor can be implemented in the form of a computer program product. This computer program product can be pre-written into the memory, or it can be downloaded and installed into the memory as software.

[0296] A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the flow or function according to the embodiments of this application is generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a server or data center that integrates one or more available media. For example, available media may include magnetic media (e.g., floppy disks, hard disks, or magnetic tapes), optical media (e.g., digital versatile discs (DVDs)), or semiconductor media (e.g., solid-state disks (SSDs)).

[0297] This application also provides a computer-readable storage medium. The methods described in the above embodiments can be implemented, in whole or in part, by software, hardware, firmware, or any combination thereof. The computer-readable medium may include computer storage media and communication media, and may also include any medium capable of transferring a computer program from one place to another. The storage medium can be any target medium accessible by a computer.

[0298] As one possible design, computer-readable media may include compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disc storage; computer-readable media may also include disk storage or other disk storage devices. Furthermore, any connecting cable may also be appropriately referred to as computer-readable media. For example, if software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of media. As used herein, disks and optical discs include optical discs (CD), laser discs, optical discs, digital versatile discs (DVD), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while optical discs optically reproduce data using lasers.

[0299] The above combinations should also be included within the scope of computer-readable media. The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

[0300] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties. Furthermore, the collection, use and processing of the relevant data must comply with relevant laws, regulations and standards, and corresponding operation entry points are provided for users to choose to authorize or refuse.

Claims

1. A display method, characterized in that, The method includes: The terminal device displays a first interface, which includes an icon for a first application. The terminal device receives a first operation on the icon of the first application; In response to the first operation, the terminal device displays a second interface, which includes an icon for a first material and an icon for a second material, wherein the first material is audio and the second material is an image, audio or video. The terminal device receives a second operation on the second interface; the second operation is used to group the first material and the second material. In response to the second operation, the terminal device displays a first icon in the second interface; The terminal device receives a third operation targeting the first icon; In response to the third operation, the terminal device displays a third interface, which includes the first material and the second material.

2. The method according to claim 1, characterized in that, The third interface also includes a first control, and the method further includes: In response to an operation on the first control, the terminal device displays a fourth interface, which includes a first video. The fourth interface is an interface for editing the video, and the first video is obtained by the terminal device by editing the first material and the second material.

3. The method according to claim 2, characterized in that, The fourth interface further includes one or more of the following: a second control for adding material to the first video, a third control for exporting the video, a control for setting the resolution of the first video, a control for splitting the first video, or a control for setting transitions for the first video.

4. The method according to claim 3, characterized in that, After the terminal device displays the fourth interface, the method further includes: In response to an operation on the second control, the terminal device displays a fifth interface, which includes: the first icon and the icon of the third material, wherein the third material is an image, audio or video; In response to the operation of adding the third material to the first video, the terminal device displays the third material in the fourth interface; In response to a user's operation on a third control, the terminal device exports a second video, which includes the first material, the second material, and the third material. In response to the user opening the third interface, the terminal device displays the third material in the third interface.

5. The method according to any one of claims 1-4, characterized in that, The third interface also includes controls for adding descriptions, and the method further includes: In response to an operation on the control used to add instructions, the terminal device displays a text box in the third interface; In response to the input of first information in the text box, the terminal device displays the first information in the text box, the first information including: text information and / or to-do items.

6. The method according to any one of claims 1-4, characterized in that, The second interface also includes a fourth control for viewing the media set, and the method further includes: In response to an operation on the fourth control, the terminal device displays a sixth interface, which includes a fifth control for viewing more functions; In response to an operation on the fifth control, the terminal device displays a sixth control for detecting similar materials in the sixth interface; In response to an operation on the sixth control, the terminal device displays a second icon in the sixth interface; In response to an operation on the second icon, the terminal device displays a seventh interface, which includes an icon for a third material and an icon for a fourth material, wherein the third material and the fourth material are materials whose similarity meets a preset condition.

7. The method according to claim 6, characterized in that, The method further includes: In response to the selection of the third and fourth materials, the terminal device displays a seventh control for merging similar materials in the seventh interface; In response to an operation on the seventh control, the terminal device displays a third icon in the second interface, the third icon displaying one or more of the following: an icon of the third material, an icon of the fourth material, or a third identifier, the third identifier being used to indicate that the third icon corresponds to at least two similar materials.

8. The method according to claim 7, characterized in that, When the seventh interface further includes a fifth material, and the third, fourth, and fifth materials are materials whose similarity meets a preset condition, the method further includes, in response to the operation on the seventh control, the terminal device deleting the fifth material.

9. The method according to claim 7 or 8, characterized in that, The method further includes: In response to an operation on the third icon, the terminal device displays an eighth interface, which includes: a scaled-down icon of the third material, a scaled-down icon of the fourth material, and an eighth control for viewing more functions; In response to an operation on the eighth control, the terminal device displays a first window in the eighth interface, the first window including one or more of the following: a ninth control for setting a cover, or a tenth control for removing a similar image; When the icon of the third material is selected, in response to the operation on the ninth control, the terminal device sets the icon of the third material as the cover, and the third icon includes the icon of the third material; Alternatively, when the icon of the third material is selected, in response to an operation on the tenth control, the terminal device moves the third material out of the similar image, and after responding to the operation on the tenth control, the eighth interface does not include the scaled-down icon of the third material.

10. The method according to claim 6, characterized in that, When the third material is audio and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the similarity between the audio in the third material and the fourth material is greater than a first threshold; And / or, when the third material is an image and the fourth material is a video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the ratio of the number of first images to the total number of images in the fourth material is greater than a second threshold, and the first image is the image in the fourth material whose similarity to the third material is greater than the third threshold.

11. The method according to claim 6, characterized in that, The sixth interface also includes a fourth icon, and the method further includes: In response to an operation on the fourth icon, the terminal device displays a ninth interface, which includes an icon for the first material and, when the second material is audio, an icon for the second material.

12. The method according to any one of claims 1-4, 7-8, and 10-11, characterized in that, The method further includes: In response to the operation of downloading the sixth material, the terminal device displays an icon of the sixth material in the second interface; And / or, in response to the operation of obtaining a seventh material through recording, the terminal device displays an icon of the seventh material in the second interface, wherein both the sixth material and the seventh material are audio.

13. The method according to any one of claims 1-4, 7-8, and 10-11, characterized in that, The first material carries at least one first tag, the first tag being used to indicate the type of audio, the type of audio including one or more of the following: recording, dialogue, song, sound effect, or voiceprint; the method further includes: In response to a user's search for the first tag in the second interface, the terminal device displays a tenth interface, which includes the icon of the first material and the first tag.

14. The method according to any one of claims 1-4, 7-8, and 10-11, characterized in that, The second operation includes: dragging the icon of the first material to the icon of the second material, or dragging the icon of the second material to the icon of the first material.

15. The method according to any one of claims 1-4, 7-8, and 10-11, characterized in that, The terminal device receives a second operation for the second interface, including: In response to an operation on the icon of the first material in the second interface, the terminal device displays an eleventh interface, which includes an eleventh control for merging at least two materials into a material group, wherein the icon of the first material is selected and the icon of the second material is not selected. When the icon of the second material is selected, the terminal device receives a second operation on the eleventh control.

16. The method according to any one of claims 1-15, characterized in that, The icon of the first material displays a first identifier, which indicates that the first material is audio; the first icon displays one or more of the following: a scaled-down icon of the first material, a scaled-down icon of the second material, and a second identifier, which indicates that the first icon corresponds to at least two materials.

17. The method according to any one of claims 1-4, 7-8, and 10-11, characterized in that, The method further includes: In response to an operation on the icon of the first material in the second interface, the terminal device displays a twelfth interface, which includes: the first material and a control for pinning the material to the top; In response to an operation on the control for pinning the material, the terminal device displays the first material at the top of the second interface.

18. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it causes the terminal device to perform the method as described in any one of claims 1-17.

19. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it causes the computer to perform the method as described in any one of claims 1-17.

20. A computer program product, the computer program product comprising a computer program, characterized in that, When the computer program is executed by a processor, it causes the computer to perform the method as described in any one of claims 1-17.

Images