Display method and device

Abstract

The embodiment of the invention provides a display method and device, and relates to the technical field of terminals, and the method comprises the steps that a terminal device displays a second interface, the second interface comprises an icon of a first material and an icon of a second material, the first material is an audio, and the second material is an image, audio or video; the terminal equipment receives a second operation for the second interface; in response to the second operation, the terminal equipment displays a first icon in a second interface; the terminal equipment receives a third operation for the first icon; and in response to the third operation, the terminal device displays a third interface, the third interface comprising the first material and the second material, so that the user can realize unified preview of the image, the video and the audio in the first application, the user can conveniently and quickly position the required material from the first application, and the user can conveniently sort the material in batches.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a display method and device. Background Art

[0002] With the popularization and development of the Internet, people's functional requirements for terminal devices are becoming more and more diverse. For example, many terminal devices can provide video editing functions, allowing users to create short videos by editing materials such as images, videos, and audio.

[0003] During the video editing process, the terminal device can obtain images, videos, audio and other materials from different applications based on user operations. However, since the related materials are scattered, users do not know where the materials they need are when importing them, and thus miss important materials, affecting the user experience of the video editing function. Summary of the invention

[0004] The embodiments of the present application provide a display method and device, which enable users to achieve a unified preview of images, videos, and audios in a first application, making it convenient for users to quickly locate required materials from the first application and also convenient for users to batch organize materials.

[0005] In a first aspect, an embodiment of the present application provides a display method, the method comprising: a terminal device displays a first interface, the first interface including an icon of a first application; the terminal device receives a first operation on the icon of the first application; in response to the first operation, the terminal device displays a second interface, the second interface including: an icon of a first material and an icon of a second material, the first material is audio, and the second material is an image, audio or video; the terminal device receives a second operation on the second interface; in response to the second operation, the terminal device displays the first icon in the second interface; the terminal device receives a third operation on the first icon; in response to the third operation, the terminal device displays a third interface, the third interface including: the first material and the second material.

[0006] In this way, the user can achieve a unified preview of images, videos and audios in the first application, which makes it convenient for the user to quickly locate the required materials in the first application and also facilitates the user to batch organize the materials.

[0007] In one possible implementation, the third interface also includes a first control, and the method also includes: in response to an operation on the first control, the terminal device displays a fourth interface, the fourth interface includes a first video, the fourth interface is an interface for editing the video, and the first video is obtained by the terminal device editing the first material and the second material.

[0008] Thus, compared to users Figure 4As for entering the creation function through the creation control in the interface shown in b, and inserting the required materials from the creation function, entering the creation function through the first control makes it convenient for users to create videos at any time according to the material organization situation and / or the text description of the material group, thereby improving the convenience and flexibility of users in using the creation function.

[0009] In one possible implementation, the fourth interface also includes one or more of the following: a second control for adding materials to the first video, a third control for exporting videos, a control for setting the resolution of the first video, a control for splitting the first video, or a control for setting transitions for the first video.

[0010] In this way, the terminal device can use a variety of functional controls in the fourth interface to perform comprehensive editing of the video.

[0011] In one possible implementation, after the terminal device displays the fourth interface, the method also includes: in response to an operation on the second control, the terminal device displays a fifth interface, the fifth interface including: a first icon and an icon of a third material, the third material being an image, audio or video; in response to an operation of adding the third material to the first video, the terminal device displays the third material in the fourth interface; in response to a user's operation on the third control, the terminal device exports a second video, the second video including the first material, the second material and the third material; in response to a user's operation of opening the third interface, the terminal device displays the third material in the third interface.

[0012] It is understandable that since users may add new available materials to the video during the video creation process, the terminal device can set the materials in the video as a group when it detects that the user is exporting the video, or add new materials to the original group, so that the user can view the material content in the video or continue to use the materials in the group to create new videos.

[0013] In one possible implementation, the third interface also includes a control for adding instructions, and the method also includes: in response to an operation on the control for adding instructions, the terminal device displays a text box in the third interface; in response to an operation of entering first information in the text box, the terminal device displays the first information in the text box, and the first information includes: text information, and / or a to-do list.

[0014] In this way, users can add their creative ideas for the video and the editing progress of any material to the third interface at any time, making the grouping function more flexible and more in line with user needs.

[0015] In one possible implementation, the second interface also includes: a fourth control for viewing a material set, and the method also includes: in response to an operation on the fourth control, the terminal device displays a sixth interface, and the sixth interface includes: a fifth control for viewing more functions; in response to an operation on the fifth control, the terminal device displays a sixth control for detecting similar materials in the sixth interface; in response to the operation on the sixth control, the terminal device displays a second icon in the sixth interface; in response to the operation on the second icon, the terminal device displays a seventh interface, and the seventh interface includes: an icon of the third material, and an icon of the fourth material, and the third material and the fourth material are materials whose similarity meets a preset condition.

[0016] In this way, the terminal device can detect similar materials in multimedia applications, facilitate unified organization of similar materials, and avoid similar materials occupying more display space.

[0017] In one possible implementation, the method also includes: in response to an operation of selecting the third material and the fourth material, the terminal device displays a seventh control for merging similar materials in a seventh interface; in response to an operation on the seventh control, the terminal device displays a third icon in the second interface, and the third icon displays one or more of the following: an icon of the third material, an icon of the fourth material, or a third identifier, and the third identifier is used to indicate that the third icon corresponds to at least two similar materials.

[0018] The terminal device can not only detect similar materials in multimedia applications, but also merge, delete and process similar materials, thereby improving the user experience of using the similarity detection function and facilitating the management of materials in multimedia applications.

[0019] In a possible implementation, when the seventh interface also includes: a fifth material, and the third material, the fourth material and the fifth material are materials whose similarities meet preset conditions, after responding to an operation on the seventh control, the method also includes: the terminal device deletes the fifth material.

[0020] In this way, since the materials that do not need to be merged are usually materials that the user no longer needs, the terminal device can delete the materials that do not need to be merged among similar materials while merging other materials to avoid occupying storage space.

[0021] In one possible implementation, the method also includes: in response to an operation on the third icon, the terminal device displays an eighth interface, the eighth interface includes: a reduced icon of the third material, a reduced icon of the fourth material, and an eighth control for viewing more functions; in response to the operation on the eighth control, the terminal device displays a first window in the eighth interface, the first window includes one or more of the following: a ninth control for setting a cover, or a tenth control for moving out similar images; when the icon of the third material is selected, in response to the operation on the ninth control, the terminal device sets the icon of the third material as the cover, and the third icon includes the icon of the third material; or, when the icon of the third material is selected, in response to the operation on the tenth control, the terminal device moves the third material out of the similar images, and after responding to the operation on the tenth control, the eighth interface does not include the reduced icon of the third material.

[0022] In this way, the terminal device can also provide multiple functions such as setting the cover and removing similar images, thereby improving the user experience of using the similarity detection function.

[0023] In a possible implementation, when the third material is audio and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the similarity between the audio in the third material and the fourth material is greater than a first threshold; and / or, when the third material is an image and the fourth material is a video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the ratio of the number of first images to the number of all images in the fourth material is greater than a second threshold, and the first image is an image in the fourth material whose similarity to the third material is greater than a third threshold.

[0024] In this way, the terminal device can not only realize similarity detection for the same type of materials, but also realize similarity detection for different types of materials, thereby improving the flexibility of the similarity detection function and making it easier for users to organize similar materials in a unified manner.

[0025] In one possible implementation, the sixth interface also includes a fourth icon, and the method also includes: in response to an operation on the fourth icon, the terminal device displays a ninth interface, and the ninth interface includes: an icon of the first material, and when the second material is audio, the ninth interface also includes an icon of the second material.

[0026] In this way, the terminal device can not only preview the audio material, but also organize the audio into a material set, making it easier for users to view all the audio materials.

[0027] In one possible implementation, the method also includes: in response to an operation of downloading the sixth material, the terminal device displays an icon of the sixth material in the second interface; and / or, in response to an operation of recording to obtain the seventh material, the terminal device displays an icon of the seventh material in the second interface, and the sixth material and the seventh material are both audio.

[0028] In this way, the terminal device can view the downloaded audio content in the multimedia application to solve the problem that it is difficult for users to locate the audio position in the file management application, and / or view the recordings in the multimedia application to facilitate the user to uniformly manage all audio materials.

[0029] In one possible implementation, the first material carries at least one first tag, and the first tag is used to indicate the type of audio, and the type of audio includes one or more of the following: recording, conversation, song, sound effect or voiceprint. The method also includes: in response to the user's operation of searching for the first tag in the second interface, the terminal device displays the tenth interface, and the tenth interface includes the icon of the first material and the first tag.

[0030] In this way, the multimedia application in the terminal device can realize intelligent classification of audio files and provide screening for any audio type to improve the convenience of users to find audio in the multimedia application.

[0031] In a possible implementation manner, the second operation includes: an operation of dragging the icon of the first material to the icon of the second material, or an operation of dragging the icon of the second material to the icon of the first material.

[0032] In this way, the terminal device can integrate the materials into a material group by dragging and dropping, and this method is convenient for the user to add new materials to the material group at any time.

[0033] In one possible implementation, the terminal device receives a second operation on the second interface, including: in response to an operation on the icon of the first material in the second interface, the terminal device displays an eleventh interface, the eleventh interface including: an eleventh control for merging at least two materials into one material group, the icon of the first material is in a selected state, and the icon of the second material is not in a selected state; when the icon of the second material is selected, the terminal device receives the second operation on the eleventh control.

[0034] In this way, the terminal device can integrate at least two materials into a material group by selecting the materials, and this method is convenient for the user to integrate multiple materials into one material group at one time.

[0035] In one possible implementation, a first identifier is displayed in the icon of the first material, and the first identifier is used to indicate that the first material is audio; the first icon displays one or more of the following: a reduced icon of the first material, a reduced icon of the second material, and a second identifier, and the second identifier is used to indicate that the first icon corresponds to at least two materials.

[0036] In this way, the terminal device can quickly locate the audio content through the first identifier, and can also quickly locate the material group through the second identifier, thereby improving the flexibility of the user in previewing the material.

[0037] In one possible implementation, the method also includes: in response to an operation on an icon of the first material in the second interface, the terminal device displays a twelfth interface, the twelfth interface including: the first material and a control for pinning the material; in response to an operation on the control for specifying the material, the terminal device displays the first material at the top in the second interface.

[0038] In this way, the terminal device can realize the top placement of the material or material group in the multimedia application, so that the user can quickly find the required material, thereby improving the user's experience of using the multimedia application.

[0039] In a second aspect, an embodiment of the present application provides a display device, which includes a display unit and a processing unit. The display unit is used to display a first interface, which includes an icon of a first application; the processing unit is used to receive a first operation on the icon of the first application; in response to the first operation, the display unit is also used to display a second interface, which includes: an icon of a first material and an icon of a second material, the first material is audio, and the second material is an image, audio or video; the processing unit is also used to receive a second operation on the second interface; in response to the second operation, the display unit is also used to display the first icon in the second interface; the processing unit is also used to receive a third operation on the first icon; in response to the third operation, the display unit is also used to display a third interface, which includes: the first material and the second material.

[0040] In a third aspect, an embodiment of the present application provides a terminal device, including a processor and a memory, the memory being used to store code instructions; the processor being used to run the code instructions so that the terminal device executes the method described in the first aspect or any one of the implementations of the first aspect.

[0041] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, which stores instructions. When the instructions are executed, the computer executes the method described in the first aspect or any one of the implementations of the first aspect.

[0042] In a fifth aspect, a computer program product includes a computer program, and when the computer program is executed, the computer executes the method described in the first aspect or any one of the implementations of the first aspect.

[0043] It should be understood that the second to fifth aspects of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation methods are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A schematic diagram of a scenario provided for an embodiment of the present application;

[0045] Figure 2 Another scenario schematic diagram provided for an embodiment of the present application;

[0046] Figure 3 A schematic diagram of the hardware structure of a terminal device provided in an embodiment of the present application;

[0047] Figure 4 A schematic diagram of an interface for opening a multimedia application provided in an embodiment of the present application;

[0048] Figure 5 A schematic diagram of an interface for downloading audio provided in an embodiment of the present application;

[0049] Figure 6 A schematic diagram of an interface for uploading audio provided in an embodiment of the present application;

[0050] Figure 7 A schematic diagram of an audio classification interface provided in an embodiment of the present application;

[0051] Figure 8 A schematic diagram of an interface for identifying similar materials provided in an embodiment of the present application;

[0052] Fig. 9 A schematic diagram of an interface for processing similar materials provided in an embodiment of the present application;

[0053] Fig.10 A schematic diagram of an interface for split-screen display in a multimedia application is provided for an embodiment of the present application;

[0054] Fig.11 A schematic diagram of an interface for integrating a material group provided in an embodiment of the present application;

[0055] Fig.12 A schematic diagram of an interface for integrating a material group provided in an embodiment of the present application;

[0056] Fig.13 A schematic diagram of an interface for previewing a material group provided in an embodiment of the present application;

[0057] Fig.14 A schematic diagram of an interface for adding materials provided in an embodiment of the present application;

[0058] Fig.15 A schematic diagram of an interface for pinning materials provided in an embodiment of the present application;

[0059] Fig.16 A schematic diagram of a display process provided in an embodiment of the present application;

[0060] Fig.17 A schematic diagram of the structure of a display device provided in an embodiment of the present application;

[0061] Fig.18 A schematic diagram of the hardware structure of another terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0062] In order to facilitate the clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects. For example, the first value and the second value are only used to distinguish different values, and their order is not limited. Those skilled in the art can understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit them to be different.

[0063] It should be noted that, in this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in this application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0064] In the present application, "at least one" means one or more, and "plurality" means two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c can be single or multiple.

[0065] With the development of terminal technology and the rise of short videos, more and more users use the video editing function in terminal devices to edit images, videos, audio and other materials to create short videos. Before video editing, the terminal device can select the images, videos, audio and other materials to be edited. However, since the images and video content are arranged in chronological order in the gallery, the related materials are relatively scattered, resulting in not knowing where the materials you need are when importing the materials, and then missing important materials, affecting the user experience of the video editing function.

[0066] For example, Figure 1 A schematic diagram of an interface for viewing materials provided in an embodiment of the present application. Figure 1 In the corresponding embodiments, a mobile phone as the terminal device is used as an example for illustration, and this example does not constitute a limitation on the embodiments of the present application.

[0067] When the terminal device receives a message from the user opening the gallery application, the terminal device can display the following Figure 1 The interface shown in a in FIG. 1 may be a photo display interface, which may include: a thumbnail corresponding to at least one material, and a toolbar at the bottom of the screen. The material may include: images and videos, and the at least one material may be sorted from near to far in chronological order. The toolbar may include: a control 101 for viewing an album.

[0068] When the terminal device receives a click operation on the control 101 by the user, the terminal device displays the following Figure 1 The interface shown in b in , which may be an album display interface, may include: a thumbnail corresponding to at least one album, such as a thumbnail corresponding to the All Photos album, a thumbnail corresponding to the Video album, a thumbnail corresponding to the Screenshot and Screen Recording album, and a thumbnail corresponding to the My Favorites album, etc.

[0069] It is understandable that in order to avoid the situation where the user does not know where the required materials are when the materials are imported due to the dispersion of related materials, the user can store the related materials in an album. Then, the required materials can be imported from the album directory before video editing. However, when more and more videos need to be edited, the albums used to store the required materials for the videos will also increase, which will affect the user's search for materials before video editing over time.

[0070] It is understandable that users have a demand for unified management of materials. How to integrate materials without affecting the album management logic has become an urgent problem that needs to be solved.

[0071] In view of this, the embodiment of the present application provides a display method, so that the terminal device can display the Figure 1 At least two materials in the interface shown in a are integrated into a material group to meet the user's demand for material integration, and the terminal device can also display the materials in the material group based on the user's operation on the material group to enable the user to batch organize the materials in the material group. Among them, the at least two materials may include audio.

[0072] In a possible implementation, when importing audio materials, it is difficult for users to quickly locate the audio because the audio is usually stored in a file management application, and the file management application has many folders, deep paths, and confusing file naming.

[0073] When users download audio from the Internet or other channels, it may be difficult to quickly locate the audio location; when users upload audio from other applications, it is also difficult to find the audio upload path in the file management application.

[0074] In a possible implementation, for some video editing applications, after a user downloads a piece of audio from the video editing application, the audio can only be viewed in the video editing application, and due to the limitations of the video editing application, the audio cannot be shared to other applications on the terminal device.

[0075] For example, Figure 2 Another scenario schematic diagram provided for an embodiment of the present application.

[0076] In the case where the user needs to view the downloaded audio, when the terminal device receives the user's operation of opening the file management application, the terminal device can display the following Figure 2 The interface shown in a in FIG. 1 allows the user to search for audio by file type, or by file storage location, or by file source.

[0077] Alternatively, when the user needs to upload the audio to other applications, the terminal device can display the following information when receiving the user's operation of triggering the control corresponding to the file search in other applications: Figure 2 The interface shown in b in FIG. enables the user to find the audio to be uploaded through at least one folder stored in the mobile phone.

[0078] It is understandable that the lack of unified management of audio files in terminal devices makes the viewing, uploading, and use of audio files cumbersome. In addition, users who frequently use the video editing function use audio more frequently, and the cumbersome audio search method affects the user experience.

[0079] Therefore, a display method provided in an embodiment of the present application can also enable a terminal device to implement a unified preview of images, videos, and audios in a first application, so that the user can quickly locate the required audio in the first application. The first application can be a multimedia application described in an embodiment of the present application.

[0080] It is understandable that the above terminal devices may also be referred to as terminals, user equipment (UE), mobile stations (MS), mobile terminals (MT), etc. The terminal devices may be mobile phones, smart TVs, wearable devices, tablet computers (Pad), computers with wireless transceiver functions, virtual reality (VR) terminal devices, augmented reality (AR) terminal devices, wireless terminals in industrial control, wireless terminals in self-driving, wireless terminals in remote medical surgery, wireless terminals in smart grids, wireless terminals in transportation safety, wireless terminals in smart cities, wireless terminals in smart homes, etc. The embodiments of the present application do not limit the specific technology and specific device form used by the terminal devices.

[0081] Therefore, in order to better understand the embodiment of the present application, the structure of the terminal device of the embodiment of the present application is introduced below. Figure 3 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application.

[0082] The terminal device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, an indicator 192, a camera 193, and a display screen 194, etc.

[0083] Among them, the sensor module 180 may include one or more of the following: pressure sensor, gyroscope sensor, air pressure sensor, magnetic sensor, acceleration sensor, distance sensor, proximity light sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor, or bone conduction sensor, etc., which is not specifically limited in the embodiments of the present application.

[0084] It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the terminal device. In other embodiments of the present application, the terminal device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0085] The processor 110 may include one or more processing units. Different processing units may be independent devices or integrated into one or more processors. The processor 110 may also be provided with a memory for storing instructions and data.

[0086] The USB interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the terminal device, and can also be used to transfer data between the terminal device and peripheral devices. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0087] The charging management module 140 is used to receive charging input from a charger, which may be a wireless charger or a wired charger. The power management module 141 is used to connect the charging management module 140 to the processor 110 .

[0088] The wireless communication function of the terminal device can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0089] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. The antenna in the terminal device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna.

[0090] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to terminal devices. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation.

[0091] The wireless communication module 160 can provide wireless communication solutions applied to terminal devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), etc.

[0092] The terminal device realizes the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering.

[0093] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. In some embodiments, the terminal device may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0094] The terminal device can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0095] The camera 193 is used to capture static images or videos. In some embodiments, the terminal device may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0096] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0097] The internal memory 121 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 121 can include a program storage area and a data storage area.

[0098] The terminal device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor.

[0099] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. Speaker 170A, also known as "speaker", is used to convert audio electrical signals into sound signals. The terminal device can listen to music or listen to hands-free calls through speaker 170A. Receiver 170B, also known as "earpiece", is used to convert audio electrical signals into sound signals. When the terminal device answers a call or voice message, the voice can be answered by placing receiver 170B close to the human ear. Headphone interface 170D is used to connect wired headphones. Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. In an embodiment of the present application, the terminal device may have a microphone 170C.

[0100] The pressure sensor is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor can be set on the display screen 194. The gyroscope sensor can be used to determine the motion posture of the terminal device. The air pressure sensor is used to measure the air pressure. The magnetic sensor includes a Hall sensor. The acceleration sensor can detect the magnitude of the acceleration of the terminal device in all directions (generally three axes). Distance sensor, used to measure the distance. The proximity light sensor can include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The ambient light sensor is used to sense the brightness of the ambient light. The fingerprint sensor is used to collect fingerprints. The temperature sensor is used to detect the temperature. The touch sensor, also known as a "touch device". The bone conduction sensor can obtain vibration signals.

[0101] The touch sensor can be set on the display screen 194, and the touch sensor and the display screen 194 form a touch screen, or a "touch screen".

[0102] The button 190 includes a power button, a volume button, etc. The button 190 may be a mechanical button. It may also be a touch button. The terminal device may receive the button input and generate a key signal input related to the user settings and function control of the terminal device. The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, message, missed call, notification, etc.

[0103] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture, etc., which will not be elaborated here.

[0104] The following specific embodiments are used to describe in detail the technical solution of the present application and how the technical solution of the present application solves the above technical problems. The following specific embodiments can be implemented independently or in combination with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0105] The embodiment of the present application provides a display method, which upgrades the gallery application to a multimedia application, and the multimedia application can realize the unified management of images, videos, and audios (see Figure 4 Corresponding embodiments), for example, in multimedia applications, users can preview the downloaded audio (see Figure 5 In addition, in multimedia applications, users can also quickly locate the audio during the audio upload process (see Figure 6 corresponding embodiments).

[0106] It can be understood that the terminal device can set the storage path of the audio in the folder corresponding to the multimedia application, so that the user can view the audio in the multimedia application, or it can be understood that the multimedia application can provide a shortcut for viewing the audio, so that the user can preview the audio in the multimedia application at any time.

[0107] For example, Figure 4 A schematic diagram of an interface for opening a multimedia application provided in an embodiment of the present application.

[0108] The terminal device displays Figure 4 The interface shown in a in FIG. 1 may be called a desktop, and the interface may include icons 401 of multimedia applications.

[0109] A multimedia application can be an application for managing images, videos, and audios on terminal devices such as smart phones and tablets. The multimedia application can also realize the editing of materials such as images, videos, and audios. The multimedia application can also be called a "multimedia library" or a "resource library", etc. This embodiment does not limit the name of the application.

[0110] When the terminal device receives a click operation from the user on the multimedia application icon 401, the terminal device may display the following Figure 4 The interface shown in b in the figure can be called the interface of all materials, and the word "Multimedia" can be displayed in the upper left corner of the interface. The interface can include: a thumbnail corresponding to at least one material, and a toolbar at the bottom of the screen. The thumbnails corresponding to at least one material can be sorted from recent to far in chronological order. The thumbnails can also be called icons or logos.

[0111] Figure 4The interface shown in b in FIG. 4 may include a thumbnail 402 corresponding to audio A. The thumbnail 402 may display an audio identifier (such as an identifier in the shape of a musical note in the upper right corner of the thumbnail 402), the thumbnail 402 may display the playing time of audio A (such as the playing time in the lower left corner of the thumbnail, such as 04:30), and the thumbnail 402 may also display the name of audio A or the file name of audio A. The embodiment of the present application does not limit the specific content displayed in the thumbnail 402.

[0112] The toolbar may include: a control 403 for viewing all materials, a control 404 for viewing a material collection, a control for viewing photos in a time dimension (or called a moment control), and a control for implementing editing functions based on the materials (or called a creation control), wherein control 403 is in a selected state, and the word "All" is displayed in control 403, and the word "Material Collection" is displayed in control 404.

[0113] When the terminal device receives a click operation on the control 404 by the user, the terminal device may display the following Figure 4 The interface shown in c in the figure may be called a material collection interface, and the word "Multimedia" may be displayed in the upper left corner of the interface. The interface may include: a thumbnail corresponding to at least one material collection, and the material collection may include: an album material collection, an audio material collection, or a video material collection, etc.

[0114] Figure 4 The interface shown in c may include: thumbnails corresponding to the album material set, thumbnails corresponding to the video material set, and thumbnails 405 corresponding to the audio material set. The audio logo (such as the logo in the lower left corner of the thumbnail 405) may be displayed in the thumbnail 405.

[0115] When the terminal device receives a click operation of the user on the thumbnail 405, the terminal device may display the following Figure 4 The interface shown in d in the figure can display the thumbnail corresponding to the audio A. Then, when the terminal device receives the trigger operation of the user for the thumbnail corresponding to the audio A, the terminal device can realize the functions such as playing the audio A. Figure 4 Not shown.

[0116] Based on this, the terminal device can provide a multimedia application that can achieve unified management of images, videos and audio materials, making it convenient for users to view audio materials at any time.

[0117] exist Figure 4 Based on the corresponding embodiment, the multimedia application may include the audio obtained by the terminal device based on the user download, see Figure 5 The corresponding embodiments.

[0118] For example, Figure 5 A schematic diagram of an interface for downloading audio provided in an embodiment of the present application.

[0119] The terminal device displays Figure 5 The interface shown in a in the figure may be a file download interface, which may include: audio B and audio C, and audio B is selected. When the terminal device receives a trigger operation of the user on the download control at the bottom of the screen, the terminal device may download audio B to the local device and provide a shortcut to audio B in the multimedia application, so that the user can view audio B in the multimedia application.

[0120] In a possible implementation, when the terminal device receives a trigger operation from the user on the download control at the bottom of the screen, the terminal device may also Figure 5 The prompt information is displayed in the interface shown in a, and the prompt information is used to prompt the user to view the audio B from the multimedia application. Figure 5 Not shown in the interface shown in a.

[0121] When the terminal device receives the user's operation to open all material interfaces, the terminal device can display the following Figure 5 The interface shown in b in the figure may include: a thumbnail 501 corresponding to audio B, an audio identifier may be displayed in the thumbnail 501, and the playing time of audio B may be displayed in the thumbnail 501, such as 3 minutes and 20 seconds. The operation of opening the interface of all materials may be that the user slides left or right along the bottom of the display screen, or the user triggers the multimedia application control from the desktop, or the user triggers the thumbnail corresponding to the multimedia application from the background multitasking interface, which is not limited in the embodiments of the present application.

[0122] In a possible implementation, after the terminal device downloads audio B, the terminal device can identify the timbre, pitch, relative loudness and other information of various objects in the audio through audio timbre recognition, and set a tag for audio B to indicate the audio type, so as to achieve subsequent screening of audio B. The audio screening process can be referred to in Figure 7 The corresponding embodiments will not be described in detail here.

[0123] Based on this, the terminal device can view the downloaded audio content in the multimedia application to solve the problem that it is difficult for the user to locate the audio position in the file management application.

[0124] exist Figure 4 Based on the corresponding embodiment, the terminal device can also search for audio from the directory corresponding to the multimedia application and upload the audio to other applications. For details, see Figure 6 The corresponding embodiments.

[0125] For example, Figure 6A schematic diagram of an interface for uploading audio provided in an embodiment of the present application.

[0126] The terminal device displays Figure 6 The interface shown in a in the figure may be an interface for uploading materials in other applications. The interface may include a window for selecting a file directory. The window may include: controls for selecting files in the chat, controls for selecting files in the favorites, controls for selecting files from the mobile phone storage, and controls 601 for selecting files from the mobile phone multimedia application. Other content displayed in the interface may be a file directory opened from the mobile phone storage.

[0127] When the terminal device receives a click operation on the control 601 by the user, the terminal device may display the following Figure 6 The interface shown in b in the figure may include: thumbnails corresponding to materials in the multimedia application, such as thumbnail 602 corresponding to audio A and thumbnail 603 corresponding to audio B, and a selected control (such as a circular control displayed in the upper right corner of the thumbnail) may be displayed in any thumbnail. Figure 6 The material displayed in the interface shown in b can be included in Figure 5 In the interface shown in b.

[0128] When the terminal device receives the user's Figure 6 When a click operation is performed on at least one selected control in the interface shown in b in FIG, and then a trigger operation is received from the user on the send control in the upper right corner, the terminal device can upload at least one material corresponding to the at least one selected control to other applications, thereby realizing the uploading of images, videos or audios.

[0129] Compared to based on Figure 2 In the corresponding embodiment, the terminal device can obtain the audio from the directory where the multimedia application is located to search for the audio to be uploaded, so as to solve the problem that it is difficult to quickly locate the required audio from at least one folder stored in the mobile phone.

[0130] The embodiment of the present application provides a display method, which enables multimedia applications to realize intelligent classification of audio and provide a screening function for any audio type.

[0131] For example, Figure 7 A schematic diagram of an audio classification interface provided in an embodiment of the present application.

[0132] After storing any audio, the terminal device can identify the audio and set at least one label for the audio according to the identification result to distinguish different types of audio. The type of the label may include one or more of the following: recordings, conversations, songs, sound effects, or voiceprints, etc., which are not limited in the embodiments of the present application.

[0133] The audio with recording type can be the audio recorded by the terminal device through the recording function, and the audio with recording type can be displayed not only in the recorder application but also in the multimedia application. The audio with conversation type can be the audio containing at least two speakers.

[0134] When receiving a message from a user opening the material collection interface, the terminal device may display the following information: Figure 7 The interface shown in a in FIG. 1 may include: thumbnails 701 corresponding to all material sets, thumbnails 702 corresponding to audio material sets, and a search box 705. The all material sets may include all materials in the multimedia application, namely, all images, videos, and audio contents.

[0135] It is understandable that the terminal device can implement audio filtering not only in any material set, but also based on any search box in the multimedia application.

[0136] In one implementation, the terminal device may support audio filtering in any material set. For example, when the terminal device receives a click operation from the user on the thumbnail 701, the terminal device may display the following: Figure 7 The interface shown in b in the figure has the same material as Figure 5 The materials displayed in the interface shown in b are consistent. Figure 5 The interface shown in b can be used to view the material generation time.

[0137] Should Figure 7 The interface shown in b in FIG. 1 can display thumbnails corresponding to all materials. The upper left corner of the interface can display the name of the thumbnail 701, such as the words "all materials". The interface can also display a control 703 for filtering materials.

[0138] When the terminal device receives a click operation on the control 703 by the user, the terminal device may display the following Figure 7 The interface shown in c in , the interface may include, window 704, window 704 includes controls for filtering material sources and controls for filtering audio types, etc. For example, the controls for filtering material sources may include one or more of the following: controls for filtering all materials, controls for filtering local materials, or controls for filtering materials from the cloud, and the controls for filtering audio types may include one or more of the following: controls for filtering recordings, controls for filtering conversations, controls for filtering songs, controls for filtering sound effects, or controls for filtering voiceprints, etc.

[0139] When the terminal device receives a click operation from the user on the control for filtering songs, the terminal device may display Figure 7 The interface shown in d in the figure may include: a thumbnail corresponding to audio B, and audio B may carry a song tag.

[0140] In a possible implementation, when the terminal device receives a user's click operation on a control for filtering voiceprints, the terminal device can classify the audio according to different voiceprints. For example, the terminal device can identify the voiceprints of different users, or identify the voiceprints of animals, etc. In a scenario where the terminal device can identify the voiceprints of different users, the terminal device can Figure 7 The interface shown in d in FIG. 1 shows: audio of user A, audio of user B, etc., Figure 7 Not shown.

[0141] In a possible implementation, when the terminal device receives a user click operation on the thumbnail 702, the terminal device can display thumbnails corresponding to all audio in the multimedia application and the control 703 to implement audio filtering in the audio material collection. It is understandable that the terminal device can also implement audio filtering in any material collection containing audio materials, or implement Figure 5 Audio filtering is implemented in the interface shown in b, which is not limited in the embodiments of the present application.

[0142] In another implementation, the terminal device implements audio filtering based on any search box in the multimedia application, which can be Figure 5 The search box in the interface shown in b can also be Figure 7 For example, when the terminal device receives a click operation of the user on the search box 705, the terminal device displays the following Figure 7 The interface shown in e in FIG. 7 may include: a search box 705, and a material set obtained by classifying all materials based on types such as time, portrait, and location.

[0143] In a possible implementation, the terminal device may also be based on Figure 5 The search box in the interface shown in b in the figure implements audio filtering, for example, in response to a user's Figure 5 The terminal device may also display the following information: Figure 7 The interface shown in e.

[0144] When the terminal device receives the user input of the word "song" in the search box 705, the terminal device may display the following Figure 7 The interface shown in d.

[0145] In a possible implementation, the terminal device can also filter the audio type through a search box and / or a control for filtering the audio type in the entire material interface. The specific implementation process is the same as Figure 7 The description in the corresponding embodiments is similar and will not be repeated here.

[0146] Based on this, the multimedia application in the terminal device can realize intelligent classification of audio files and provide filtering for any audio type to improve the convenience of users to find audio in the multimedia application.

[0147] The present application embodiment provides a display method, so that multimedia applications can realize the recognition of similar materials (see Figure 8 Corresponding embodiments), and processing of similar materials ( Fig. 9 corresponding embodiments).

[0148] For example, Figure 8 A schematic diagram of an interface for identifying similar materials provided in an embodiment of the present application.

[0149] When the terminal device receives the user's Figure 7 When you click the more function control (the more function control can be displayed as "+") in the upper right corner of the interface shown in a, the terminal device displays the following Figure 8 The interface shown in a in FIG. 8 may include a window 801, and the window 801 may include: a control 802 for testing similar materials (or called a test similar control).

[0150] When the terminal device receives a trigger operation on the control 802 by the user, the terminal device can perform similarity detection on all materials in the multimedia application, and display the following when two similar items are detected: Figure 8 The interface shown in b in FIG. 8 may include thumbnails 803 corresponding to similar items. The upper right corner of the thumbnail 803 may display the number of similar items detected, such as 2.

[0151] Among them, the terminal device can detect the similarity between at least two materials, such as detecting the similarity between at least two images, detecting the similarity between at least two videos, detecting the similarity between at least two audios, detecting the similarity between an image and a video, and detecting the similarity between a video and an audio.

[0152] The specific implementation of detecting the similarity between at least two images can be: when capturing at least two images, the terminal device can set a label for each photo to indicate the shooting time, and detect at least two images that meet a certain time threshold when performing similarity detection, and then when it is determined that the similarity of the at least two images is greater than a first similarity threshold, mark the at least two images as similar items. And / or, the terminal device can also detect images acquired at different time points, and when it is detected that the similarity of the at least two images is greater than the first similarity threshold, mark the at least two images as a similar item.

[0153] The specific implementation of detecting the similarity between an image and a video can be as follows: the terminal device can decompose the video into single frames, and compare the similarity between the image and each image in the video one by one. When the ratio of the number of images whose similarity meets the preset conditions to the number of all images in the video is greater than a third similarity threshold, it is determined that there is similarity between the image and the video, and it is marked as a similar item.

[0154] The specific implementation of detecting the similarity between video and audio can be: the terminal device can extract the audio in the video and compare the similarity between the two audios. For example, when it is determined that the similarity between the two audios is greater than the fourth similarity threshold, it is determined that there is similarity between the video and the audio, and it is marked as a similar item.

[0155] It is understandable that the terminal device may detect similar materials in response to a user's click operation on the control 802, or the terminal device may also periodically detect similar materials, which is not limited in the embodiments of the present application.

[0156] For example, Fig. 9 A schematic diagram of an interface for processing similar materials provided in an embodiment of the present application. Fig. 9 In the corresponding embodiment, an example is given in which at least one similar item detected includes an image. The processing procedure when the similar item includes a video or an audio is similar to that of the image, which will not be described in detail here.

[0157] When the terminal device receives the user's Figure 8 When the thumbnail 803 in the interface shown in b is clicked, the terminal device may display the following Fig. 9 The interface shown in a. Fig. 9 The interface shown in a in the figure may include two similar items detected, such as a similar item detected containing 10 images, and a similar item detected containing 6 images, and the two similar items are sorted from near to far in chronological order.

[0158] When the terminal device receives the user's Fig. 9When at least two images (such as 9 images) are selected in the interface shown in a, the terminal device may display the following Fig. 9 The interface shown in b in the figure, Fig. 9 The interface shown in b in the figure can be understood as a similar item processing interface. The operation of selecting at least two images may include: a long press operation on any selected image, and a click operation on other images of the at least two images, etc., which is not limited in the embodiment of the present application.

[0159] In a possible implementation, when the terminal device receives a long press operation by the user on any similar image in a similar project, the terminal device may select by default an image in a similar project whose similarity to the selected similar image is greater than a second similarity threshold, and then display the following information: Fig. 9 The interface shown in b in FIG. 1 is shown in FIG. 1 . The second similarity threshold is greater than the first similarity threshold. For example, the similar project may be a project detected on July 25, 2023.

[0160] It is understandable that the terminal device can assist the user in screening similar images by re-identifying the image similarity, so as to screen out the most similar images.

[0161] In a possible implementation, when the terminal device receives a long press operation from the user on any similar image in a similar project, the terminal device may select all similar images in the similar project by default. Fig. 9 Not shown.

[0162] like Fig. 9 The interface shown in b in FIG. 1 may include one or more of the following: a thumbnail 900, a control for selecting all images (or called a select all control) 901, a control 902 for selecting all similar images in a similar project, a control for deleting selected similar images (or called a delete control) 903, and a control for merging similar images (or called a merge similar control) 904. The storage size of all images in a selected project can be displayed around the control 902, and the storage size of the selected image can be displayed in the control 903.

[0163] It can be understood that in the embodiment of the present application, controls 901, 902, 903 and 904 are Fig. 9 The position and form of display in the interface shown in b are not specifically limited.

[0164] The terminal device has selected Fig. 9 In the case of 9 similar images shown in b in FIG. 1 , when the terminal device receives a trigger operation of the user on the control 904, the terminal device can fold the selected similar images and then display the following: Fig. 9The interface shown in c. Fig. 9 The interface shown in c includes unprocessed similar items.

[0165] In a possible implementation, after the terminal device has selected Fig. 9 In the case of 9 similar images shown in b in FIG. 1 , when the terminal device receives the user's trigger operation on the control 904, the terminal device can merge the selected 9 images and delete the image corresponding to the thumbnail 900 in the similar project. In this scenario, the image corresponding to the thumbnail 900 can be moved to the recently deleted corresponding material set, so that the user can retrieve and continue to process similar images at any time. Fig. 9 Not shown.

[0166] In a possible implementation, the terminal device may not delete the unmerged similar images, that is, the user may manually delete the unmerged similar images. Fig. 9 Delete unnecessary similar images in the interface shown in b.

[0167] In one implementation of restoring similar images, the terminal device may add a label indicating a similar image to the similar image when detecting the similar image, and the label in the similar image is retained even if the similar image is deleted; when the terminal device restores the similar image in the recently deleted corresponding material set, the terminal device may re-display the similar image on the screen according to the label in the similar image. Fig. 9 The interface shown in a.

[0168] In another implementation of restoring similar images, the terminal device may add a label indicating similar images to the similar images when similar images are detected, and delete the label when the similar images are deleted; when the terminal device restores any image in the recently deleted corresponding material set, the terminal device may trigger a similarity detection process to perform similarity detection on the restored image and all materials in the multimedia application. The similarity detection process can be referred to in Figure 8 The corresponding embodiments will not be described in detail here.

[0169] When the terminal device receives a message from the user opening the full material interface, the terminal device can display the following Fig. 9 The interface shown in d in the figure may include: a thumbnail 905, in which a thumbnail of any one of the at least two similar images merged may be displayed, and in which an identifier (or similar image identifier) ​​indicating that at least two similar images are included may be displayed. The specific display form of the similar images is not limited in the embodiment of the present application.

[0170] When the terminal device receives the user's trigger operation on the thumbnail 905, the terminal device displays the following Fig. 9The interface shown in e in the figure may include one or more of the following: any image of at least two similar images displayed in an enlarged manner (such as similar image 910), at least two similar images displayed in a reduced manner, or a similar image identifier, which can be set in Fig. 9 The upper right corner of the interface shown in e.

[0171] At least two similar images displayed in zoomed-out form may be displayed in Fig. 9 The rectangular frame shown by e in FIG. 8 is a rectangle frame, and the thumbnail corresponding to the similar image 910 may be selected by default in the rectangular frame, such as the thumbnail located in the middle of the rectangular frame.

[0172] In a possible implementation, when the terminal device receives an operation in which the user selects thumbnails corresponding to other similar images in a rectangular frame, the terminal device may Fig. 9 The interface shown in e in FIG. 1 shows an enlarged view of the selected similar image 911 .

[0173] Further, in the case where similar image 911 is selected, when the terminal device receives a click operation of the user on control 906, the terminal device may display the following Fig. 9 The interface shown in f in the figure may include: a window 907, and the window 907 may include: a control 908 for setting any similar image as a cover, and a control 909 for removing any similar image and other functional controls.

[0174] In response to a click operation on the control 908, the terminal device can set the similar image 911 as a cover and display it on a screen such as Fig. 9 The thumbnail 905 shown in d in FIG. enables the terminal device to quickly locate a certain material by setting a cover for similar items.

[0175] In response to a click operation on the control 909, the terminal device may remove the similar image 911, and the removed similar image may be independently displayed in the entire material interface, for example, in Fig. 9 The interface shown in d in FIG. 1 shows a thumbnail corresponding to the similar image 911. In this scenario, there may be no similar image 911 in the similar items corresponding to the thumbnail 905. Fig. 9 Not shown.

[0176] Based on this, the terminal device can not only detect similar materials in multimedia applications, but also merge, delete and other processes similar materials, thereby improving the user experience of using the similarity detection function and facilitating the management of materials in multimedia applications.

[0177] The embodiment of the present application provides a display method, so that the multimedia application in the terminal device can realize the split-screen display of the thumbnail and the single material corresponding to any thumbnail in the thumbnail, so as to facilitate the user to view the material.

[0178] For example, Fig.10 A schematic diagram of an interface for split-screen display in a multimedia application is provided for an embodiment of the present application, and an example is given by taking a tablet as an example of a terminal device. This example does not constitute a limitation on the embodiment of the present application.

[0179] The terminal device displays Fig.10 The interface shown in a in the figure can be Figure 7 The contents displayed in the interface shown in b are similar and will not be repeated here.

[0180] When the terminal device receives a click operation from the user on the thumbnail 1001, the terminal device may display Figure 7 The interface shown in b in the figure may include: two windows and a control 1002 located between the two windows. The left window 1003 may display thumbnails corresponding to all materials, and the right window 1004 may display the video content corresponding to the thumbnail 1001, so as to realize the split screen display of the left and right windows. The user may control the display size of the left and right windows through the control 1002, and may also close the right window 1004 by sliding the control 1002 to the rightmost area of ​​the display screen.

[0181] Alternatively, when the terminal device receives the user's operation of dragging the thumbnail 1001 to the right side of the display screen (the user releases the thumbnail at this time), the terminal device may display Figure 7 In the process of dragging thumbnail 1001 to the right side of the display screen, the terminal device Fig.10 The content in the interface shown in a can be gradually reduced to Fig.10 In the left window 1003 shown in b.

[0182] In a possible implementation, when the terminal device receives a click operation of the user on the thumbnail 1001 or receives an operation of the user dragging the thumbnail 1001 to the right side of the display screen, the terminal device can determine whether the resolution of the display screen meets the preset resolution, and when it is determined that the resolution of the display screen meets the preset resolution, perform the following steps: Fig.10 The split screen display shown in b in the figure. The preset resolution can be understood as the display screen resolution that allows the split screen display to be realized. For example, the preset resolution can be the display screen resolution of a folding screen device or the display screen resolution of a tablet, etc. The specific resolution value is not limited in the embodiments of the present application.

[0183] It is understandable that the terminal device can also Figure 4 In the all-material interface shown in b, split-screen display is achieved through the above-mentioned click operation or drag operation. The embodiment of the present application does not limit the interface for achieving split-screen display.

[0184] Based on this, the terminal device can realize split-screen display of all materials or any material among all materials, so that the user can view the difference between similar materials.

[0185] The embodiment of the present application provides a display method, so that the multimedia application in the terminal device can integrate images, videos and audio into a material group (see Fig.11 as well as Fig.12 Corresponding embodiments), and implementing processing of material groups (see Fig.13 corresponding embodiments).

[0186] Among them, the terminal device can integrate the material group by dragging and dropping (see Fig.11 Corresponding embodiments), and / or the terminal device can also integrate the material groups by triggering the grouping control (see Fig.12 corresponding embodiments).

[0187] For example, Fig.11 A schematic diagram of an interface for integrating material groups provided in an embodiment of the present application.

[0188] Terminal device display Fig.11 In the interface shown in a of FIG. 1 , when the terminal device receives the operation of the user dragging thumbnail 1101 to the area where thumbnail 1102 is located, the terminal device can sequentially display the following Fig.11 The interface shown in b and Fig.11 The interface shown in c.

[0189] When the user drags thumbnail 1101 to the area where thumbnail 1102 is located, the terminal device can display an identifier 1103 corresponding to thumbnail 1101. Identifier 1103 is used to indicate the position where thumbnail 1101 is moved. Identifier 1103 can be translucent to prevent the application user from viewing other content in the interface.

[0190] Compared to Fig.11 The interface shown in a, Fig.11 The interface shown in c in FIG. 1 may display a thumbnail 1104. The thumbnail 1104 may display a material group identifier (an identifier displayed in the lower right corner of the thumbnail 1104). The thumbnail 1104 may display a thumbnail 1101 in a reduced state and a thumbnail 1102 in a reduced state in a stacked manner. The material group corresponding to the thumbnail 1104 may include an image corresponding to the thumbnail 1101 and an audio A corresponding to the thumbnail 1102.

[0191] In a possible implementation, the terminal device can also add the materials corresponding to other thumbnails to the material group corresponding to thumbnail 1104 based on the user dragging other thumbnails to the area where thumbnail 1104 is located, and as the content of the material group increases, the content of the thumbnails displayed in stacked form in thumbnail 1104 increases.

[0192] It is understandable that in the embodiment of the present application, no specific limitation is imposed on the content displayed in the thumbnail 1104 and the specific form of the material group identifier.

[0193] For example, Fig.12 A schematic diagram of another interface for integrating material groups provided in an embodiment of the present application.

[0194] Terminal device display Fig.12 In the interface shown in a of FIG. 1 , when the terminal device receives a long press operation of the user on the thumbnail 1201 (when the user releases the thumbnail), the terminal device may display the following Fig.12 The interface shown in b.

[0195] Fig.12 The interface shown in b in FIG. 1 may include: a control (or grouping control) 1202 for indicating that at least two materials are integrated into a material group; a thumbnail 1201 is selected by default; and a control for selecting a material may be displayed around any thumbnail.

[0196] When the user Fig.12 In the interface shown in b in FIG. 1 , when the image corresponding to thumbnail 1201, the audio corresponding to thumbnail 1203, and the video corresponding to thumbnail 1204 are selected, in response to a click operation on control 1202, the terminal device may integrate the selected three materials into one material group, and then display the following: Fig.12 The interface shown in c.

[0197] Compared to Fig.12 The interface shown in a, Fig.12 The interface shown in c in FIG. 1 may display a thumbnail 1205. The thumbnail 1205 may display a material group identifier, and the thumbnail 1201 in a reduced state, the thumbnail 1203 in a reduced state, and the thumbnail 1204 in a reduced state may be displayed in a stacked manner in the thumbnail 1205. The material group corresponding to the thumbnail 1205 may include: an image corresponding to the thumbnail 1201, an audio A corresponding to the thumbnail 1203, and a video corresponding to the thumbnail 1204.

[0198] It is understandable that the terminal device can also Figure 4 In the interface of all materials shown in b, based on Fig.11 as well as Fig.12The corresponding embodiments implement the integration of material groups, and the specific interface for implementing the integration of material groups is not limited in the embodiments of the present application.

[0199] Based on this, the terminal device can be based on Fig.11 as well as Fig.12 The corresponding embodiment realizes integrating at least two materials into a material group, so that the user can view related materials in the material group. Fig.11 The solution described in the corresponding embodiment facilitates the user to add new materials to the material group at any time. Fig.12 The solution described in the corresponding embodiment facilitates the user to integrate multiple materials into one material group at one time.

[0200] exist Fig.11 or Fig.12 On the basis of the corresponding embodiments, the terminal device can also realize functions such as renaming the material group, simultaneously previewing at least two materials in the material group, and adding text descriptions to the material group.

[0201] For example, Fig.13 A schematic diagram of an interface for previewing a material group provided in an embodiment of the present application.

[0202] The terminal device displays Fig.13 When the terminal device receives a click operation of the user on the thumbnail 1301, the terminal device may display the following Fig.13 The interface shown in b.

[0203] Fig.13 The interface shown in b in the figure may be a grouping interface, which may include one or more of the following: images in a material group, audio in a material group, video in a material group, a control 1303 for adding text descriptions to a material group, a control for deleting any material, a control 1302 for creating using materials in a material group, etc. Fig.13 The content displayed in the interface shown in b is not specifically limited.

[0204] It is understandable that the terminal device can support the user in Fig.13 b) in the left side of the interface to add group description, add to-do items, or rename the group; and the terminal device can also support users to Fig.13 The right side of the interface shown in b in FIG. 1 plays audio, plays video, plays multiple videos silently, and triggers the display of subtitles in the video, etc.

[0205] When the terminal device receives a click operation on control 1303 by the user, the terminal device can display a text box in the area below control 1303 (such as the area shown by the dotted box 1304), and the text box can implement functions such as information entry, creation of to-do items, and marking to-do items as completed.

[0206] For example, in response to the user inputting the text message "This group is the material required for short video 1_12" in the text box, creating three to-do items "1. Need to trim the audio and video length, 2. Modify the image contrast, and 3. Submit before the afternoon of July 31st", and marking the second to-do item as completed, the terminal device displays the following Fig.13 The interface shown in c.

[0207] When the terminal device receives a user click operation on the control 1302, the terminal device can automatically edit all the materials in the material group, such as synthesizing the pictures or videos in the material group into a target video, and setting the dubbing of the target video to audio A, and then displaying the video as shown in FIG. Fig.13 The interface shown in d in FIG. 1 can be understood as a creative interface for editing a material group. The user's click operation on the control 1302 can be a click operation on the control 1302. Fig.13 The operation of the control 1302 in the interface shown in b in FIG. 1304 may also be for Fig.13 Operation of control 1302 in the interface shown in c.

[0208] In this scenario, the terminal device can not only organize the material groups and add descriptions to the material groups, but also Fig.13 In the interface shown in d, edit the materials in the material group into a video to realize video creation.

[0209] like Fig.13 The interface shown in d in the figure may include one or more of the following: a control 1307 for adding materials to a video, a control 1305 for exporting a video (displayed as the word "Export"), a control for setting the resolution of a video (displayed as the word "1080P"), a control for splitting a video (displayed as the word "Split"), or a control 1306 for setting transitions for a video, etc.

[0210] like Fig.13 As shown in d in the figure, the terminal device also supports the user to edit the video, set filters, set music, add text, set special effects, set picture-in-picture, set frame, set background and make other adjustments to the video.

[0211] It is understandable that compared to users Figure 4As for entering the creation function through the creation control in the interface shown in b, and inserting the required materials from the creation function, entering the creation function through the control 1302 in the grouping interface allows users to create videos at any time based on the material organization situation and / or the text description of the material group, thereby improving the convenience and flexibility of users in using the creation function.

[0212] exist Fig.13 On the basis of the corresponding embodiment, the terminal device can support the user to add new materials in the creation interface and integrate the materials for generating the video into a material group.

[0213] For example, Fig.14 A schematic diagram of an interface for adding materials provided in an embodiment of the present application.

[0214] The terminal device displays Fig.14 The interface shown in a in Fig.13 The interface is the same as that shown in d, and will not be repeated here.

[0215] When the terminal device receives a click operation on the control 1307 by the user, the terminal device displays the following Fig.14 The interface shown in b in FIG. 1 may include: a thumbnail 1401 and a thumbnail 1402. The word “Imported” may be displayed in the thumbnail 1401, indicating that the material corresponding to the thumbnail 1401 has been imported into the video.

[0216] When the terminal device receives the user's selection of thumbnail 1402, and then receives the user's click operation on the control 1403 for adding material, the terminal device displays the following Fig.14 The interface shown in c in FIG. 1 may include: a reduced thumbnail 1402. It can be understood that the terminal device can automatically add the image corresponding to the thumbnail 1402 to the video to generate a new video.

[0217] When the terminal device receives a click operation from the user on the control 1404, the terminal device can save the newly generated video to the device and add the image corresponding to the thumbnail 1402 to the original group by default. That is, when the terminal device receives an operation from the user to open the group, the terminal device can display the following: Fig.14 The interface shown in d in FIG. 1 can display image 1405 , which is the image content corresponding to thumbnail 1402 .

[0218] It is understandable that when the terminal device does not receive the user's operation on the control 1404 to export the video content, the terminal device will not add the image corresponding to the thumbnail 1402 to the original grouping.

[0219] It is understandable that since users may add new available materials to the video during the video creation process, the terminal device can set the materials in the video as a group when it detects that the user is exporting the video, or add new materials to the original group, so that the user can view the material content in the video or continue to use the materials in the group to create new videos.

[0220] The embodiment of the present application provides a display method, so that a terminal device can implement a top-placement function for any material or material group in a multimedia application.

[0221] For example, Fig.15 A schematic diagram of an interface for pinned material provided in an embodiment of the present application.

[0222] Terminal device display Fig.15 The interface shown in a in the figure can be Figure 5 The content displayed in the interface shown in b is the same as that in FIG. 1 and will not be described in detail here. When the terminal device receives a click operation of the user on the thumbnail 1501, the terminal device may display Fig.15 In the interface shown in b, a control 1502 for pinning the material may be displayed in the upper right corner of the interface.

[0223] When the terminal device receives a click operation from the user on the control 1502, the terminal device can pin the image corresponding to the thumbnail 1501 to the top. For example, when the terminal device receives an operation from the user to exit the current interface (or receives an operation from the user to open all material interfaces), the terminal device displays the following Fig.15 In the interface shown in c in FIG. 1 , the thumbnail 1501 can be displayed on the top, and a top mark can be displayed in the thumbnail 1501 .

[0224] It is understandable that the terminal device can not only realize the top of the image, but also Fig.15 The corresponding embodiment implements the pinning of video, audio, and material groups. When there are multiple pinned materials in a multimedia application, the multiple pinned materials can be sorted from recent to far in chronological order, for example, the most recently pinned material is placed in front, so that the user can directly focus on the pinned material when viewing all the materials.

[0225] In a possible implementation, the pinned material can also be displayed at the top in the album. Since the pinned material can carry a pinned tag, in response to the user opening any material set, the terminal device can display the material carrying the pinned tag in the front of the material set.

[0226] Based on this, the terminal device can realize the pinning of materials or material groups in multimedia applications, so that users can quickly find the required materials, thereby improving the user's experience in using multimedia applications.

[0227] It should be understood that the interface provided in the embodiment of the present application is merely an example and does not constitute a limitation on the embodiment of the present application.

[0228] exist Figure 5-Figure 15 Based on the corresponding embodiments, Fig.16 A flow chart showing a display method according to an embodiment of the present application is shown in FIG. Fig.16 As shown, the display method may include the following steps:

[0229] S1601. The terminal device displays a first interface, which includes an icon of a first application.

[0230] The first interface can be Figure 4 In the interface shown in a, the first application may be a multimedia application, and the icon of the first application may be icon 401.

[0231] S1602. The terminal device receives a first operation on an icon of a first application.

[0232] The first operation may be a click operation on the icon 401 .

[0233] S1603. In response to the first operation, the terminal device displays a second interface, which includes: an icon of a first material and an icon of a second material, the first material is audio, and the second material is an image, audio, or video.

[0234] The second interface can be Figure 4 The interface shown in b, or Fig.11 The interface shown in a, or Fig.12 The interface shown in a (or b) in the figure. When the second interface is Fig.12 In the interface shown in b in FIG. 1 , the icon of the first material may be thumbnail 1203 , and the icon of the second material may be thumbnail 1201 or thumbnail 1204 .

[0235] S1604. The terminal device receives a second operation on the second interface.

[0236] The second operation is an operation in which the user groups the first material and the second material. Fig.11 The dragging described in the corresponding embodiment forms a group, or as Fig.12 The selected materials described in the corresponding embodiments form a group.

[0237] S1605. In response to the second operation, the terminal device displays the first icon in the second interface.

[0238] The first icon can be Fig.12 The thumbnail 1205 in the interface shown in c or Fig.13Thumbnail 1301 shown in a in FIG.

[0239] S1606. The terminal device receives a third operation on the first icon.

[0240] The third operation is a click operation on the thumbnail 1301 .

[0241] S1607. In response to the third operation, the terminal device displays a third interface, which includes: the first material and the second material.

[0242] The third interface is Fig.13 The interface shown in b.

[0243] Based on this, users can achieve unified preview of images, videos and audios in the first application, which makes it convenient for users to quickly locate the required materials from the first application and also facilitates users to batch organize and preview the materials.

[0244] In one possible implementation, the third interface also includes a first control, and the method also includes: in response to an operation on the first control, the terminal device displays a fourth interface, the fourth interface includes a first video, the fourth interface is an interface for editing the video, and the first video is obtained by the terminal device editing the first material and the second material.

[0245] The first control is Fig.13 The control 1302 shown in b (or c) in FIG. 1304 , the fourth interface may be Fig.13 The interface shown in d.

[0246] In one possible implementation, the fourth interface also includes one or more of the following: a second control for adding materials to the first video, a third control for exporting videos, a control for setting the resolution of the first video, a control for splitting the first video, or a control for setting transitions for the first video.

[0247] like Fig.13 In the interface shown in d, the second control is control 1307, the third control may be control 1305, the control for setting the resolution of the first video may be a control displayed with the word "1080p", the control for splitting the first video may be a control displayed with the word "split", and the control for setting a transition for the first video may be control 1306.

[0248] In one possible implementation, after the terminal device displays the fourth interface, the method also includes: in response to an operation on the second control, the terminal device displays a fifth interface, the fifth interface including: a first icon and an icon of a third material, the third material being an image, audio or video; in response to an operation of adding the third material to the first video, the terminal device displays the third material in the fourth interface; in response to a user's operation on the third control, the terminal device exports a second video, the second video including the first material, the second material and the third material; in response to a user's operation of opening the third interface, the terminal device displays the third material in the third interface.

[0249] The fifth interface can be Fig.14 In the interface shown in b, the first icon may be a thumbnail 1401, and the icon of the third material may be a thumbnail 1402.

[0250] like Fig.14 The interface shown in c in the figure may include a third material; Fig.14 The interface shown in d in FIG. 1 may include a third material, such as the material indicated by 1405 .

[0251] In one possible implementation, the third interface also includes a control for adding instructions, and the method also includes: in response to an operation on the control for adding instructions, the terminal device displays a text box in the third interface; in response to an operation of entering first information in the text box, the terminal device displays the first information in the text box, and the first information includes: text information, and / or a to-do list.

[0252] The controls for adding instructions can be Fig.13 The control 1303 shown in b in FIG. 1304 may be a text box displayed in the area 1304, and the first information may be Fig.13 The content displayed in the dotted box 1304 in the interface shown in c.

[0253] In one possible implementation, the second interface also includes: a fourth control for viewing a material set, and the method also includes: in response to an operation on the fourth control, the terminal device displays a sixth interface, and the sixth interface includes: a fifth control for viewing more functions; in response to an operation on the fifth control, the terminal device displays a sixth control for detecting similar materials in the sixth interface; in response to the operation on the sixth control, the terminal device displays a second icon in the sixth interface; in response to the operation on the second icon, the terminal device displays a seventh interface, and the seventh interface includes: an icon of the third material, and an icon of the fourth material, and the third material and the fourth material are materials whose similarity meets a preset condition.

[0254] The fourth control can be Figure 4The control 404 in the interface shown in b in FIG. 6 can be as follows: Figure 8 The interface shown in a (or Figure 4 The fifth control can be Figure 8 More function controls (more function controls can be displayed as "+") displayed in the upper right corner of a; the sixth control can be control 802; the second icon can be Figure 8 The seventh interface can be a thumbnail 803 shown in b; Fig. 9 The interface shown in a (or b).

[0255] In one possible implementation, the method also includes: in response to an operation of selecting the third material and the fourth material, the terminal device displays a seventh control for merging similar materials in a seventh interface; in response to an operation on the seventh control, the terminal device displays a third icon in the second interface, and the third icon displays one or more of the following: an icon of the third material, an icon of the fourth material, or a third identifier, and the third identifier is used to indicate that the third icon corresponds to at least two similar materials.

[0256] The seventh control can be Fig. 9 In the control 904 shown in b in the figure, the terminal device displays the third icon in the second interface, which can be understood as the terminal device in Fig. 9 The thumbnail 905 is displayed in the interface shown in d in FIG. 1 , and the third identifier may be a similar image identifier in the thumbnail 905 .

[0257] In a possible implementation, when the seventh interface also includes: a fifth material, and the third material, the fourth material and the fifth material are materials whose similarities meet preset conditions, after responding to an operation on the seventh control, the method also includes: the terminal device deletes the fifth material.

[0258] The fifth material can be Fig. 9 The unselected materials in the interface shown in b, such as the material corresponding to the thumbnail 900.

[0259] In one possible implementation, the method also includes: in response to an operation on the third icon, the terminal device displays an eighth interface, the eighth interface includes: a reduced icon of the third material, a reduced icon of the fourth material, and an eighth control for viewing more functions; in response to the operation on the eighth control, the terminal device displays a first window in the eighth interface, the first window includes one or more of the following: a ninth control for setting a cover, or a tenth control for moving out similar images; when the icon of the third material is selected, in response to the operation on the ninth control, the terminal device sets the icon of the third material as the cover, and the third icon includes the icon of the third material; or, when the icon of the third material is selected, in response to the operation on the tenth control, the terminal device moves the third material out of the similar images, and after responding to the operation on the tenth control, the eighth interface does not include the reduced icon of the third material.

[0260] The eighth interface can be Fig. 9 The interface shown in e in FIG. 8 ; the eighth control may be control 906; the first window may be Fig. 9 In the window 907 shown in f, the ninth control may be control 908, and the tenth control may be control 909.

[0261] In a possible implementation, when the third material is audio and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the similarity between the audio in the third material and the fourth material is greater than a first threshold; and / or, when the third material is an image and the fourth material is a video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the ratio of the number of first images to the number of all images in the fourth material is greater than a second threshold, and the first image is an image in the fourth material whose similarity to the third material is greater than a third threshold.

[0262] In one possible implementation, the sixth interface also includes a fourth icon, and the method also includes: in response to an operation on the fourth icon, the terminal device displays a ninth interface, and the ninth interface includes: an icon of the first material, and when the second material is audio, the ninth interface also includes an icon of the second material.

[0263] The fourth icon can be Figure 4 The ninth interface can be a thumbnail 405 shown in c; Figure 4 The interface shown in d.

[0264] In one possible implementation, the method also includes: in response to an operation of downloading the sixth material, the terminal device displays an icon of the sixth material in the second interface; and / or, in response to an operation of recording to obtain the seventh material, the terminal device displays an icon of the seventh material in the second interface, and the sixth material and the seventh material are both audio.

[0265] In one possible implementation, the first material carries at least one first tag, and the first tag is used to indicate the type of audio, and the type of audio includes one or more of the following: recording, conversation, song, sound effect or voiceprint. The method also includes: in response to the user's operation of searching for the first tag in the second interface, the terminal device displays the tenth interface, and the tenth interface includes the icon of the first material and the first tag.

[0266] The tenth interface is Figure 7 The interface shown in d.

[0267] In a possible implementation manner, the second operation includes: an operation of dragging the icon of the first material to the icon of the second material, or an operation of dragging the icon of the second material to the icon of the first material.

[0268] In one possible implementation, the terminal device receives a second operation on the second interface, including: in response to an operation on the icon of the first material in the second interface, the terminal device displays an eleventh interface, the eleventh interface including: an eleventh control for merging at least two materials into one material group, the icon of the first material is in a selected state, and the icon of the second material is not in a selected state; when the icon of the second material is selected, the terminal device receives the second operation on the eleventh control.

[0269] The eleventh interface is Fig.12 In the interface shown in b, the eleventh control may be control 1202.

[0270] In one possible implementation, a first identifier is displayed in the icon of the first material, and the first identifier is used to indicate that the first material is audio; the first icon displays one or more of the following: a reduced icon of the first material, a reduced icon of the second material, and a second identifier, and the second identifier is used to indicate that the first icon corresponds to at least two materials.

[0271] The first identifier is the audio identifier described in the embodiment of the present application, and the second identifier is the material group identifier described in the embodiment of the present application.

[0272] In one possible implementation, the method also includes: in response to an operation on an icon of the first material in the second interface, the terminal device displays a twelfth interface, the twelfth interface including: the first material and a control for pinning the material; in response to an operation on the control for specifying the material, the terminal device displays the first material at the top in the second interface.

[0273] The twelfth interface can be Fig.15 In the interface shown in a, the control for pinning the material is control 1502.

[0274] Combined with the above Figure 4-Figure 16, the method provided in the embodiment of the present application is described, and the device for executing the above method provided in the embodiment of the present application is described below. Fig.17 As shown, Fig.17 A schematic diagram of the structure of a display device provided in an embodiment of the present application. The display device may be a terminal device in an embodiment of the present application, or a chip or chip system in a terminal device.

[0275] like Fig.17 As shown, the display device 1700 can be used in a communication device, a circuit, a hardware component or a chip, and the display device 1700 includes: a display unit 1701 and a processing unit 1702. The display unit 1701 is used to support the display step performed by the display method; the processing unit 1702 is used to support the display device 1700 to perform the information processing step.

[0276] In a possible implementation, the display device 1700 may further include a communication unit 1703, and the communication unit 1703 is used to support the display device 1700 to perform steps such as receiving or sending a message.

[0277] The display devices described in the embodiments of the present application may include Fig.17 The units described in the corresponding embodiments.

[0278] Specifically, the processing unit 1702 and the display unit 1701 may be integrated together, and the processing unit 1702 and the display unit 1701 may communicate with each other.

[0279] In a possible implementation, the display device 1700 may further include: a storage unit 1704. The storage unit 1704 may include one or more memories, and the memory may be a device in one or more devices or circuits for storing programs or data.

[0280] The storage unit 1704 may exist independently and be connected to the processing unit 1702 via a communication bus. The storage unit 1704 may also be integrated with the processing unit 1702.

[0281] Taking the display device 1700 as an example, which can be a chip or chip system of a terminal device in an embodiment of the present application, the storage unit 1704 can store computer execution instructions of the method of the terminal device, so that the processing unit 1702 executes the method of the terminal device in the above embodiment. The storage unit 1704 can be a register, a cache, or a random access memory (RAM), etc. The storage unit 1704 can be integrated with the processing unit 1702. The storage unit 1704 can be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, and the storage unit 1704 can be independent of the processing unit 1702.

[0282] In a possible implementation, the display device 1700 may further include: a communication unit 1703. The communication unit 1703 is used to support the display device 1700 to interact with other devices. Exemplarily, when the display device 1700 is a terminal device, the communication unit 1703 may be a communication interface or an interface circuit. When the display device 1700 is a chip or a chip system in a terminal device, the communication unit 1703 may be a communication interface. For example, the communication interface may be an input / output interface, a pin or a circuit, etc.

[0283] The device of this embodiment can be used to execute the steps executed in the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail here.

[0284] Fig.18 A schematic diagram of the hardware structure of another terminal device provided in an embodiment of the present application.

[0285] The terminal device includes a processor 1801, a communication line 1804 and at least one communication interface ( Fig.18 The communication interface 1803 is used as an example for explanation).

[0286] Processor 1801 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0287] Communications link 1804 may include circuitry for transmitting information between the above-described components.

[0288] The communication interface 1803 uses any transceiver or other device for communicating with other devices or communication networks, such as Ethernet, wireless local area networks (WLAN), etc.

[0289] Possibly, the terminal device may further include a memory 1802 .

[0290] The memory 1802 may be a read-only memory (ROM) or other types of static storage devices that can store static information and instructions, a random access memory (RAM) or other types of dynamic storage devices that can store information and instructions, or an electrically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory may exist independently and be connected to the processor via a communication line 1804. The memory may also be integrated with the processor.

[0291] The memory 1802 is used to store computer-executable instructions for executing the solution of the present application, and the execution is controlled by the processor 1801. The processor 1801 is used to execute the computer-executable instructions stored in the memory 1802, thereby implementing the method provided by the embodiment of the present application.

[0292] Possibly, the computer-executable instructions in the embodiments of the present application may also be referred to as application code, and the embodiments of the present application do not specifically limit this.

[0293] In a specific implementation, as an embodiment, the processor 1801 may include one or more CPUs, such as Fig.18 CPU0 and CPU1 in.

[0294] In a specific implementation, as an embodiment, the terminal device may include multiple processors, such as Fig.181801 and 1805 in the embodiment of the present invention. Each of these processors may be a single-CPU processor or a multi-CPU processor. The processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (e.g., computer program instructions).

[0295] In the above embodiments, the instructions stored in the memory for execution by the processor may be implemented in the form of a computer program product, wherein the computer program product may be pre-written in the memory, or may be downloaded and installed in the memory in the form of software.

[0296] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can store or a data storage device such as a server or data center that includes one or more available media integrated. For example, the available medium can include a magnetic medium (e.g., a floppy disk, a hard disk or a tape), an optical medium (e.g., a digital versatile disc (digital versatiledisc, DVD)), or a semiconductor medium (e.g., a solid state drive (solid state disk, SSD)), etc.

[0297] The embodiments of the present application also provide a computer-readable storage medium. The methods described in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer-readable media may include computer storage media and communication media, and may also include any medium that can transfer a computer program from one place to another. The storage medium may be any target medium that can be accessed by a computer.

[0298] As a possible design, the computer readable medium may include a compact disc read-only memory (CD-ROM), RAM, ROM, EEPROM or other optical disc storage; the computer readable medium may include a magnetic disk storage or other magnetic disk storage device. Moreover, any connection line may also be appropriately referred to as a computer readable medium. For example, if the software is transmitted from a website, server or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology (such as infrared, radio and microwave), the coaxial cable, fiber optic cable, twisted pair, DSL or wireless technology such as infrared, radio and microwave are included in the definition of medium. Disk and disc as used herein include compact disc (CD), laser disc, optical disc, digital versatile disc (DVD), floppy disk and Blu-ray disc, where disks usually reproduce data magnetically, while optical discs reproduce data optically using lasers.

[0299] The above combinations should also be included in the scope of computer-readable media. The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be based on the protection scope of the claims.

[0300] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and provide corresponding operation entrances for users to choose to authorize or refuse.

Claims

1. A display method, characterized in that: The method comprises: The terminal device displays a first interface, wherein the first interface includes an icon of a first application; The terminal device receives a first operation on the icon of the first application; In response to the first operation, the terminal device displays a second interface, wherein the second interface includes: an icon of a first material and an icon of a second material, wherein the first material is audio, and the second material is an image, audio, or video; The terminal device receives a second operation on the second interface; In response to the second operation, the terminal device displays a first icon in the second interface; The terminal device receives a third operation on the first icon; In response to the third operation, the terminal device displays a third interface, and the third interface includes: the first material and the second material.

2. The method according to claim 1, characterized in that The third interface also includes a first control, and the method further includes: In response to the operation on the first control, the terminal device displays a fourth interface, which includes a first video. The fourth interface is an interface for editing videos, and the first video is obtained by the terminal device editing the first material and the second material.

3. The method according to claim 2, characterized in that The fourth interface also includes one or more of the following: a second control for adding materials to the first video, a third control for exporting videos, a control for setting the resolution of the first video, a control for splitting the first video, or a control for setting transitions for the first video.

4. The method according to claim 3, characterized in that: After the terminal device displays the fourth interface, the method further includes: In response to the operation on the second control, the terminal device displays a fifth interface, wherein the fifth interface includes: the first icon and an icon of a third material, wherein the third material is an image, audio, or video; In response to the operation of adding the third material to the first video, the terminal device displays the third material in the fourth interface; In response to a user operation on a third control, the terminal device exports a second video, where the second video includes the first material, the second material, and the third material; In response to a user operation of opening the third interface, the terminal device displays the third material in the third interface.

5. The method according to any one of claims 1 to 4, characterized in that: The third interface also includes a control for adding a description, and the method further includes: In response to an operation on the control for adding a description, the terminal device displays a text box in the third interface; In response to an operation of inputting first information in the text box, the terminal device displays the first information in the text box, where the first information includes: text information and / or a to-do list.

6. The method according to any one of claims 1 to 5, characterized in that: The second interface also includes: a fourth control for viewing a material set, and the method further includes: In response to the operation on the fourth control, the terminal device displays a sixth interface, and the sixth interface includes: a fifth control for viewing more functions; In response to the operation on the fifth control, the terminal device displays a sixth control for detecting similar materials in the sixth interface; In response to the operation on the sixth control, the terminal device displays a second icon in the sixth interface; In response to the operation on the second icon, the terminal device displays a seventh interface, which includes: an icon of the third material and an icon of the fourth material, and the third material and the fourth material are materials whose similarity meets a preset condition.

7. The method according to claim 6, characterized in that The method further comprises: In response to the operation of selecting the third material and the fourth material, the terminal device displays a seventh control for merging similar materials in the seventh interface; In response to the operation on the seventh control, the terminal device displays a third icon in the second interface, and the third icon displays one or more of the following: an icon of the third material, an icon of the fourth material, or a third identifier, and the third identifier is used to indicate that the third icon corresponds to at least two similar materials.

8. The method according to claim 7, characterized in that When the seventh interface also includes: a fifth material, and the third material, the fourth material and the fifth material are materials whose similarities meet a preset condition, after responding to an operation on the seventh control, the method also includes: the terminal device deleting the fifth material.

9. The method according to claim 7 or 8, characterized in that: The method further comprises: In response to the operation on the third icon, the terminal device displays an eighth interface, wherein the eighth interface includes: a reduced icon of the third material, a reduced icon of the fourth material, and an eighth control for viewing more functions; In response to the operation on the eighth control, the terminal device displays a first window in the eighth interface, wherein the first window includes one or more of the following: a ninth control for setting a cover, or a tenth control for removing a similar image; When the icon of the third material is in a selected state, in response to an operation on the ninth control, the terminal device sets the icon of the third material as a cover, wherein the third icon includes the icon of the third material; Alternatively, when the icon of the third material is in a selected state, in response to an operation on the tenth control, the terminal device moves the third material out of the similar image, and after responding to the operation on the tenth control, the eighth interface does not include the reduced icon of the third material.

10. The method according to any one of claims 6 to 9, characterized in that: When the third material is audio and the fourth material is video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the similarity between the audio in the third material and the fourth material is greater than a first threshold; And / or, when the third material is an image and the fourth material is a video, the third material and the fourth material are materials whose similarity meets a preset condition, including: the ratio of the number of first images to the number of all images in the fourth material is greater than a second threshold, and the first image is an image in the fourth material whose similarity with the third material is greater than a third threshold.

11. The method according to any one of claims 6 to 10, characterized in that: The sixth interface also includes a fourth icon, and the method further includes: In response to the operation on the fourth icon, the terminal device displays a ninth interface, and the ninth interface includes: an icon of the first material, and when the second material is audio, the ninth interface also includes an icon of the second material.

12. The method according to any one of claims 1 to 11, characterized in that: The method further comprises: In response to the operation of downloading the sixth material, the terminal device displays an icon of the sixth material in the second interface; And / or, in response to an operation of obtaining the seventh material by recording, the terminal device displays an icon of the seventh material in the second interface, and both the sixth material and the seventh material are audio.

13. The method according to any one of claims 1 to 12, characterized in that: The first material carries at least one first tag, and the first tag is used to indicate the type of audio, and the type of audio includes one or more of the following: recording, dialogue, song, sound effect or voiceprint. The method further includes: In response to a user's operation of searching for the first tag in the second interface, the terminal device displays a tenth interface, where the tenth interface includes an icon of the first material and the first tag.

14. The method according to any one of claims 1 to 13, characterized in that: The second operation includes: an operation of dragging the icon of the first material to the icon of the second material, or an operation of dragging the icon of the second material to the icon of the first material.

15. The method according to any one of claims 1 to 13, characterized in that: The terminal device receives a second operation on the second interface, including: In response to an operation on the icon of the first material in the second interface, the terminal device displays an eleventh interface, the eleventh interface including: an eleventh control for merging at least two materials into one material group, the icon of the first material is in a selected state, and the icon of the second material is not in a selected state; When the icon of the second material is selected, the terminal device receives a second operation on the eleventh control.

16. The method according to any one of claims 1 to 15, characterized in that: A first identifier is displayed in the icon of the first material, and the first identifier is used to indicate that the first material is audio; one or more of the following are displayed in the first icon: a reduced icon of the first material, a reduced icon of the second material, and a second identifier, and the second identifier is used to indicate that the first icon corresponds to at least two materials.

17. The method according to any one of claims 1 to 16, characterized in that: The method further comprises: In response to an operation on the icon of the first material in the second interface, the terminal device displays a twelfth interface, wherein the twelfth interface includes: the first material and a control for pinning the material; In response to an operation on the control for specifying the material, the terminal device displays the first material at the top in the second interface.

18. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the terminal device executes the method according to any one of claims 1 to 17.

19. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the computer is caused to perform the method according to any one of claims 1 to 17.

Images