Display method, intelligent terminal and storage medium

Abstract

The invention provides a display method, an intelligent terminal and a storage medium, and the method comprises the steps: S10, responding to a first operation, and determining or generating image data; s20, identifying the image data to obtain at least one first application icon and position information of the first application icon; and S30, determining or generating a first interface based on the first application icon and the position information of the first application icon, and displaying the first interface on a display screen. In response to the first operation of selecting the image data by the user to perform interface layout, the interface layout function is realized based on the position information of each application icon in the image data, the problem of complicated operation of an interface layout mode of an intelligent terminal in related technologies is solved, the interface layout efficiency is improved, and the user experience is further improved.

Description

Technical Field

[0001] The present application relates to the field of electronic information technology, and in particular to a display method, an intelligent terminal and a storage medium. Background Art

[0002] The existing interface layout methods of smart terminals mainly include interface layout methods based on touch operations.

[0003] In the process of conceiving and implementing this application, the inventors found that there are at least the following problems: the interface layout method based on touch operation is mainly achieved by the user adjusting the position of each application icon in the display interface based on the touch screen, but the operation requirements of this method are complex and time-consuming.

[0004] Therefore, how to simplify the interface layout of smart terminals has become an urgent problem to be solved.

[0005] The preceding description is intended to provide general background information and does not necessarily constitute prior art. Summary of the invention

[0006] In response to the above technical problems, the present application provides a display method, a smart terminal and a storage medium, so that users can select image data and allow the smart terminal to identify the position of each application icon through the image data to determine the interface layout and display it, which is simple and convenient to operate.

[0007] The present application provides a display method, which can be applied to a smart terminal, including:

[0008] S10: determining or generating image data in response to a first operation;

[0009] S20: Identify the image data to obtain a first application icon and location information of the first application icon;

[0010] S30: Determine or generate a first interface based on the first application icon and the position information of the first application icon, and display the first interface on a display screen.

[0011] Optionally, the S30 includes:

[0012] determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen;

[0013] In response to the second operation, collecting location information of the target application icon;

[0014] A first interface is determined or generated based on the location information of the target application icon and the preview interface, and the first interface is displayed on the display screen.

[0015] Optionally, the determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0016] Acquire at least one second application icon in the smart terminal;

[0017] When there is at least one third application icon in the first application icons and the third application icon is not located in the second application icons, determining a data packet attribute of each of the third application icons;

[0018] When the data package attributes of each of the third application icons indicate that they are installation application icons, respectively downloading the installation data packages corresponding to each of the third application icons, so that the smart terminal includes each of the first application icons;

[0019] A first preview interface is determined or generated based on the first application icon and the position information of the first application icon, and the first preview interface is displayed on the display screen.

[0020] Optionally, after determining the data packet attribute of each of the third application icons, the method further includes:

[0021] When there is at least one fourth application icon among the third application icons and the data packet attributes of the fourth application icons all indicate that they are non-installed application icons, a second preview interface is determined or generated based on at least one fifth application icon and the position information of the fifth application icon, and the second preview interface is displayed on the display screen.

[0022] Optionally, the determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0023] Acquire at least one second application icon in the smart terminal;

[0024] When there is at least one sixth application icon in the second application icons and each of the sixth application icons is not located in the first application icons, determining or generating a first page based on the first application icons and the position information of the first application icons;

[0025] A second page is determined or generated based on the position information of the sixth application icon, and the first page or the second page is displayed on the display screen.

[0026] Optionally, the image data includes at least two folder windows and / or at least one eighth application icon, and the S20 includes:

[0027] Recognize the image data to obtain at least one seventh application icon in the folder window, location information of the seventh application icon, location information of the folder window, the eighth application icon, and location information of the eighth application icon;

[0028] The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0029] creating at least one folder based on at least one seventh application icon in each of the folder windows and the position information of the seventh application icon;

[0030] Based on the folder, the location information of the folder window, the eighth application icon and the location information of the eighth application icon, a third preview interface is determined or generated, and the third preview interface is displayed on the display screen.

[0031] Optionally, the image data includes a folder window, and S20 includes:

[0032] Recognize the image data to obtain the first application icon in the folder window and the position information of the first application icon;

[0033] The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0034] A fourth preview interface is determined or generated based on the first application icon in the folder window and the position information of the first application icon, and the fourth preview interface is displayed on the display screen.

[0035] Optionally, the image data includes video data, the preview interface includes a plurality of third pages, and S20 includes:

[0036] determining at least one target image data in the video data;

[0037] Respectively identifying each of the target image data, and determining the first application icon in each of the target image data and the position information of the first application icon;

[0038] The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0039] Determine or generate the third page in sequence according to the order of each target image data in the video data and based on the first application icon in each target image data and the position information of the first application icon;

[0040] Determine or generate a fifth preview interface based on each of the third pages, and display the fifth preview interface on the display screen; and / or,

[0041] The image data includes at least one non-continuous image data, the preview interface includes at least one fourth page, and S20 includes:

[0042] Respectively identifying each of the image data, and determining the first application icon in each of the image data and the position information of the first application icon;

[0043] The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0044] determining or generating the fourth page in sequence according to the first operation time sequence of each of the image data and based on the first application icon in each of the image data and the position information of the first application icon;

[0045] A sixth preview interface is determined or generated based on each of the fourth pages, and the sixth preview interface is displayed on the display screen.

[0046] The present application also provides a display device, which can be applied to a smart terminal, including:

[0047] A determination module, configured to determine or generate image data in response to a first operation;

[0048] an identification module, configured to identify the image data and obtain a first application icon and location information of the first application icon;

[0049] The display module is used to determine or generate a first interface based on the first application icon and the position information of the first application icon, and display the first interface on a display screen.

[0050] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of the above method are implemented.

[0051] The present application also provides a computer storage medium, wherein the computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented.

[0052] As described above, the display method of the present application can be applied to a smart terminal, including: in response to a first operation, determining or generating image data, identifying the image data, obtaining a first application icon and the position information of the first application icon, determining or generating a first interface based on the first application icon and the position information of the first application icon, and displaying the first interface on a display screen. Through the above technical solution, in response to the first operation of the user selecting image data, the interface layout function can be implemented based on the position information of the application icon in the image data, solving the problem of complex operation of the interface layout method of the smart terminal in the related technology, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and are used together with the specification to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0054] Figure 1 A schematic diagram of the hardware structure of a smart terminal for implementing each embodiment of the present application;

[0055] Figure 2 A communication network system architecture diagram provided for an embodiment of the present application;

[0056] Figure 3 It is an application scenario diagram of the existing display method provided in the embodiment of the present application;

[0057] Figure 4 This is one of the application scenario diagrams of a display method provided in an embodiment of the present application;

[0058] Figure 5 It is a flow chart of a display method shown in an embodiment of the present application;

[0059] Figure 6 is a flow chart of step S30 in a display method shown in an embodiment of the present application;

[0060] Figure 7 This is the second application schematic diagram of a display method shown in an embodiment of the present application;

[0061] Figure 8 This is the third application schematic diagram of a display method shown in an embodiment of the present application;

[0062] Fig. 9 This is the fourth application schematic diagram of a display method shown in an embodiment of the present application;

[0063] Fig.10 This is the fifth application schematic diagram of a display method shown in an embodiment of the present application;

[0064] Fig.11 is a flow chart of step S20 in a display method shown in an embodiment of the present application;

[0065] Fig.12 This is the sixth application schematic diagram of a display method shown in an embodiment of the present application;

[0066] Fig.13 is another flow chart of step S20 in a display method shown in an embodiment of the present application;

[0067] Fig.14 This is the seventh application schematic diagram of a display method shown in an embodiment of the present application;

[0068] Fig.15 This is the eighth application schematic diagram of a display method shown in an embodiment of the present application;

[0069] Fig.16 It is a schematic diagram of the structure of a display device shown in an embodiment of the present application.

[0070] The realization of the purpose, functional features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The above-mentioned drawings have shown clear embodiments of this application, which will be described in more detail later. These drawings and textual descriptions are not intended to limit the scope of the concept of this application in any way, but to illustrate the concept of this application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0071] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0072] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0073] It should be understood that, although the terms first, second, third, etc. may be used to describe various information in this article, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of this article, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination". Furthermore, as used in this article, the singular forms "one", "one" and "the" are intended to also include plural forms, unless there is an opposite indication in the context. It should be further understood that the terms "comprising" and "including" indicate that there are the described features, steps, operations, elements, components, projects, kinds, and / or groups, but do not exclude the existence, occurrence or addition of one or more other features, steps, operations, elements, components, projects, kinds, and / or groups. The terms "or", "and / or", "including at least one of the following" etc. used in this application can be interpreted as inclusive, or mean any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”, and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will only occur when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0074] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are displayed in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and it can be performed in other orders. Moreover, at least a portion of the steps in the figure may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with other steps or at least a portion of the sub-steps or stages of other steps.

[0075] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0076] It should be noted that, in this article, step codes such as S10, S20, S30 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial limitation on the sequence. When implementing the step, those skilled in the art may execute S20 first and then S10, etc., but these should all be within the scope of protection of this application.

[0077] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0078] In the subsequent description, the suffixes such as "module", "component" or "unit" used to represent elements are only used to facilitate the description of the present application and have no specific meaning. Therefore, "module", "component" or "unit" can be used in a mixed manner.

[0079] The smart terminal may be implemented in various forms. For example, the smart terminal described in this application may include smart terminals such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals such as digital TVs and desktop computers.

[0080] The subsequent description will be illustrated by taking a smart terminal as an example, and those skilled in the art will understand that, in addition to components specifically used for mobile purposes, the construction according to the embodiments of the present application can also be applied to fixed-type terminals.

[0081] See also Figure 1 , which is a schematic diagram of the hardware structure of a smart terminal for implementing various embodiments of the present application, the smart terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, A / V (audio / video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111 and other components. Those skilled in the art can understand that Figure 1 The structure of the smart terminal shown in the figure does not constitute a limitation on the smart terminal. The smart terminal may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0082] Combine the following Figure 1 A detailed introduction to each component of the smart terminal:

[0083] The radio frequency unit 101 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving the downlink information of the base station, it is sent to the processor 110 for processing; in addition, the uplink data is sent to the base station. Generally, the radio frequency unit 101 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 101 can also communicate with the network and other devices through wireless communication. The above-mentioned wireless communications can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution), TDD-LTE (Time Division Duplexing-Long Term Evolution) and 5G, etc.

[0084] WiFi is a short-range wireless transmission technology. The smart terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 102. It provides users with wireless broadband Internet access. Figure 1 The WiFi module 102 is shown, but it is understandable that it is not a necessary component of the smart terminal and can be omitted as needed without changing the essence of the invention.

[0085] The audio output unit 103 can convert the audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the smart terminal 100 is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, etc. Moreover, the audio output unit 103 can also provide audio output related to a specific function performed by the smart terminal 100 (for example, a call signal receiving sound, a message receiving sound, etc.). The audio output unit 103 may include a speaker, a buzzer, etc.

[0086] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processor (GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 106. The image frame processed by the graphics processor 1041 can be stored in the memory 109 (or other storage medium) or sent via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a telephone call mode, a recording mode, a voice recognition mode, and other operating modes, and can process such sound into audio data. The processed audio (voice) data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 can implement various types of noise elimination (or suppression) algorithms to eliminate (or suppress) noise or interference generated in the process of receiving and sending audio signals.

[0087] The smart terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the smart terminal 100 moves to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the smart terminal 100 (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can also be configured in the smart terminal 100, such as fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0088] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0089] The user input unit 107 can be used to receive input digital or character information, and to generate key signal input related to the user settings and function control of the intelligent terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 1071 or near the touch panel 1071 using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 can be implemented in various types such as resistive, capacitive, infrared, and surface acoustic waves. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, a function key (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, etc., which are not specifically limited here.

[0090] Optionally, the touch panel 1071 may cover the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. Then, the processor 110 provides corresponding visual output on the display panel 1061 according to the type of touch event. Figure 1 In the figure, the touch panel 1071 and the display panel 1061 are used as two independent components to realize the input and output functions of the smart terminal. However, in some embodiments, the touch panel 1071 and the display panel 1061 can be integrated to realize the input and output functions of the smart terminal, which is not limited here.

[0091] The interface unit 108 is used as an interface through which at least one external device can be connected to the smart terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the smart terminal 100 or may be used to transmit data between the smart terminal 100 and an external device.

[0092] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a program storage area and a data storage area. Optionally, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the smart terminal 100 (such as audio data, a phone book, etc.), etc. In addition, the memory 109 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0093] The processor 110 is the control center of the smart terminal. It uses various interfaces and lines to connect various parts of the entire smart terminal. It executes various functions of the smart terminal and processes data by running or executing software programs and / or modules stored in the memory 109, and calling data stored in the memory 109, so as to monitor the smart terminal as a whole. The processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor and a modem processor. Optionally, the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 110.

[0094] The intelligent terminal 100 may also include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 through a power management system, thereby managing functions such as charging, discharging, and power consumption through the power management system.

[0095] although Figure 1 Not shown, the smart terminal 100 may also include a Bluetooth module, etc., which will not be described in detail here.

[0096] To facilitate understanding of the embodiments of the present application, the communication network system on which the smart terminal of the present application is based is described below.

[0097] See also Figure 2 , Figure 2 A communication network system architecture diagram is provided for an embodiment of the present application, wherein the communication network system is an LTE system of universal mobile communication technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence for communication.

[0098] Optionally, UE201 may be the above-mentioned terminal 100, which will not be described in detail here.

[0099] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 , etc. Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface), and eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0100] EPC203 may include MME (Mobility Management Entity) 2031, HSS (Home Subscriber Server) 2032, other MMEs 2033, SGW (Serving Gate Way) 2034, PGW (PDN Gate Way) 2035 and PCRF (Policy and Charging Rules Function) 2036, etc. Optionally, MME 2031 is a control node that processes signaling between UE 201 and EPC 203, and provides bearer and connection management. HSS 2032 is used to provide some registers to manage functions such as home location register (not shown in the figure), and store some user-specific information such as service features and data rates. All user data can be sent through SGW2034, PGW2035 can provide IP address allocation and other functions for UE 201, PCRF2036 is the policy and charging control policy decision point for service data flow and IP bearer resources, which selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0101] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem) or other IP services.

[0102] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, 5G and future new network systems (such as 6G), etc., without limitation here.

[0103] Based on the above-mentioned smart terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0104] In some embodiments, the user can perform layout operations of application icons on the interface through touch operations or external input device output operations. After each touch operation or external input device input operation of the user, the smart terminal displays the corresponding interface layout. When the user needs to adjust the layout of multiple application icons, it is necessary to repeat the interface layout operation multiple times. The operation of this method is complicated and cumbersome, the flexibility is poor, and the efficiency of desktop layout is low, resulting in a poor user experience.

[0105] Figure 3 A schematic diagram of an application scenario of a related display method.

[0106] Take the smart terminal as a smart phone as an example, see Figure 3 When the smartphone is in the startup state, the interface layout is shown in interface 301, which includes application icons such as recorder, music, settings, calendar, documents, travel, calls, camera, and album. The user can perform an interface layout operation of dragging the calendar application icon downward in interface 301 through touch operation. When the user operation is completed, the smartphone layouts the calendar application icons according to the interface layout operation, and obtains the interface layout shown in interface 302. The above interface layout operation can only adjust the position information of a single application icon in the interface, and cannot meet the user's needs for adjusting multiple application icons.

[0107] In order to solve the above technical problems, the embodiment of the present application provides a display method, which can be applied to a smart terminal, the smart terminal having a display screen. In response to a first operation of a user selecting image data, the position information of each application icon in the image data is identified to adjust the interface layout, the operation is simple, the efficiency of the interface layout is improved, and the user experience is thereby improved.

[0108] The following takes a smartphone and the interface layout operation as an example of touch operation. Figure 4 , introduce the application scenarios of this application.

[0109] Figure 4 A schematic diagram of an application scenario provided by an embodiment of the present application. Figure 4 The interface layout of the smart phone is shown in interface 401, which includes multiple application icons such as recorder, music, settings, calendar, documents, travel, call, camera, album, etc.

[0110] The user can perform the operation of entering the setting application icon 4011 by touching the operation, thereby entering the interface layout operation page in the setting application, such as interface 402. The user selects the "adjust interface layout according to image data" control 4021 in interface 402 by touching the operation, and enters the image data selection page, such as interface 403. Interface 403 includes multiple image data such as image data 4031, image data 4021, video data 4033, and video data 4044. The user selects image data 4031 by touching the operation to complete the first operation. In response to the user's first operation, the smart phone identifies the image data 4031, obtains the position information (also called interface layout information) of each first application icon (including recorder, music, settings, weather, documents, travel, calls, albums, cameras, etc.) and the first application icon in the image data 4031, and determines or generates the first interface according to the first application icons and the position information of the first application icons in the above-mentioned image data 4031 and displays it, such as interface 404.

[0111] Based on this, when the user selects image data to perform an interface layout operation, the user can view the interface layout effect corresponding to the image data through the display screen.

[0112] In the following, the technical solution shown in the present application is described in detail by taking the smart terminal as a smart phone as an example. Optionally, the following embodiments can exist alone or in combination with each other, and the same or similar contents will not be repeated in different embodiments.

[0113] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in one or more embodiments of this specification are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards, and corresponding operation entrances shall be provided for users to choose to authorize or refuse.

[0114] First embodiment

[0115] Figure 5 A flow chart of a display method provided in an embodiment of the present application. Figure 5 , the method may include:

[0116] S10: In response to a first operation, determining or generating image data.

[0117] Optionally, when the user selects the first operation of executing the image data interface layout, the intelligent terminal determines or generates the image data corresponding to the first operation in response to the first operation.

[0118] Optionally, the image data includes but is not limited to image data and / or video data.

[0119] Optionally, the first operation may be a layout operation of the application icons on the display screen output by the user through an external input device (eg Figure 4 The first operation may be a click operation or a drag operation, or the like.

[0120] Optionally, the above-mentioned image data may include image data captured by the smart terminal (such as image data or video data captured by other terminal devices), image data legally obtained by the smart terminal from a third-party platform (such as image data or video data including interface layout), and / or image data transmitted to the smart terminal by other terminals (such as screenshots of other terminals' interfaces, image data or video data including interface layout). For example, the third-party platform may indicate an open cloud server storing image data.

[0121] Exemplarily, when the image data selected by the user is image data transmitted from other terminals to the smart terminal, the smart terminal determines and displays the page layout based on the above image data, so that the interface layout of the smart terminal is consistent with other terminal devices, simplifying the interface layout operation under multiple devices and improving the interface layout efficiency.

[0122] S20: Identify the image data to obtain a first application icon and location information of the first application icon.

[0123] Optionally, image processing is performed on the image data to identify and obtain the first application icon and position information of the first application icon included in the image data.

[0124] Optionally, the first application icon is an icon of an application (APPlication, APP) existing in the image data. Figure 4 The application icon of the weather application in the internal image data 4031.

[0125] Optionally, the position information of the first application icon is used to indicate the relative position of the first application icon in the image data. Exemplarily, the position information of the first application icon may include a first distance between the first application icon and the left border of the image data, a second distance between the first application icon and the right border of the image data, a third distance between the first application icon and the upper border of the image data, and a fourth distance between the first application icon and the lower border of the image data.

[0126] Optionally, the interface in the smart terminal is pre-set with a plurality of grids, and each grid is used to display an application icon.

[0127] The image data is divided according to the grid design in the interface of the smart terminal to obtain the corresponding grid. Based on this, the position information of the first application icon can indicate the grid information of the first application icon in the image data, and specifically, the grid information can include row information and column information.

[0128] For example, the interface in the smart terminal is as follows: Figure 4 As shown in the middle interface 401 , it includes 4*3 grids for displaying 12 grids. The image data 4031 is divided to obtain 4*3 grids. The location information of the recorder application icon can be the first row and the first column in the image data 4031 .

[0129] S30: Determine or generate a first interface based on the first application icon and the position information of the first application icon, and display the first interface on a display screen.

[0130] Optionally, based on the first application icon included in the image data and the position information of the first application icon, the relative position information of the first application icon in the interface of the smart terminal is determined, so as to determine or generate the first interface and display it through the display screen.

[0131] Optionally, the position information of the first application icon in the first interface corresponds one-to-one to the relative position of the first application icon in the image data.

[0132] Optionally, when the position information of the first application icon is used to indicate the relative position of the first application icon in the image data, the position information of the first application icon in the first interface includes: the first distance between the first application icon and the left border of the first interface, the second distance between the first application icon and the right border of the first interface, the third distance between the first application icon and the upper border of the first interface, and the fourth distance between the first application icon and the lower border of the first interface.

[0133] Optionally, when the position information of the first application icon indicates grid information of the first application icon in the image data, the position information of the first application icon in the first interface is the grid information of the first application icon in the first interface.

[0134] For example, the image data is image data, and the position information of the recorder application icon in the image data 4031 may be the first row and the first column in the image data 4031. The first interface obtained correspondingly is as follows: Figure 4 As shown in the middle interface 404, the location information of the recorder application icon is located at the first row and first column in the first interface.

[0135] An embodiment of the present application provides a display method, which identifies the position information of each application icon in the image data in response to a first operation of a user selecting image data, and adjusts the interface layout based on the position information of each application icon in the image data. The operation is simple and the interface layout efficiency of the smart terminal is improved.

[0136] Second embodiment

[0137] exist Figure 5 Based on the embodiment shown, the following Figure 6 , further illustrating the above display method.

[0138] Figure 6 This is a flow chart of another display method step S30 provided in an embodiment of the present application. Figure 6 , step S30 in the method may include:

[0139] S301: Determine or generate a preview interface based on the first application icon and the position information of the first application icon, and display the preview interface on the display screen.

[0140] Optionally, based on the first application icon and the position information of the first application icon, a preview interface is determined or generated, the position information of the first application icon in the preview interface corresponds one-to-one to the relative position of the first application icon in the image data, and the preview interface is displayed on the display screen.

[0141] Optionally, the preview interface is used to display an interface layout effect determined based on the image data.

[0142] S302: In response to the second operation, collect location information of the target application icon.

[0143] Optionally, the second operation includes a user confirmation operation on the preview interface, that is, the user determines to use the current preview interface as the display interface of the smart terminal. Based on this, in response to the second operation, the target application icon is empty (null), and the collected location information of the target application icon is empty (null).

[0144] Optionally, the second operation includes a secondary interface layout operation of one or more application icons in the preview interface, that is, an adjustment operation of the position information of one or more application icons in the preview interface. Based on this, in response to the second operation of the user on the preview interface, the application icon corresponding to the second operation is determined as the target application icon, and the position information of the target application icon corresponding to the second operation is collected.

[0145] Optionally, the position information of the target application icon may indicate the position information of the target application icon in the preview interface when the second operation is completed, such as the distance between the target application icon and various boundaries of the preview interface (including the upper boundary, lower boundary, left boundary and right boundary, etc.), or the grid information of the target application icon in the preview interface.

[0146] Optionally, the second operation may be an operation on the first application icon in the preview interface output by the user through an external input device, or may be a touch operation on the first application icon in the preview interface directly by the user. The second operation may be a click operation or a drag operation, etc.

[0147] S303: Determine or generate a first interface based on the location information of the target application icon and the preview interface, and display the first interface on the display screen.

[0148] Optionally, when the second operation is a confirmation operation of the user on the preview interface, the preview interface is determined to be the first interface, and the preview interface is displayed on the display screen.

[0149] Optionally, when the second operation is a secondary interface layout operation of one or more application icons in the preview interface by the user, the first interface is determined or generated based on the location information of the target application icon and the preview interface, and the first interface is displayed on the display screen.

[0150] Figure 7 A schematic diagram of an application scenario provided by an embodiment of the present application. Figure 7 The image data 701 includes multiple first application icons such as recorder, music, settings, weather, documents, travel, calls, albums, and cameras. The preview interface determined or generated based on the image data 701 is shown in interface 702. The user performs a second operation of dragging the document application icon located on the right side of the weather application icon to the lower left of the interface in interface 702. Based on the above second operation, the determined first interface is shown in interface 703: the document application icon is moved to the bottom of the weather application icon.

[0151] The embodiment of the present application can adjust the interface layout by identifying the number of images to improve the efficiency of the interface layout, and can further realize the user's adjustment needs for the interface layout based on the process from the preview interface to the first interface, thereby improving the user experience.

[0152] Next, combine Figure 8-10 , introduce the application scenarios of this application.

[0153] Optionally, S301 includes:

[0154] Acquire at least one second application icon in the smart terminal;

[0155] When there is at least one third application icon in the first application icons and the third application icon is not located in the second application icons, determining a data packet attribute of each of the third application icons;

[0156] When the data package attributes of each of the third application icons indicate that they are installation application icons, respectively downloading the installation data packages corresponding to each of the third application icons, so that the smart terminal includes each of the first application icons;

[0157] A first preview interface is determined or generated based on the first application icon and the position information of the first application icon, and the first preview interface is displayed on the display screen.

[0158] Optionally, at least one second application icon in the current smart terminal is acquired, where the second application icon indicates an icon of an application program that has been installed or is being installed in the current smart terminal.

[0159] Optionally, when there is at least one third application icon in at least one first application and the third application icon is not in at least one second application, it indicates that the application corresponding to the third application icon in the image data is not installed in the current smart terminal, and the data packet attributes of each of the above third application icons are determined.

[0160] Optionally, the data package attribute of the third application icon includes installable and non-installable, and the corresponding third application icon includes an installation application icon or a non-installation application icon. Among them, the installation application icon indicates an application icon of a data package that can be installed by the application program in the current smart terminal. The non-installation application icon indicates an application icon of a data package that cannot be installed by the application program in the current smart terminal.

[0161] Optionally, the installed application icon includes an icon of a social application program. The non-installed application icon includes an operating system assistant that is not supported by the current smart terminal.

[0162] Optionally, when the data package attribute of each third application icon indicates that it is an installation application icon, the installation data package corresponding to each third application icon is downloaded respectively, so that each first application icon is included in the smart terminal. In other words, each first application icon exists in at least one second application icon.

[0163] Optionally, the first application icon includes the third application icon. The position information of the first application icon includes the position information of the third application icon.

[0164] Optionally, a first preview interface is determined or generated based on the first application icon and the position information of the first application icon, and the first preview interface is displayed on the display screen.

[0165] In response to the user's first operation, the embodiment of the present application simultaneously adjusts the number and layout of application icons in the smart terminal by identifying image data, thereby further improving the efficiency of the interface layout.

[0166] See also Figure 8 , the display interface of the smart phone is shown in interface 801, including 7 second application icons such as recorder, document, setting, travel, call, camera, and album. Image data 802 includes 9 first application icons such as recorder, music, weather, document, setting, travel, call, camera, and album. Correspondingly, it can be determined that the third application icons include a music application icon and a weather application icon. The smart phone downloads the installation data package of the music application icon and the weather application icon, and determines or generates a first preview interface as shown in interface 803 based on the location information of the first application icon in the image data 802. In this way, the smart phone includes each first application icon.

[0167] Optionally, after determining the data packet attribute of each of the third application icons, S301 further includes:

[0168] When there is at least one fourth application icon among the third application icons and the data packet attributes of the fourth application icons all indicate that they are non-installed application icons, a second preview interface is determined or generated based on at least one fifth application icon and the position information of the fifth application icon, and the second preview interface is displayed on the display screen.

[0169] Optionally, the fifth application icon is an application icon among the first application icons except the fourth application icons.

[0170] Optionally, when there are one or more fourth application icons in each third application icon and the data packet attributes of each fourth application icon indicate that it is a non-installation application icon, it is determined that the smart terminal cannot download the installation data packet corresponding to each fourth application icon, and the corresponding preview interface does not include the fourth application icons. Based on the position information of each fourth application icon in the image data, it can be determined that the corresponding position information in the preview interface of each fourth application icon is empty (null).

[0171] Optionally, in each third application icon, an installation data package corresponding to the application icon having a data package attribute of being installable is determined and downloaded.

[0172] Optionally, in at least one first application, other application icons except the fourth application icon are determined as fifth application icons, and a second preview interface is determined or generated based on at least one fifth application icon and the position information of the fifth application icon, and the second preview interface is displayed on the display screen.

[0173] See also Fig. 9, the second application icons contained in the smart phone are shown in interface 901, including 7 second application icons such as recorder, document, setting, travel, call, camera, and album. Image data 902 includes 9 first application icons such as mobile assistant, recorder, music, weather, document, setting, travel, call, camera, and album. The smart terminal determines that the data packet attribute of the mobile assistant application icon is not installable, and the corresponding mobile assistant application icon is a non-installation application icon (that is, the fourth application icon), and determines that the fifth application icon includes application icons other than the mobile assistant application icon in the image data 902, and the corresponding second interface is generated as shown in interface 903, and the area corresponding to the mobile assistant application icon in the smart terminal is displayed as empty.

[0174] Optionally, S301 includes:

[0175] Acquire at least one second application icon in the smart terminal;

[0176] When there is at least one sixth application icon in the second application icons and each of the sixth application icons is not located in the first application icons, determining or generating a first page based on the first application icons and the position information of the first application icons;

[0177] A second page is determined or generated based on the position information of the sixth application icon, and the first page or the second page is displayed on the display screen.

[0178] Optionally, at least one second application icon in the current smart terminal is obtained, and when there is one or more sixth application icons in at least one second application icon and each sixth application icon is not in the first application icon, it is determined that the sixth application icon is an application icon installed in the smart terminal but does not exist in the image data.

[0179] Optionally, the first page is determined or generated based on the first application icon and the position information of the first application icon. The position information of each sixth application icon is obtained, and the second page is determined or generated based on the position information of each sixth application icon.

[0180] Optionally, the preview interface includes a first page and / or a second page, and the corresponding display screen displays the first page and / or the second page.

[0181] Optionally, the first page or the second page may be displayed sequentially on the display screen in an animation form.

[0182] Optionally, only the first page is displayed on the display screen, or only the second page is displayed on the display screen.

[0183] Optionally, the position information of the sixth application icon may include grid information of the sixth application icon in the interface layout of the current smart terminal, or the relative position between the sixth application icon and each boundary of the interface in the current smart terminal.

[0184] See also Fig.10 , the second application icon included in the smart phone is shown in interface 1011, which includes the sixth application icons that do not exist in the image data 1012, namely, "game" application icon and "calculator" application icon, the corresponding first page generated based on the image data 1012 is shown in 1021, and the second page is determined or generated based on the position information of each sixth application icon, as shown in 1022. The first page is displayed on the display screen, as shown in interface 1003.

[0185] In response to the first operation, the embodiment of the present application determines multiple pages based on the image data and displays them in different ways, thereby improving the interaction efficiency during the interface layout process.

[0186] Third embodiment

[0187] exist Figure 6 Based on the embodiment shown, the following Fig.11 , further illustrating the above display method.

[0188] Optionally, the image data includes at least two folder windows and / or at least one eighth application icon.

[0189] Optionally, the image data includes at least two folder windows and / or at least one eighth application icon. The first application icon includes at least one seventh application icon in each folder window and the at least one eighth application icon.

[0190] Fig.11 This is a flow chart of step S20 of an image processing method provided in an embodiment of the present application. Fig.11 The method step S20 comprises:

[0191] S201. Identify the image data to obtain at least one seventh application icon in the folder window, location information of the seventh application icon, location information of the folder window, the eighth application icon, and location information of the eighth application icon.

[0192] Optionally, the image data is identified to determine the location information of each folder window, to identify at least one seventh application icon included in each folder window and the location information of the seventh application icon, and to determine at least one eighth application icon and the location information of each eighth application icon in the image data except for the folder windows.

[0193] Optionally, the seventh application icon is different from the eighth application icon.

[0194] Optionally, the determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0195] creating at least one folder based on at least one seventh application icon in each of the folder windows and the position information of the seventh application icon;

[0196] Based on the folder, the location information of the folder window, the eighth application icon and the location information of the eighth application icon, a third preview interface is determined or generated, and the third preview interface is displayed on the display screen.

[0197] Optionally, at least one folder is created based on at least one seventh application icon and position information of the seventh application icon in each folder window.

[0198] Optionally, when there is a third application icon in at least one seventh application icon in each folder window, the data packet attributes of each third application icon are determined, and the installation data packet corresponding to the installable application icon with the data packet attribute is downloaded in the corresponding folder window, and / or, the location information corresponding to the fourth application icon is set to empty in the corresponding folder window.

[0199] Optionally, based on at least one folder, position information of each folder window, at least one eighth application icon and position information of the eighth application icon, a third preview interface is determined or generated and displayed on the display screen.

[0200] Fig.12 A schematic diagram of an application scenario provided by an embodiment of the present application. Fig.12 The image data 1201 includes a folder window: a folder 1 window, and eighth application icons such as documents, settings, travel, calls, albums, and cameras. The folder 1 window includes three seventh application icons such as recorder, music, and weather. The third preview interface determined or generated based on the image data 1201 is shown in interface 1202.

[0201] Fourth embodiment

[0202] Optionally, the image data includes a folder window.

[0203] Optionally, the image data includes a folder window, the at least one application icon in the image data includes only the application icons in the folder window, and the preview interface generated based on the image data includes only the above folder window and the application icons in the folder window.

[0204] Fig.13 This is a flow chart of step S20 of an image processing method provided in an embodiment of the present application. Fig.13 The method step S20 further includes:

[0205] S202: Identify the image data to obtain the first application icon in the folder window and location information of the first application icon.

[0206] Optionally, the image data is identified to obtain the first application icon in the folder window and the position information of the first application icon.

[0207] Optionally, determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0208] A fourth preview interface is determined or generated based on the first application icon in the folder window and the position information of the first application icon, and the fourth preview interface is displayed on the display screen.

[0209] Optionally, a fourth preview interface is determined or generated based on the first application icon in the folder window and the position information of the first application icon, the fourth preview interface only includes the above-mentioned folder window, and the above-mentioned fourth preview interface is displayed on the display screen.

[0210] It is understandable that the size and position information of the folder window in the fourth preview interface can be specifically set according to actual conditions. For example, the folder window is set to be located in the center of the fourth preview interface, or the folder window is set to be located in the upper left corner of the fourth preview interface, which is not specifically limited in the embodiment of the present application.

[0211] Fig.14 A schematic diagram of an application scenario provided by an embodiment of the present application. Fig.14 , the image data 1401 only includes one folder window: the desktop game window. The desktop game window includes four first application icons, namely, game 1, game 2, game 3, and game 4. The fourth reading interface determined based on the image data 1401 is shown in interface 1402, Fig.14 In the example, the desktop game window is located in the center of the interface 1402 .

[0212] Optionally, the image data includes video data, and the preview interface includes a plurality of third pages.

[0213] Optionally, the image data includes video data, and the video data includes multiple frames of continuous image data. In this way, at least one image data can be determined from the video data to identify the first application icon and the corresponding location information. Based on this, the preview interface includes multiple third pages.

[0214] Optionally, the number of third pages in the preview interface is consistent with the number of image data determined from the video data.

[0215] Optionally, the S20 includes:

[0216] determining at least one target image data in the video data;

[0217] Each of the target image data is identified respectively, and the first application icon in each of the target image data and the position information of the first application icon are determined.

[0218] Optionally, at least one image data is determined from the video data as the target image data. The method for determining the target image data can be specifically set according to actual conditions.

[0219] Optionally, at least one image data is randomly selected from the video data as the target image data.

[0220] Optionally, a target number of image data is determined from the video data as the target image data, wherein the target number can be specifically set according to actual conditions, for example, the target number is 5, or the target number is 10.

[0221] Optionally, based on the duration and frame rate of the video data, the number of target image data and the position of each target image data in the image in the video data are determined.

[0222] For example, the duration of the video data is 3s, the frame rate of the video data is 30fps, and correspondingly, 1 image data is selected every 9 frames from the video data to obtain 10 target image data. Alternatively, 1 image data is selected every 9 frames from the video data, and the first frame of image data is selected to obtain 11 target image data.

[0223] Optionally, the determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0224] Determine or generate the third page in sequence according to the order of each target image data in the video data and based on the first application icon in each target image data and the position information of the first application icon;

[0225] A fifth preview interface is determined or generated based on each of the third pages, and the fifth preview interface is displayed on the display screen.

[0226] Optionally, according to the order of each target image data in the video data, according to the first application icon in each target image data and the position information of the first application icon, the third page corresponding to each target image data is determined or generated in sequence to obtain multiple third pages.

[0227] Optionally, the manner of determining or generating the fifth preview interface based on each third page may be specifically set according to actual conditions.

[0228] Optionally, a third page is randomly selected from the third pages as the fifth preview interface and displayed on the display screen.

[0229] Optionally, the third page corresponding to the first target image data is set as a fifth preview interface and displayed on the display screen.

[0230] Optionally, a corresponding animation is formulated based on each third page as a fifth preview interface, and displayed on the display screen.

[0231] The embodiment of the present application selects a certain amount of image data from the video data corresponding to the first operation, and adjusts the interface layout of multiple pages based on the recognition results of the above image data, thereby reducing power consumption while improving the efficiency of the interface layout.

[0232] Fig.15 A schematic diagram of an application scenario provided by an embodiment of the present application. Fig.15 , the image data is video data, and the video data includes 90 frames of image data. Every 9 frames, 1 image data is selected, and the first frame of image data is selected to obtain 11 target image data. According to each target image data, 11 corresponding third pages are determined respectively. The third page 1 corresponding to the first frame of image data is used as the fifth preview interface (such as interface 1501).

[0233] Optionally, the image data includes at least one non-continuous image data, and the preview interface includes at least one fourth page.

[0234] Optionally, the image data includes at least one non-continuous image data, and the corresponding preview interface includes at least one fourth page.

[0235] Optionally, one or more image data may be determined from at least one non-continuous image data to identify the first application icon and the corresponding position information. Based on this, the preview interface includes at least one fourth page.

[0236] Optionally, the number of the fourth page in the preview interface is consistent with the number of image data determined from at least one non-continuous image data.

[0237] Optionally, the S20 includes:

[0238] Each of the image data is identified respectively, and the first application icon in each of the image data and the position information of the first application icon are determined.

[0239] Optionally, each image data in a non-continuous image data is identified respectively to determine the first application icon in each image data and the position information of the first application icon in each image data.

[0240] Optionally, the determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes:

[0241] determining or generating the fourth page in sequence according to the first operation time sequence of each of the image data and based on the first application icon in each of the image data and the position information of the first application icon;

[0242] A sixth preview interface is determined or generated based on each of the fourth pages, and the sixth preview interface is displayed on the display screen.

[0243] Optionally, in response to the first operation, the first operation time of each image data is determined, and in order of the first operation time of each image data, the fourth page corresponding to each image data is determined or generated in sequence based on the first application icon in each image data and the position information of each first application icon in each image data.

[0244] Optionally, the method of determining or generating the sixth preview interface based on each fourth page may be specifically set according to actual conditions.

[0245] Optionally, a third page is randomly selected from each fourth page as a sixth preview interface and displayed on the display screen.

[0246] Optionally, among at least one non-continuous image data, the image data with the shortest first operation time is used as the target preview image, and the fourth page corresponding to the target preview image is used as the sixth preview interface and displayed on the display screen.

[0247] Optionally, a corresponding animation is formulated based on each fourth page as a sixth preview interface, and displayed on the display screen.

[0248] In response to the user's first operation, the embodiment of the present application adjusts the interface layout of multiple pages in the smart terminal device by identifying image data or video data, simplifies the interface layout operation, reduces the time consumption of the interface layout, and thus improves the efficiency of the interface layout.

[0249] The above examples are only reference examples. In order to avoid redundancy, they are not listed one by one here. In actual development or application, they can be flexibly combined according to actual needs, but any combination belongs to the technical solution of this application and is covered within the scope of protection of this application.

[0250] Fifth embodiment

[0251] Fig.16 This is a schematic diagram of the structure of a display device provided in an embodiment of the present application. The display device 16 is applied to a smart terminal. Fig.16 , the display device 16 comprises:

[0252] The determination module 1601 is used to determine or generate image data in response to a first operation;

[0253] An identification module 1602 is used to identify the image data and obtain a first application icon and location information of the first application icon;

[0254] The first display module 1603 is used to determine or generate a first interface based on the first application icon and the position information of the first application icon, and display the first interface on a display screen.

[0255] Optionally, the first display module 1603 includes:

[0256] A preview submodule, configured to determine or generate a preview interface based on the first application icon and the position information of the first application icon, and display the preview interface on the display screen;

[0257] A collection submodule, configured to collect location information of a target application icon in response to a second operation;

[0258] The display submodule is used to determine or generate a first interface based on the location information of the target application icon and the preview interface, and display the first interface on the display screen.

[0259] Optionally, preview submodules, including:

[0260] A first acquisition unit, configured to acquire at least one second application icon in the smart terminal;

[0261] a first determining unit, configured to determine a data packet attribute of each of the third application icons when there is at least one third application icon in the first application icons and the third application icon is not located in the second application icons;

[0262] a downloading unit, configured to download installation data packages corresponding to the third application icons respectively when the data package attributes of the third application icons indicate that the third application icons are installation application icons, so that the smart terminal includes the first application icons;

[0263] The first display unit is configured to determine or generate a first preview interface based on the first application icon and the position information of the first application icon, and display the first preview interface on the display screen.

[0264] Optionally, the preview submodule also includes:

[0265] The second display unit is used to determine or generate a second preview interface based on at least one fifth application icon and position information of the fifth application icon when there is at least one fourth application icon in the third application icons and the data packet attributes of the fourth application icons all indicate that they are non-installed application icons, and display the second preview interface on the display screen.

[0266] Optionally, the fifth application icon is an application icon among the first application icons except the fourth application icons.

[0267] Optionally, preview submodules, including:

[0268] A second acquisition unit, configured to acquire at least one second application icon in the smart terminal;

[0269] a second determining unit, configured to determine or generate a first page based on the first application icon and position information of the first application icon when there is at least one sixth application icon in the second application icon and each of the sixth application icons is not located in the first application icon;

[0270] The third display unit is used to determine or generate a second page based on the position information of the sixth application icon, and display the first page or the second page on the display screen.

[0271] Optionally, the image data includes at least two folder windows and / or at least one eighth application icon, and the identification module 1602 includes:

[0272] A first identification submodule is used to identify the image data, obtain at least one seventh application icon in the folder window, the position information of the seventh application icon, the position information of the folder window, the eighth application icon and the position information of the eighth application icon;

[0273] Preview submodules, including:

[0274] A creating unit, configured to create at least one folder based on at least one seventh application icon in each of the folder windows and the position information of the seventh application icon;

[0275] The fourth display unit is used to determine or generate a third preview interface based on the folder, the location information of the folder window, the eighth application icon and the location information of the eighth application icon, and display the third preview interface on the display screen.

[0276] Optionally, the image data includes a folder window, and the identification module 1602 includes:

[0277] A second identification submodule is used to identify the image data and obtain the first application icon in the folder window and the position information of the first application icon;

[0278] Preview submodules, including:

[0279] The fifth display unit is used to determine or generate a fourth preview interface based on the first application icon in the folder window and the position information of the first application icon, and display the fourth preview interface on the display screen.

[0280] Optionally, the image data includes video data, the preview interface includes a plurality of third pages, and the identification module 1602 includes:

[0281] A determination submodule, used to determine at least one target image data in the video data;

[0282] A third identification submodule is used to identify each of the target image data respectively, and determine the first application icon in each of the target image data and the position information of the first application icon;

[0283] Preview submodules, including:

[0284] A third determining unit, configured to determine or generate the third page in sequence according to the order of the target image data in the video data and based on the first application icon in each target image data and the position information of the first application icon;

[0285] A sixth display unit, configured to determine or generate a fifth preview interface based on each of the third pages, and display the fifth preview interface on the display screen;

[0286] Optionally, the image data includes at least one non-continuous image data, the preview interface includes at least one fourth page, and the identification module 1602 includes:

[0287] a fourth identification submodule, configured to identify each of the image data respectively, and determine the first application icon in each of the image data and the position information of the first application icon;

[0288] Preview submodules, including:

[0289] A fourth determining unit, configured to determine or generate the fourth page in sequence according to the first operation time sequence of each image data and based on the first application icon in each image data and the position information of the first application icon;

[0290] The seventh display unit is used to determine or generate a sixth preview interface based on each of the fourth pages, and display the sixth preview interface on the display screen.

[0291] The display device provided in this embodiment can be used to implement the technical solution of the above method embodiment. Its implementation principle and technical effect are similar, and this embodiment will not be repeated here.

[0292] The present application also provides an intelligent terminal, which includes a memory and a processor. The memory stores a display program, and when the display program is executed by the processor, the steps of the display method in any of the above embodiments are implemented.

[0293] The present application also provides a computer-readable storage medium, on which a display program is stored. When the display program is executed by a processor, the steps of the display method in any of the above embodiments are implemented.

[0294] In the embodiments of the smart terminal and computer-readable storage medium provided in the present application, all technical features of any of the above-mentioned display method embodiments may be included, and the expanded and explained contents of the specification are basically the same as those of the embodiments of the above-mentioned methods, and will not be repeated here.

[0295] The embodiment of the present application further provides a computer program product, which includes a computer program code. When the computer program code runs on a computer, the computer executes the methods in the above various possible implementation modes.

[0296] An embodiment of the present application also provides a chip, including a memory and a processor, the memory is used to store a computer program, and the processor is used to call and run the computer program from the memory, so that a device equipped with the chip executes the methods in various possible implementation modes as described above.

[0297] It is understood that the above scenarios are only examples and do not constitute a limitation on the application scenarios of the technical solutions provided in the embodiments of the present application. The technical solutions of the present application can also be applied to other scenarios. For example, it is known to those skilled in the art that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0298] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0299] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0300] The units in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0301] In the present application, the same or similar terminology concepts, technical solutions and / or application scenario descriptions are generally described in detail only the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of the present application, for the same or similar terminology concepts, technical solutions and / or application scenario descriptions that are not described in detail later, reference can be made to the previous related detailed descriptions.

[0302] In the present application, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0303] The various technical features of the technical solution of the present application can be arbitrarily combined. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of the present application.

[0304] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as above, and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, a controlled terminal, or a network device, etc.) to execute the method of each embodiment of the present application.

[0305] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing computer program instructions on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server, a data center, etc. that contains one or more available media integrated. The available medium can be a magnetic medium, (e.g., a floppy disk, a storage disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state storage disk Solid State Disk (SSD)), etc.

[0306] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A display method, characterized in that: The method comprises: S10: determining or generating image data in response to a first operation; S20: Identify the image data to obtain a first application icon and location information of the first application icon; S30: Determine or generate a first interface based on the first application icon and the position information of the first application icon, and display the first interface on a display screen.

2. The method according to claim 1, characterized in that The S30 includes: determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen; In response to the second operation, collecting location information of the target application icon; A first interface is determined or generated based on the location information of the target application icon and the preview interface, and the first interface is displayed on the display screen.

3. The method according to claim 2, characterized in that The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes: Acquire at least one second application icon in the smart terminal; When there is at least one third application icon in the first application icons and the third application icon is not located in the second application icons, determining a data packet attribute of each of the third application icons; When the data package attributes of each of the third application icons indicate that they are installation application icons, respectively downloading the installation data packages corresponding to each of the third application icons, so that the smart terminal includes each of the first application icons; A first preview interface is determined or generated based on the first application icon and the position information of the first application icon, and the first preview interface is displayed on the display screen.

4. The method according to claim 3, characterized in that After determining the data packet attributes of each of the third application icons, the method further includes: When there is at least one fourth application icon among the third application icons and the data packet attributes of the fourth application icons all indicate that they are non-installed application icons, a second preview interface is determined or generated based on at least one fifth application icon and the position information of the fifth application icon, and the second preview interface is displayed on the display screen.

5. The method according to claim 2, characterized in that: The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes: Acquire at least one second application icon in the smart terminal; When there is at least one sixth application icon in the second application icons and each of the sixth application icons is not located in the first application icons, determining or generating a first page based on the first application icons and the position information of the first application icons; A second page is determined or generated based on the position information of the sixth application icon, and the first page or the second page is displayed on the display screen.

6. The method according to claim 2, characterized in that The image data includes at least two folder windows and / or at least one eighth application icon, and the S20 includes: Recognize the image data to obtain at least one seventh application icon in the folder window, location information of the seventh application icon, location information of the folder window, the eighth application icon, and location information of the eighth application icon; The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes: creating at least one folder based on at least one seventh application icon in each of the folder windows and the position information of the seventh application icon; Based on the folder, the location information of the folder window, the eighth application icon and the location information of the eighth application icon, a third preview interface is determined or generated, and the third preview interface is displayed on the display screen.

7. The method according to claim 2, characterized in that The image data includes a folder window, and the S20 includes: Recognize the image data to obtain the first application icon in the folder window and the position information of the first application icon; The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes: A fourth preview interface is determined or generated based on the first application icon in the folder window and the position information of the first application icon, and the fourth preview interface is displayed on the display screen.

8. The method according to claim 2, characterized in that: The image data includes video data, the preview interface includes a plurality of third pages, and S20 includes: determining at least one target image data in the video data; Respectively identifying each of the target image data, and determining the first application icon in each of the target image data and the position information of the first application icon; The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes: Determine or generate the third page in sequence according to the order of each target image data in the video data and based on the first application icon in each target image data and the position information of the first application icon; Determine or generate a fifth preview interface based on each of the third pages, and display the fifth preview interface on the display screen; and / or, The image data includes at least one non-continuous image data, the preview interface includes at least one fourth page, and S20 includes: Respectively identify each of the image data, and determine the first application icon in each of the image data and the position information of the first application icon; The determining or generating a preview interface based on the first application icon and the position information of the first application icon, and displaying the preview interface on the display screen includes: determining or generating the fourth page in sequence according to the first operation time sequence of each of the image data and based on the first application icon in each of the image data and the position information of the first application icon; A sixth preview interface is determined or generated based on each of the fourth pages, and the sixth preview interface is displayed on the display screen.

9. An intelligent terminal, characterized in that: The intelligent terminal comprises: a memory and a processor, wherein a display program is stored in the memory, and when the display program is executed by the processor, the steps of the display method according to any one of claims 1 to 8 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the display method according to any one of claims 1 to 8 are implemented.

Images