Display method and electronic equipment

Abstract

The embodiment of the invention provides a display method and electronic equipment, and relates to the technical field of electronic equipment. The method can improve the efficiency in the process that the user uses the image to generate the corresponding function of the video. The method comprises the following steps: receiving a first operation, wherein the first operation is used for indicating the electronic equipment to display an interface of a first function; the first function corresponds to generating a video file from the image. And displaying the first interface. Wherein the first interface corresponds to the first function, and the first interface comprises at least two scene cards. The first scene card is displayed before the second scene card. The number of available display columns of the first scene card is greater than that of available display columns of the second scene card. Each available display column corresponds to a video file which can be sliced.

Description

Technical Field

[0001] Embodiments of the present application relate to the technical field of electronic devices, and particularly to a display method and an electronic device. Background Art

[0002] Currently, an electronic device can, under the instruction of a user, automatically generate a video file according to existing images.

[0003] Generally, when images are already stored in an electronic device, since the distribution of the images in the gallery is relatively scattered, the user needs to spend a great deal of effort to screen and obtain the required images. Subsequently, the process of instructing the electronic device to generate a video based on the screened and obtained images is also rather cumbersome. Summary of the Invention

[0004] The present application provides a display method and an electronic device, which can improve the efficiency of the user in the process of using the function of generating a video from images.

[0005] To achieve the above technical objectives, the present application adopts the following technical solutions:

[0006] In a first aspect, a display method is provided, which is applied to an electronic device configured with a display screen. The method includes: receiving a first operation, where the first operation is used to instruct the electronic device to display an interface of a first function. The first function corresponds to generating a video file according to an image. Displaying a first interface. Wherein, the first interface corresponds to the first function, and the first interface includes at least two scene cards, and each scene card is correspondingly displayed with a background picture, a card theme, and a prompt statement. In the first interface, a first scene card is displayed before a second scene card. The first scene card and the second scene card are included in the at least two scene cards. The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card. Each available display column corresponds to a video file that can be formed into a finished product, or the display priority of the first scene card pre-configured in the electronic device is higher than the display priority of the second scene card.

[0007] In this way, the electronic device can display the scene cards in order according to the number of videos that can be generated. Thus, the scene card that can generate more videos can be displayed in a more forward position, so as to facilitate the user to use the function of converting images to videos. Correspondingly, when the relevant information on the number of videos that can be generated in each scene card cannot be obtained, the scene cards can be displayed according to the default priority.

[0008] Optionally, the number of available display columns of the first scenario card is greater than that of the second scenario card. Before displaying the first interface, the method further includes: determining a first number of available display columns of the first scenario card and a second number of available display columns of the second scenario card.

[0009] Optionally, at least one image is stored in the electronic device. Before determining the first number and the second number, the method further includes: determining attribute information of each image, where the attribute information includes information of at least one of the following dimensions: person attribute, location attribute, time attribute, event attribute. According to the attribute information of the image, at least one label is marked for the image, and the label of the image corresponds to the attribute information of the image. For each rule in each scenario card, an available image set matching the rule is determined. Each scenario is configured with at least one rule, and each rule is configured with at least one label. In this application, this processing process may also be referred to as CV analysis. Based on this, the electronic device can determine the number of videos that can be generated for each scenario card.

[0010] Optionally, determining the first number includes: determining that the number of available rules included in the first scenario card is the first number. The available rules included in the first scenario card are the rules in all the rules corresponding to the first scenario card for which the available image set is not empty.

[0011] Optionally, determining the second number includes: determining that the number of available rules included in the second scenario card is the second number. The available rules included in the second scenario card are the rules in all the rules corresponding to the second scenario card for which the available image set is not empty.

[0012] Optionally, the first number is not 0. The prompt statement of the first scenario card is the same as the name of the first display column. The first display column corresponds to a first rule, and the first rule is the rule with the largest number of corresponding available images among all the available rules of the first scenario card.

[0013] Optionally, the background image of the first scenario card is a preset image. Exemplarily, the background image displayed in the scenario card can be a preset image.

[0014] Optionally, the first interface further includes a third scenario card. The method further includes: receiving a second operation, where the second operation is an operation on the third scenario card, and the second operation is used to instruct the electronic device to display the details of the third scenario card. Displaying a second interface. Wherein, the second interface includes at least one display column, and each display column corresponds to a rule configured for the third scenario card.

[0015] Thus, in combination with the relevant interaction examples for the pair of third-scenario cards, the relevant display and interaction implementation of each display column inside the scenario card are further provided.

[0016] Optionally, at least one display column included in the second interface includes a second display column and a third display column. The second display column is displayed before the third display column. The number of available images corresponding to the rule of the second display column is greater than the number of available images corresponding to the rule of the third display column. In this way, the electronic device can display each display column in sequence according to the number of available images corresponding to the display column.

[0017] Optionally, before displaying the second interface, the method further includes: determining the name of the second display column according to the label of the available image of the second display column. In this example, the electronic device can also generate the name of the display column according to at least one label of the available image corresponding to each display column and a preset statement style. The name of the display column can also be used to replace the prompt statement displayed on the scenario card.

[0018] Optionally, the second interface includes a fourth display column. The fourth display column is the display column of the pre-configured third-scenario card. In this way, when the available images of each rule cannot be obtained, or the available images of each rule are all empty, the electronic device can display the display columns according to a preset display mechanism.

[0019] Optionally, before displaying the second interface, the method further includes: determining that the available set of images of each rule in the third-scenario card is empty.

[0020] Optionally, the image displayed in the fourth display column is the same as the background image displayed in the third-scenario card.

[0021] Optionally, the method further includes: receiving a third operation, where the third operation is an operation on the fourth display column. In response to the third operation, a third interface is displayed. The third interface includes a fifth display column. The set of available images corresponding to the rule of the fifth prompt column is not empty. Thus, when the display column clicked by the user cannot form a complete piece, the electronic device can display the fifth display column to show the user other display columns that can form a complete piece for selection.

[0022] Optionally, the method further includes: receiving a third operation, which is an operation on the fourth display column. In response to the third operation, a fourth interface is displayed. The fourth interface includes first prompt information for prompting the user to capture an image. Before receiving the third operation, it is determined that the available image sets of the rules of the scene are all empty. Thus, the electronic device can, through the first prompt information, prompt the user to capture more images so as to implement sorting and display of scenes and display columns according to the above solution.

[0023] Optionally, the display priority of the first scene card pre-configured in the electronic device is higher than that of the second scene card. After displaying the first interface, the method further includes: receiving a fourth operation, which is an operation on a fourth scene card, and the fourth operation is used to instruct the electronic device to display the details of the fourth scene card. The fourth scene card is displayed in the first interface. In response to the fourth operation, a fifth interface is displayed. The fifth interface includes a sixth display column. The sixth display column is the display column of the fourth scene card pre-configured. This solution provides a display logic in the case where CV analysis has not been performed. For example, scene pictures are displayed in a preset order. Another example is that after the user clicks on a scene picture, the electronic device can display a preset display column on the interface.

[0024] Optionally, the method further includes: receiving a fifth operation, which is an operation on the sixth display column. In response to the fifth operation, second prompt information is displayed, and the second prompt information is used to prompt the user to trigger intelligent image recognition processing. The intelligent image recognition processing includes: determining the attribute information of each image, where the attribute information includes at least one dimension of information among the following: character attribute, location attribute, time attribute, event attribute. According to the attribute information of the image, at least one label is marked for the image, and the label of the image corresponds to the attribute information of the image. For each rule in each scene card, an available image set matching the rule is determined. Each scene is configured with at least one rule, and each rule is configured with at least one label. Thus, an entry for triggering CV analysis is provided to the user, such as the second prompt information. In some other implementations, the second prompt information may also include components such as function buttons.

[0025] Optionally, the first interface further includes a fifth scene card. The fifth display card is displayed before the first scene card. Before displaying the first interface, the method further includes: receiving a first push message, where the first push message includes the background picture, card theme, and prompt statement of the fifth scene card. This example provides a display logic for the electronic device to receive a scene card pushed by a cloud server before displaying scene pictures. For example, the scene card pushed by the cloud server can be displayed at the top.

[0026] Optionally, after displaying the first interface, the method further includes: receiving a sixth operation for instructing the electronic device to display details of the fifth scene card. In response to the sixth operation, a sixth interface is displayed, and the sixth interface includes a seventh display column pre-configured for the fifth scene card. Receiving a seventh operation, where the seventh operation is an operation on the seventh display column. In response to the seventh operation, at least one image corresponding to the seventh display column is obtained. Displaying a seventh interface, where the seventh interface includes an image corresponding to the seventh display column. In the case where the user clicks on a scene card pushed by the cloud server, the electronic device can obtain the display column corresponding to the card and the image information corresponding to the display column from the cloud server. This enables the user to quickly obtain popular scene cards and images on the network.

[0027] In a second aspect, the present application further provides an electronic device, which includes: a display screen, a memory, and one or more processors. The display screen, the memory, and the processor are coupled. Among them, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device executes the technical solutions provided in the first aspect and any one of its possible implementations above. For example, the electronic device controls the display screen to display the interface provided in the first aspect and any one of its possible designs above.

[0028] In a third aspect, the present application further provides a chip system, which is applied to an electronic device; the chip system may include one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected by a line. The interface circuit is used to receive a signal from the memory of the electronic device and send the signal to the processor, and the signal includes the computer instructions stored in the memory. When the processor executes the above computer instructions, the electronic device executes the technical solutions provided in the first aspect and any one of its possible implementations above.

[0029] In a fourth aspect, the present application further provides a computer-readable storage medium, including computer instructions. When the computer instructions run on an electronic device, the electronic device executes the technical solutions provided in the first aspect and any one of its possible implementations above.

[0030] In a fifth aspect, the present application further provides a computer program product. When the computer program product runs on a computer, the computer executes the technical solutions provided in the first aspect and any one of its possible implementations above.

[0031] It can be understood that the solutions provided in the second to fifth aspects of the present application can respectively correspond to the first aspect and any one of its possible designs, so the beneficial effects that can be achieved are similar and will not be elaborated here. Description of the Drawings

[0032] Figure 1 Schematic diagram of the interface display provided by the embodiment of the present application;

[0033] Figure 2 Schematic diagram of the composition of an electronic device provided by the embodiment of the present application;

[0034] Figure 3 Schematic diagram of the composition of an electronic device provided by the embodiment of the present application;

[0035] Figure 4 Schematic diagram of the composition of a scene card provided by the embodiment of the present application;

[0036] Figure 5 Schematic diagram of a scene card provided by the embodiment of the present application;

[0037] Figure 6 Schematic diagram of the logic of an interface interaction provided by the embodiment of the present application;

[0038] Figure 7 Schematic diagram of the logic of an interface interaction provided by the embodiment of the present application;

[0039] Figure 8 Schematic diagram of the logic of an interface interaction provided by the embodiment of the present application;

[0040] Figure 9 Schematic diagram of the logic of an interface provided by the embodiment of the present application;

[0041] Figure 10 Schematic diagram of the logic of an interface interaction provided by the embodiment of the present application;

[0042] Figure 11 Schematic diagram of the logic of an interface interaction provided by the embodiment of the present application;

[0043] Figure 12 Schematic diagram of the logic of the interaction between the electronic device and the cloud provided by the embodiment of the present application;

[0044] Figure 13 Schematic diagram of the logic of an interface interaction provided by the embodiment of the present application;

[0045] Figure 14 Schematic diagram of the composition of an electronic device provided by the embodiment of the present application;

[0046] Figure 15 Schematic diagram of the composition of a chip system provided by the embodiment of the present application. Detailed implementation manners

[0047] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of such features. In the description of this embodiment, unless otherwise specified, the meaning of "a plurality" is two or more.

[0048] Currently, the shooting function has become one of the functions with a relatively high usage frequency in electronic devices.

[0049] Users can use the electronic device to take images. Correspondingly, the electronic device can store the captured images in the memory.

[0050] In this application, the electronic device can also process the stored images to provide users with a more rich and intelligent experience. Among them, the stored images can include photos captured by the electronic device and / or images obtained in other forms. For example, images obtained in other forms can include images obtained from the network, other electronic devices, and other applications.

[0051] In the following examples, it is taken as an example that the images stored in the electronic device include photos captured by shooting.

[0052] Exemplarily, in some embodiments of this application, the processing of the stored images can be implemented based on the CV processing capabilities configured in the electronic device. CV processing can also be referred to as CV analysis.

[0053] In this example, the electronic device can perform CV processing such as recognition, classification, and learning on the captured and stored photo images through the CV processing capabilities. This CV processing capability can also be referred to as the intelligent image recognition capability.

[0054] In some other embodiments, the electronic device can also generate corresponding video files based on these captured and stored images through CV processing.

[0055] In some other embodiments, the electronic device can also be configured with an application or software module capable of invoking the CV processing capabilities. For example, in some implementations, the electronic device can invoke the CV processing capabilities through the gallery application configured therein to implement the operations related to the above CV processing. In some other implementations, the electronic device can invoke the CV processing capabilities through a software module (such as a middleware module) configured therein. Among them, the configuration of the middleware module in the electronic device can be in the form of a system application or in the form of a software module configured in the framework layer.

[0056] In addition, other application programs (such as intelligent assistant applications) can also be configured in the electronic device. Based on the results obtained from the above CV processing and the pre-configured interaction logic, different interfaces are presented to the user on the display screen of the electronic device according to the results of the CV processing and the operations input by the user.

[0057] Take the example where the user instructs the electronic device to generate a video file based on existing images.

[0058] Based on the results of the above CV processing, the electronic device determines which video files can be generated from the current existing images. The electronic device can also configure corresponding display priorities for each video file according to a pre-configured rule file. Thus, the higher the display priority, the more forward the display column position of the corresponding video file on the display screen.

[0059] In addition, the electronic device can also map different video files to scene cards. Each scene card can correspondingly include one or more generable video files. In this way, the electronic device can also present multiple scene cards to the user on the display screen according to the results of the CV processing. This enables the user to quickly browse and identify the types of videos they want to generate through the scene cards. In some implementations, the electronic device can also configure corresponding display priorities for each scene card according to pre-configured rules. Thus, the higher the display priority, the more forward the position of the card on the interface.

[0060] In addition, in this application, the electronic device can also be configured with a display logic when there are no generable video files.

[0061] It should be noted that in the embodiments of this application, the scene cards or thumbnails in each interface can correspondingly display corresponding pictures. In the following description, the pictures are replaced with text forms for example. For example, the pictures preset in the electronic device or obtained from the cloud can be replaced with forms such as "image" + "number" like image 1. Another example is that the pictures in the gallery application of the electronic device can be replaced with forms such as "image" + "letter" like image a.

[0062] As an example, refer to Figure 1 , which are examples of two interfaces provided for the embodiments of this application.

[0063] Such as Figure 1As shown in interface 11, multiple scene cards can be displayed to the user on this interface. For example, the multiple scene cards can include cards corresponding to different scenes such as "Daily Vlog", "Personal Portrait", "Family Photo", "Cute Pet", "Travel Vlog", "Growth Theme", etc. Before displaying these scene cards, the electronic device can, according to the solution provided in the embodiments of this application, configure corresponding display priorities for different scene cards. It can be understood that the determination of this display priority is related to the images of the currently generable video files. Therefore, this display priority can better match the current usage habits of the user. Thus, based on the display priority, interface 11 can enable the user to more easily discover the scenes for which they want to generate videos on the interface.

[0064] As Figure 1 shown in interface 12, in this application, the electronic device can also display to the user the display columns of the generable video files in any scene. In Figure 1 the example, it is assumed that the maximum number of display columns of the generable video files displayed on the display screen is 3. The display of these display columns can also be achieved after the electronic device performs CV processing and sorts the various video files according to the CV processing results. In this way, the user can more conveniently determine the currently generable video files on this interface 12. And since the display order of each display column can correspond to the currently existing images, the display columns in the more forward positions can better fit the user's habits, further improving the usage convenience in the scenario of generating videos based on images.

[0065] The following will, in conjunction with the accompanying drawings, elaborate on the acquisition mechanism, display mechanism, and the interaction logic between each interface (such as interface 11, interface 12, etc. shown above) in the solution provided by the embodiments of this application. Figure 1 shown in the interface 11, interface 12, etc.)

[0066] It should be noted that in the embodiments of this application, the electronic device can include at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, a vehicle-mounted device, a smart home device, or a smart city device.

[0067] The embodiments of this application do not impose special restrictions on the specific type of this electronic device.

[0068] In some embodiments, the electronic device may include a processor, an external memory interface, an internal memory, a universal serial bus (USB) connector, a charging management module, a power management module, a battery, Antenna 1, Antenna 2, a mobile communication module, a wireless communication module, an audio module, a speaker, a receiver, a microphone, a headphone interface, a sensor module, keys, a motor, an indicator, a camera module, a display screen, and a subscriber identification module (SIM) card interface, etc. Among them, the sensor module may include a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0069] In this example, the processor may include one or more processing units. For example, the processor may include an application processor (AP), a modem processor (Modem), a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor (BP or BBP), and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.

[0070] The processor can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.

[0071] A memory may also be provided in the processor for storing instructions and data. In some embodiments, the memory in the processor may be a cache memory. This memory can save the instructions or data used by the processor or with a high usage frequency. If the processor needs to use this instruction or data, it can directly call it from this memory. This avoids repeated accesses, reduces the waiting time of the processor, and thus improves the efficiency of the system.

[0072] It should be noted that the structures illustrated in the above embodiments do not constitute specific limitations on the electronic device. In some other embodiments of the present application, the electronic device may include more or fewer components, or combine certain components, or split certain components, or have different component arrangements. Any component in the above embodiments may be implemented in hardware, software, or a combination of software and hardware.

[0073] Exemplarily, a touch panel (TP) may also be configured in the electronic device. The touch panel can be used to receive touch operations from users. For example, the touch operations may include operations such as swiping and clicking. In some implementations, the touch panel may be coupled to the display screen. Thus, the user can input touch operations based on the interface image displayed on the display screen. Correspondingly, the touch panel can generate corresponding operation information according to the touch operation, and the operation information may include position information, type information, etc. of the received touch operation. Thus, the electronic device can perform corresponding responses in combination with the current display image and the operation information.

[0074] It should be noted that the above example provides an example of the hardware composition in the electronic device. In the embodiments of the present application, a software composition of the electronic device is also provided.

[0075] Exemplarily, refer to Figure 2 , which is a schematic diagram of the software composition of an electronic device provided in the embodiments of the present application.

[0076] In the present application, the electronic device may have a layered architecture. This layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the system is divided into five layers, from top to bottom are the application layer, the application framework layer, Android runtime (ART) and native C / C++ libraries, the Hardware Abstract Layer (HAL), and the kernel layer.

[0077] The application layer may also be referred to as the application layer or the APP layer. The application layer may include a series of application packages.

[0078] As Figure 2 shown, the application packages may include applications such as a gallery, a calendar, a map, WLAN, music, text messages, calls, navigation, Bluetooth, and video. As Figure 2 shown, in the present application, the application packages in the electronic device may also include a smart assistant application.

[0079] In the present application, the electronic device can realize the interaction and display logic between various interfaces by running the smart assistant application. Details will be described later.

[0080] The application framework layer can also be called the framework layer or the Framework layer. This framework layer can provide application programming interfaces (APIs) and programming frameworks for the application programs in the application layer. The framework layer includes some predefined functions.

[0081] Such as Figure 2 shown, the framework layer can include a window manager, a content provider, a view system, a resource manager, a notification manager, an activity manager, an input manager, a middle platform module, etc.

[0082] The window manager provides the Window Manager Service (WMS). The WMS can be used for window management, window animation management, surface management, and as a transfer station for the input system.

[0083] The content provider is used to store and obtain data, and make this data accessible to application programs. This data can include videos, images, audio, dialed and received calls, browsing history and bookmarks, phone books, etc.

[0084] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build application programs. The display interface can be composed of one or more views. For example, a display interface including a text message notification icon can include a view for displaying text and a view for displaying pictures.

[0085] The resource manager provides various resources for application programs, such as localized strings, icons, pictures, layout files, video files, and so on.

[0086] The notification manager enables application programs to display notification information in the status bar. It can be used to convey notification-type messages, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that the download is completed, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as the notification of a background-running application program, and can also be a notification that appears on the screen in the form of a dialogue window. For example, it prompts text information in the status bar, emits a prompt tone, the electronic device vibrates, the indicator light flashes, etc.

[0087] The activity manager can provide the Activity Manager Service (AMS). The AMS can be used for the startup, switching, scheduling of system components (such as activities, services, content providers, broadcast receivers), and the management and scheduling of application processes.

[0088] The Input Manager can provide the Input Manager Service (IMS), which can be used to manage the inputs of the system, such as touch screen input, button input, sensor input, etc. The IMS retrieves events from the input device nodes and, through interaction with the WMS, distributes the events to the appropriate windows.

[0089] The middleware module configured in the framework layer can be used to support the CV processing capabilities involved in the above embodiments.

[0090] The Android Runtime includes the core libraries and the Android Runtime. The Android Runtime is responsible for converting the source code into machine code. The Android Runtime mainly includes the Ahead of Time (AOT) compilation technology and the Just in Time (JIT) compilation technology.

[0091] The core libraries are mainly used to provide the functions of the basic Java class libraries, such as libraries for basic data structures, mathematics, IO, tools, databases, networks, etc. The core libraries provide APIs for users to develop Android applications.

[0092] The native C / C++ libraries can include multiple functional modules. For example: surface manager, Media Framework, libc, OpenGL ES, SQLite, Webkit, etc.

[0093] Among them, the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The Media Framework supports the playback and recording of various common audio and video formats, as well as static image files, etc. The media libraries can support multiple audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. OpenGL ES provides the drawing and operation of 2D and 3D graphics in applications. SQLite provides a lightweight relational database for the applications of electronic devices.

[0094] The Hardware Abstraction Layer runs in the user space, encapsulates the kernel layer drivers, and provides call interfaces to the upper layer. Exemplarily, the Hardware Abstraction Layer can include a display module, an audio module, a camera module, a Bluetooth module, etc.

[0095] The kernel layer is the layer between the hardware and the software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a Bluetooth driver.

[0096] It should be noted that, as Figure 2 shown, the software composition is only an example and does not constitute a limitation to the electronic device in the embodiments of the present application.

[0097] In some other embodiments, the electronic device may also have other components.

[0098] Exemplarily, referring to Figure 3 , it is a schematic diagram of the composition of another electronic device provided by an embodiment of the present application.

[0099] In the example such as Figure 3 , the software layer (such as the application layer and the framework layer) in the electronic device is shown, and the hardware configuration (such as the hardware layer) in the electronic device is also shown. Thus, through the cooperation of the software layer and the hardware layer as shown in Figure 3 , the solution provided by the embodiment of the present application is implemented.

[0100] As shown in Figure 3 , the application layer may include a smart assistant application, a gallery application, etc.

[0101] A middle platform module may be configured in the framework layer.

[0102] The hardware layer may include a memory and a display and touch control module. Among them, the memory can be used to provide storage capacity. In the present application, in the case where the user has taken a photo through the electronic device, images P1, P2, etc. maintained by the gallery application can be stored in the memory. The display and touch control module may be composed of a display screen, a touchpad, and their respective corresponding driving modules. In this way, the display and touch control module can be used to receive the touch operation of the user, and the operation information is transmitted upward to the application layer through the corresponding driving module of the touchpad, and is responded to by the corresponding application program. The display and touch control module can also display according to the image to be displayed from the upper layer when the application program instructs the electronic device to perform image display. For example, display interface 11 or interface 12 as shown in Figure 1 .

[0103] In the embodiment of the present application, the images maintained by the gallery application can also be referred to as the images in the gallery application, or the images in the gallery, or the images stored in the gallery.

[0104] The solution provided by the embodiment of the present application can be applied to the electronic device as shown in Figure 2 or Figure 3 .

[0105] Taking the composition of the electronic device as shown in Figure 3 as an example, the process of performing CV analysis on the electronic device is illustrated.

[0106] Exemplarily, in some embodiments, the CV analysis can be performed by the middle platform module in cooperation with the gallery application. In some other embodiments, the triggering and / or execution process of the CV analysis can also involve the smart assistant.

[0107] In this application, the trigger of CV analysis will be described in detail in subsequent interface interactions. Here, a brief introduction to the execution process of CV analysis is provided.

[0108] When the electronic device performs CV analysis, the middleware module can obtain all current images from the image library. Correspondingly, the image library can send the storage addresses of images such as image P1 and image P2 stored in the memory to the middleware module. Thus, the middleware module can obtain each image from the storage address.

[0109] In this application, CV analysis can include processes such as image analysis, label configuration, display column name generation, and display priority determination.

[0110] Exemplarily, the middleware module can perform image analysis on each of the multiple images. Thus, the attribute information of each image can be obtained.

[0111] In this application, the attribute information of an image can include information of at least one dimension among the following four dimensions:

[0112] Person attribute, location attribute, time attribute, event attribute.

[0113] Corresponding to each attribute information, the middleware module can perform corresponding label configuration on the image. For example, through image analysis, when an image includes one or more specific attributes in the person attribute, the middleware module can configure a label of the corresponding attribute for the image.

[0114] Taking the person attribute as an example.

[0115] In some embodiments, the person attribute can include individual person attribute, collective person attribute, and combined person attribute.

[0116] Among them, the individual person attribute can include: individual, oneself, lover, husband, wife, grandfather, grandmother, father, mother, etc.

[0117] In this way, through image analysis, when the image includes any one or more of the above individual person attributes, the middleware module can configure the corresponding person attribute for the image. For example, through image analysis, it is determined that the person attribute of "oneself" is included in image P1. Then, the middleware module can configure the label of "oneself" for the image P1.

[0118] The collective person attribute can include: child, son, daughter, family member, close friend, etc.

[0119] In this way, through image analysis, when the middle platform module detects any one or more of the above-mentioned general terms of person attributes in an image, it can configure the corresponding person attribute for the image. For example, through image analysis, it is determined that the person attribute of "child" is included in image P2. Then, the middle platform module can configure the label of "child" for this image P1.

[0120] The general terms of person attributes can include: a family, a family of three, etc.

[0121] In this way, through image analysis, when the middle platform module detects any one or more of the above-mentioned general terms of person attributes in an image, it can configure the corresponding person attribute for the image. For example, through image analysis, it is determined that the person attribute of "a family" is included in image P2. Then, the middle platform module can configure the label of "a family" for this image P1.

[0122] It can be understood that for the same image, the configured person attribute label can be one or multiple. For example, after image analysis of image P2, the labels of "child" and "a family" can be configured for image P2. When none of the above-mentioned person attributes are included in the image, the middle platform module may not configure a person label for the current image.

[0123] Taking the location attribute as an example.

[0124] In some embodiments, the location attribute may include specific attributes, general attributes, etc.

[0125] Among them, the specific attributes may include: hometown, local area, etc.

[0126] In this way, through image analysis, when the middle platform module detects any one or more of the above-mentioned specific attributes in an image, it can configure the corresponding location attribute for the image. For example, through image analysis, it is determined that the specific attribute of "hometown" is included in image P1. Then, the middle platform module can configure the label of "hometown" for this image P1.

[0127] The general attributes may include: Locality, city, etc.

[0128] Among them, Locality corresponds to the clustering result of a pre-configured multiple regions. For example, Locality may include: Region L1, Region L2, Region L3, etc. City corresponds to the clustering result of a pre-configured multiple cities. For example, the region may include: City C1, City C2, etc.

[0129] In this way, through image analysis, when the middle platform module detects any one or more of the above-mentioned general attributes in an image, it can configure the corresponding location attribute for the image. For example, through image analysis, it is determined that the location attribute of "City C1" is included in image P2. Then, the middle platform module can configure the label of "City C1" for this image P2.

[0130] Similar to the configuration of person tags, for the same image, one or more location tags can be configured according to the specific image analysis results. Or when the current image does not correspond to any of the above location attributes, no location attribute tags are configured for the image.

[0131] Taking the time attribute as an example.

[0132] In some embodiments, the person attributes may include attributes such as relative time periods, important festivals, birthdays / anniversaries, etc.

[0133] Among them, the relative time period attribute may include: today, yesterday, weekend, last week, this year, the last three years, spring, summer, autumn, winter, etc.

[0134] In this way, through image analysis, when the shooting time of the image corresponds to any one or more of the above time attributes, the middleware module can configure the corresponding time attribute tags for the image. For example, through image analysis, it is determined that image P1 was taken yesterday afternoon. Then, the middleware module can configure the tags of "yesterday", "this year", and "the last three years" for the image P1.

[0135] The important festival attribute may include the time periods during which festivals such as New Year's Day, New Year's Eve, Spring Festival, etc. are located. It can be understood that when the user's current location is different, the time periods included in the corresponding important festival attributes can change accordingly.

[0136] In this way, through image analysis, when the shooting time of the image corresponds to any one or more of the above important festival attributes, the middleware module can configure the corresponding time attribute tags for the image. For example, through image analysis, it is determined that image P2 was taken during the Spring Festival. Then, the middleware module can configure the tag of "Spring Festival" for the image P1.

[0137] The birthday / anniversary attribute can correspond to a specific date that has been configured. This birthday / anniversary attribute may include the absolute time point of the validity period. For example, wedding anniversary, graduation anniversary, birthday, etc.

[0138] In this way, through image analysis, when the shooting time of the image corresponds to any one or more of the above birthday / anniversary attributes, the middleware module can configure the corresponding time attribute tags for the image. For example, through image analysis, it is determined that image P1 was taken on the graduation anniversary. Then, the middleware module can configure the tag of "graduation anniversary" for the image P1.

[0139] In addition, event attributes can be pre-configured in the electronic device. For example, events such as going on a trip, going to the park, going for exercise, etc. In this way, during the image analysis process, if there are elements corresponding to the event in the image (such as the location of the park, the scenery of the park, etc., or if the image includes a running posture, a swimming scene, etc.), then the corresponding event label can be configured for the image.

[0140] In this way, through the CV analysis of all existing images, the middle platform module can configure the corresponding labels for each image. This label can correspond to the attribute information of the image.

[0141] In the embodiment of the present application, the middle platform module can also aggregate one or more images together based on the configured labels of the images according to the pre-configured rules to form an image set that matches the current rules.

[0142] Exemplarily, each of the pre-configured rules can correspond to at least one label. Each rule corresponds to a generable video scene.

[0143] Taking the rule R1 corresponding to labels 1, 2, and 3 as an example. In this way, the images configured with labels 1, 2, and 3 can be aggregated into image set 1. This image set 1 can correspond to the rule R1.

[0144] Thereby, the electronic device can generate a video file in the video scene corresponding to the rule R1 according to this image set 1.

[0145] As a specific example, the video scenes of the pre-configured rules can include: videos of children going on a trip, weekend trip videos, family gathering videos, team building dinner videos, this year's scenery collection, scenery collection of city C1, etc.

[0146] Thereby, the middle platform module can aggregate the images with the person attribute including "child" and the event attribute including "going on a trip" to obtain the image set corresponding to the rule of "video of children going on a trip". Others are similar and will not be elaborated.

[0147] In this way, the middle platform module can obtain the image sets corresponding to each configured rule based on the currently stored images.

[0148] It can be understood that since this image set is obtained based on the matching of the labels of each image and the rules, in some embodiments, the number of corresponding images in the image sets corresponding to different rules can be different. In other embodiments, there may also be a situation where there is no matching image set for some or all rules.

[0149] In this application, after the middleware module obtains the image sets corresponding to each rule, it can also perform filling according to the pre-configured statement style and in combination with the tags of the images in the image set to obtain the display column name corresponding to the rule when it is displayed on the display screen.

[0150] Exemplarily, taking the rule in the video scenario of a child's outing as an example. The pre-configured statement style can be: "Generate" + character attribute + event attribute + "video". Thus, the middleware module can fill the character attribute of "child" and the event attribute of "outing" configured in the current image set into this statement style to obtain the display column name of "Generate a video of a child's outing".

[0151] Similarly, the middleware module can generate corresponding column names for the rules of all non-empty image sets (i.e., including available images) currently.

[0152] In addition, in this application, in the middleware module, the display priorities corresponding to each rule can also be configured.

[0153] Combined with Figure 1 the description in

[0154] In some embodiments of this application, the display priorities corresponding to each rule can be the display priorities of the rules in the same scene card.

[0155] Taking the rules configured in scene card 1 including rule 1, rule 2, rule 3, rule 4, rule 5, rule 6, etc.; and the display priorities of rule 1 to rule 6 decreasing in turn as an example.

[0156] For rule 1 to rule 6, for multiple rules including available images, according to the above display priority, determine N rules that need to be displayed at the top on the interface. For example, N can be configured to 3.

[0157] Taking rule 2, rule 3, rule 4, and rule 5 including available images, and rule 1 and rule 6 not including available images as an example.

[0158] In this way, the middleware module can determine that when the user views the details of scene card 1 for the first time, the corresponding display columns are displayed in the order of rule 2, rule 3, and rule 4. The display column of rule 5 is not displayed this time.

[0159] In some other cases, if the number of rules including available images in the scenario card 1 is less than N, when the middleware module needs to display the details of the scenario card 1 to the user, it can display the display columns of all the rules including available images in sequence according to the display priority.

[0160] And so on, for other card scenarios, the middleware module can also adopt a similar mechanism to determine the display order of the display columns when the user needs to view the corresponding details.

[0161] It should be noted that the above description of the display order of the rule corresponding display columns for each card scenario is based on the example that each card scenario includes at least one rule including available images.

[0162] In some other cases, there are also situations where all the rules in some scenario cards do not include available images. The display mechanism in this case will be described later.

[0163] Thus, through the above implementation, the middleware module can determine the display mechanism of each display column on the interface when the user needs to view the details of any scenario card.

[0164] In some other embodiments of the present application, the middleware module can also determine the display order of each scenario card on the interface 11 based on the above processing mechanism.

[0165] Exemplarily, the middleware module can configure the scenario card with the largest number of rules including available images among all scenario cards as the scenario card with the highest display priority. Correspondingly, the lower the display priority, the smaller the number of rules including available images.

[0166] It can be understood that one rule including available images can correspond to a generable video file. In this way, the more rules including available images, the more video files that can be generated in this scenario card.

[0167] Thus, by displaying the scenario card that can generate more video files in a more prominent position, the user can more conveniently find the scenario card that can generate rich video files on the interface 11.

[0168] In the following description, the rule including available images will be referred to as an available rule. The display column corresponding to the available rule can be referred to as an available display column. That is to say, for any available display column, at least one image matching the rule of this display column is stored in the electronic device, and based on this, a video file corresponding to this display column can be generated.

[0169] In this way, through the above functional description of the middle platform module, in the embodiments of the present application, the middle platform module can cooperate with the gallery application to determine the display order of each scenario card, the display order of each display column in each scenario card, and the name of the display column.

[0170] In some embodiments of the present application, each scenario card can be pre-configured in the electronic device.

[0171] Exemplarily, referring to Figure 4 , an example of the display elements of the scenario card in the embodiments of the present application is provided.

[0172] Taking the scenario card named "Growth Theme" as an example. The display elements of this scenario card can include a background image, a card theme, and a prompt statement.

[0173] Among them, the background image (such as Image 6) and the card theme (such as "Growth Theme") can be pre-configured in the electronic device. The background image and the card theme can have a one-to-one correspondence. For different scenario cards, the displayed background card and card theme can be different.

[0174] In this example, due to the pre-configured characteristics of the background image and the card theme, when the images maintained in the gallery application are different (such as on different electronic devices), the background images corresponding to the same card theme can remain consistent.

[0175] In an example such as Figure 4 , the display of the prompt statement can include two cases:

[0176] When there are no available display columns in this scenario card, the prompt statement is displayed as a preset prompt statement corresponding to the current card theme.

[0177] When there are available display columns in this scenario card, the prompt statement is displayed as the name of the display column with the highest display priority among all display columns (that is, the name of the rule with the highest display priority).

[0178] For example, taking the scenario card of "Growth Theme" as shown in Figure 4 as an example.

[0179] When there are no available display columns in this scenario card, in the scenario card of the growth theme in Interface 11, the prompt statement can be displayed as the pre-configured "Create a Happy Growth Video".

[0180] In the case where the available display columns are included in the scene card, taking the name of the display column with the highest display priority as "Make a video of the child playing with the father" as an example. Then, in the scene card of the growth theme in Interface 11, the prompt statement can be correspondingly adjusted and displayed as "Make a video of the child playing with the father".

[0181] The display mechanism of other scene cards on Interface 11 is similar.

[0182] In some embodiments of the present application, multiple scene cards can be pre-configured in the electronic device.

[0183] Exemplarily, as Figure 5 shown, are examples of some scene cards. In this example, the scene card can include:

[0184] A scene card with a background image of Image 1, a card theme of: "Daily Vlog", and a pre-configured prompt statement of: "Record the little bits of daily life";

[0185] A scene card with a background image of Image 2, a card theme of: "Personal Photo", and a pre-configured prompt statement of: "Generate a collection video of personal photos";

[0186] A scene card with a background image of Image 3, a card theme of: "Family Group Photo", and a pre-configured prompt statement of: "Generate a family group photo video";

[0187] A scene card with a background image of Image 4, a card theme of: "Cute Pet", and a pre-configured prompt statement of: "Generate a video of the cute moments of the pet";

[0188] A scene card with a background image of Image 5, a card theme of: "Travel Vlog", and a pre-configured prompt statement of: "Generate a video of my travel experiences";

[0189] A scene card with a background image of Image 6, a card theme of: "Growth Theme", and a pre-configured prompt statement of: "Make a happy growth video";

[0190] A scene card with a background image of Image 7, a card theme of: "Daily Gathering", and a pre-configured prompt statement of: "Make a video of the happy gathering";

[0191] A scene card with a background image of Image 8, a card theme of: "Hobbies", and a pre-configured prompt statement of: "Make a video of my performance", etc.

[0192] In some implementations, 27 or more scene cards can be configured in the electronic device.

[0193] In this way, in combination with the above functional description of the middleware module, when the middleware module performs CV analysis, for each card theme of this configuration, for each rule in each card theme, the corresponding image set. The middleware module can also generate corresponding display column names for the available rules. The middleware module can also determine the display priorities of the available rules. The middleware module can also determine the display priorities of each card theme, as well as the prompt statements of each card theme.

[0194] It should be noted that in the embodiments of the present application, the middleware module to perform CV analysis can be triggered based on user input, or triggered based on pre-configured policies. For example, the pre-configured policies can include: the time is within a preset time period (such as between 0:00 and 2:00 in the early morning), and / or the electronic device is charging, and / or the electronic device has entered the sleep state for more than 30 minutes, and / or the preset duration has been reached since the last CV analysis, etc. In other embodiments, the processing ability of the CV analysis can also be implemented by other functional modules or applications. For example, the processing ability of the CV analysis can be integrated in the gallery application, or integrated in the intelligent assistant application, etc.

[0195] Based on the above functions performed by the middleware module, the electronic device can accurately display interfaces 11 and 12 as shown in Figure 1 shown.

[0196] In the following description, taking the intelligent assistant application in the electronic device as an example, after the user inputs the corresponding operation, it interacts with the middleware module and / or the gallery application to implement the display of each interface. The interaction and switching logic of each interface in the embodiments of the present application will be described in detail. Taking the electronic device as a mobile phone as an example.

[0197] In different embodiments of the present application, the intelligent assistant application can be triggered to run in different ways.

[0198] Exemplarily, refer to Figure 6 , which is a schematic diagram of the interface interaction logic provided for the embodiments of the present application. The following Figure 6 provides several examples of triggering the intelligent assistant to run.

[0199] In this example, taking the electronic device displaying the main interface (such as interface 61) as an example.

[0200] In some embodiments, the user can input a voice command to the electronic device. For example, the user can say to the electronic device: "Hello, intelligent assistant". In response to this voice command, the electronic device can run the intelligent assistant application and switch to display interface 62. In other implementations, the voice command can also be configured as other voice commands. For example, the voice command can include the name information of the intelligent assistant, etc.

[0201] As shown in interface 62, it is an example of an interface of the intelligent assistant application.

[0202] In this example, the intelligent assistant application can provide a variety of different simulation functions with the user. For example, the simulation interaction function can include a conversation function, a recommendation function, an intelligent video editing function, a knowledge Q&A function, etc.

[0203] Correspondingly, on interface 62, a function bar 601 can be included. Each of the above-mentioned simulation functions can have a corresponding function option in the function bar 601. When one of the function options is in an active state, it can be displayed with a different display effect from other non-active function options on the function bar 601. For example, in interface 62, the conversation function is in an active state, and the recommendation function, the intelligent video editing function, the knowledge Q&A function, etc. are in non-active states. In this way, the function option of the conversation function in the function bar 601 can be displayed with a display effect such as enlarged font, bold, etc. Thus, the user can clearly know the currently active function option through the display effect of the function bar 601.

[0204] Combined with the voice command input by the user, after the intelligent assistant application runs, it can execute the corresponding simulation conversation function on the interface 62 of the conversation function. For example, a conversation bar 602 is displayed on interface 62. In the conversation bar 602, the intelligent assistant can display the text information corresponding to the voice command input by the user. For example, "Hello! I am your intelligent assistant." is displayed in the conversation bar 602. Thus, in this conversation function, the intelligent assistant can provide the conversation function to the user through the display interaction form of the conversation bar.

[0205] It should be noted that in this application, after the intelligent assistant application runs, a characteristic icon corresponding to the intelligent assistant application can also be displayed on the corresponding interface 62. This enables the user to know that the current intelligent assistant is running.

[0206] For example, the characteristic icon corresponding to the intelligent assistant can be the icon 603 on interface 62. This icon 603 can be an interaction icon, and when the user inputs different operations, this icon 603 can be correspondingly displayed in different states. Taking the example that the user inputs a click operation to this icon 603, then the icon 603 can be correspondingly displayed in an expression state representing "listening", thus simulating the conversation state with the user. Correspondingly, the intelligent assistant can control the electronic device to be ready to receive the operation that the user will input, so as to make a corresponding response.

[0207] In the example such as Figure 6 Another example of the interaction for running the intelligent assistant application is also provided.

[0208] When the electronic device displays the interface 61, the user can input an operation to trigger the operation of the intelligent assistant application. This operation can be pre-configured. For example, this operation can be configured to press the shutdown button for 3 seconds, etc.

[0209] Correspondingly, the electronic device can switch to the display interface 63. On this interface 63, the electronic device can display the special icon 603 corresponding to the intelligent assistant application at the top layer above the interface 61 (such as at the top of the lower half of the display screen). The display of this icon 603 can indicate that the current intelligent assistant application has started to run.

[0210] There can also be a button 604 displayed on the icon 603. This button 604 is an interface display entry provided to the user. When the user wants to see the interface of the intelligent assistant application on the electronic device, they can input an operation on this button 604 to achieve the purpose.

[0211] For example, the user can input an operation OP2 on the button 604. This operation OP2 can be an operation of pressing and pulling up the button 604. Correspondingly, the electronic device can switch to the dialogue function interface shown in the display interface 62.

[0212] It should be noted that in an example such as Figure 6 the default display interface of the intelligent assistant application is taken as the dialogue function interface (such as interface 62) for illustration. In some other embodiments of the present application, after the intelligent assistant application runs and displays the corresponding interface, this interface can also be an interface corresponding to other function options.

[0213] After the intelligent assistant controls the electronic device to display the interface 62, the user can also indicate the electronic device to switch to display the interface of other function options through other operations on the interface.

[0214] Exemplarily, referring to Figure 7 take the example that the user instructs the electronic device to display the interface of the intelligent video editing function.

[0215] In some embodiments, on the interface 62, the user can input an operation OP3 to correspondingly indicate the electronic device to display the interface of the intelligent video editing function. For example, this operation OP3 can include a click operation on the "intelligent video editing" function option in the function bar 601.

[0216] In response to this operation OP3, the intelligent assistant can instruct the electronic device to switch to display the interface 71. This interface 71 can be the interface of the "intelligent video editing" function. Combining with the description in Figure 1 this interface 71 can also correspond to the interface 11 in Figure 1 .

[0217] In some other embodiments, on the interface 62 , the user may input an operation OP4 , which corresponds to instructing the electronic device to display an interface of other functions. For example, the operation OP4 may include a left swipe operation in the dialog bar 602 .

[0218] Combined with the example of the function bar 601 in the interface 62, the display order of each function option from left to right is dialogue, recommendation, smart film, and knowledge question and answer. Correspondingly, the user can input the operation OP4 according to the order of the function options. For example, when you want to view the interface of the function options to the right of the currently activated function option, you can input the left swipe operation in the current content interface (such as the dialogue bar 602 in the dialogue function).

[0219] In response to the operation OP4, the smart assistant may instruct the electronic device to display the interface of the function options to the right of the currently activated function options (such as the conversation function). For example, the smart assistant may instruct the electronic device to display interface 72. The interface 72 may be an interface corresponding to the recommended function.

[0220] In this application, the recommendation function of the smart assistant can provide users with recommendations of various different types of images / videos based on local / network resources.

[0221] For instance, in this example, the interface 72 of the recommendation function may include a recommendation card for “Store Exploration Video Script” (such as the background image of the recommendation card can be displayed as Image 9), a recommendation card for “Friendship Growth Novels” (such as the background image of the recommendation card can be displayed as Image 10), a recommendation card for “Past and Present” (such as the background image of the recommendation card can be displayed as Image 11), a recommendation card for “Daily Vlog” (such as the background image of the recommendation card can be displayed as Image 1), a recommendation card for “Baby’s Children’s Stories” (such as the background image of the recommendation card can be displayed as Image 12), a recommendation card for “Time Travel Science Fiction Novels” (such as the background image of the recommendation card can be displayed as Image 13), etc.

[0222] It is understandable that in some implementations, at least one recommendation card included in the interface 72 of the recommendation function may come from the capabilities provided by other functional options. For example, the recommendation card of "Daily Vlog" may be obtained by the capability of the smart filming function. In the interface 72, the recommendation card of "Daily Vlog" may be a card recommended based on local resources (such as images stored in the gallery). Based on the recommendation card of "Daily Vlog", the user may be provided with the capability entry of intelligently generating video files of the corresponding type.

[0223] It should be noted that in this application, when the intelligent assistant application is used on an interface that displays different function cards, the content interface will change because the content to be displayed is different. For example, in the interface 62 of the conversation function, the content interface may include a conversation bar 602 as shown in Figure 6 . Another example is that in the interface 72 of the recommendation function, the content interface may include a card display bar 701. The card display bar may include multiple recommendation cards. Another example is that in the interface 71 of the intelligent video editing function, the content interface may include a card display bar 702. The card display bar may include multiple scene cards.

[0224] On this interface 72, the user can also input an operation OP5 to instruct the electronic device to switch to display the interface of the intelligent video editing function. For example, the operation OP5 may include a left swipe operation input in the card display bar 701. It can be understood that similar to the relevant description of the operation OP4, in response to this operation OP5, the intelligent assistant application can instruct the electronic device to switch to display the interface of the intelligent video editing function on the right side of the recommendation function.

[0225] Thus, the user can instruct the electronic device to display the interface 71 of the intelligent video editing function through the operation OP4 and the operation OP5.

[0226] In the above examples, two interaction examples of displaying the interface of the intelligent video editing function after entering the interface of the intelligent assistant are provided. In other embodiments, the electronic device also provides other entrances to display the interface of the intelligent video editing function.

[0227] Taking the electronic device displaying the main interface (such as interface 61) as an example. The interface 61 may include icons of one or more applications. Taking the icon 703 of the gallery application included on the interface 61 as an example. The user can click on the icon 703 to instruct the electronic device to enter the gallery application. Correspondingly, the electronic device can display the interface of the gallery application. Different function options may be displayed in the interface of the gallery application (such as at the bottom of the interface). For example, the function options may include photos, albums, memories, creation, etc.

[0228] In some implementations, after the gallery application is launched, the interface corresponding to the "Photos" function option may be displayed. One or more thumbnail images of the captured photos may be included in this interface. Correspondingly, the gallery application can enter the interface 73 corresponding to the "Creation" function option under the user's instruction (such as clicking on the creation function option).

[0229] In other implementations, the gallery application can instruct the electronic device to display the interface 73 corresponding to the "Creation" function option as soon as it is launched.

[0230] In this example, the gallery application may display an entry to the smart photo function on the interface 73. For example, a control 704 may be displayed on the interface 73. In this way, when the user wants to further process the images stored in the gallery, the user can quickly enter the corresponding function interface through the control 704. For example, the user can click the control 704 to instruct the electronic device to display the interface of the smart photo function.

[0231] In response to the operation of the click control 704, the electronic device can run the smart assistant application and display the interface 71 corresponding to the smart film-making function under the control of the smart assistant application.

[0232] In combination with the above description about CV processing and interface 11, in the present application, the display of the interface 71 can be realized based on the result of CV processing.

[0233] For example, one or more scene cards may be displayed in the interface 71. The composition of each scene card can refer to Figure 4 For example, each scene card may include a background image, a card theme, and a prompt statement. Among them, the background image of the scene card can be a preset background image that corresponds to the card theme one by one. In some implementations, the prompt statement can be displayed as a pre-configured prompt statement corresponding to the card theme. In other implementations, the prompt statement can be flexibly adjusted according to the name of the display column that can generate a video file included in the current card theme.

[0234] In addition, if Figure 5 For example, a plurality of scene cards may be pre-stored in the electronic device so as to be displayed when the interface of the smart film-making function needs to be displayed.

[0235] In some embodiments, on the interface 71, the display order of each scene card may correspond to the result of the CV analysis.

[0236] Exemplarily, based on CV analysis, the middle platform module can determine the number of available rules included in each scene card. The more available rules there are, the more video files can be generated corresponding to the scene card. In this way, the middle platform module can sort each scene card from large to small according to the number of available rules included. Therefore, when the smart assistant needs to display the interface of the smart film-making function, it can obtain the sorting results of each scene card from the middle platform module and instruct the electronic device to display according to the sorting results.

[0237] In the present application, two or more scene cards may be displayed in the same row. Thus, the display priority may be arranged from high to low: in the same row, the display priority decreases from left to right. In addition, in different rows, the display priority decreases from top to bottom.

[0238] Combination Figure 7 An example of the interface 71 in the middle. According to the sorting result from the middle - tier module (such as the display priority), the intelligent assistant application can determine that the display priority of the scene card "Daily Vlog" can be higher than that of "Personal Photo". Thus, when the scene cards "Daily Vlog" and "Personal Photo" are displayed on the same line, the scene card "Daily Vlog" can be displayed to the left of "Personal Photo". The intelligent assistant application can determine that the display priority of the scene card "Daily Vlog" can be higher than that of "Family Group Photo". Thus, when the scene cards "Daily Vlog" and "Family Group Photo" are displayed on different lines, the scene card "Daily Vlog" can be displayed above "Family Group Photo". And so on, the intelligent assistant can control the electronic device to display the interface of the intelligent video composition function according to the display priorities of each scene card.

[0239] In some other embodiments of the present application, on the interface 71, the display order of each scene card can also be related to other factors.

[0240] Exemplarily, in some implementations, for scene cards with the same display priority, the middle - tier module (or the intelligent assistant application) can determine the display order of each scene card according to the number of corresponding images included in all available rules in the scene card. For example, the display order of the scene card with more images is configured to be more forward.

[0241] In some implementations, for scene cards with the same display priority and the same number of included images, the middle - tier module (or the intelligent assistant application) can determine the display order of each scene card according to the acquisition time of the images included in the scene card. For example, when the included images have a later acquisition time (i.e., closer to the current moment), the display order of the corresponding scene card is configured to be more forward.

[0242] It can be understood that in some other cases, if the current electronic device has not performed CV analysis, or the number of available images for CV analysis is too small (such as less than a preset quantity threshold) or is empty, the middle - tier module cannot obtain the CV analysis result. Correspondingly, when the intelligent assistant needs to display the interface of the intelligent video composition function, the middle - tier module can send the pre - configured display order of each scene card to the intelligent assistant. Thus, the intelligent assistant can control the electronic device to display according to the pre - configured display order of each scene card.

[0243] In some embodiments of the present application, such as Figure 7Any of the operations for triggering the display interface 71 shown can be referred to as the first operation. Correspondingly, the intelligent video compilation function can be referred to as the first function. This interface 71 can be referred to as the first interface. Accordingly, the interface 71 may include a first scene card and a second scene card. The first scene card can be the scene card displayed before the second scene card. For example, the first scene card can be "Daily Vlog", and the second scene card can be "Personal Photo". Another example is that the first scene card can be "Growth Theme", and the second scene card can be the subsequently displayed scene card.

[0244] The above has elaborated in detail on the interface display of the intelligent video compilation function in the embodiments of the present application through the internal processing mechanism and the interface interaction logic. In the embodiments of the present application, an interaction display logic based on the user's operation on the scene card is also provided.

[0245] Exemplarily, referring to Figure 8 , it is a schematic diagram of another interface interaction logic provided by the embodiments of the present application.

[0246] In this example such as Figure 8 , the user can click on any scene card in the interface of the intelligent video compilation function (such as interface 81), thereby triggering further relevant processing and display in this scene. This interface 81 can correspond to the interface 71 as shown in Figure 7 .

[0247] As Figure 8 shown, taking the user's input operation OP6 in interface 81 as an example. This operation OP6 can be a click operation on any scene card on interface 81. For example, this operation OP6 can be a click operation on the scene card of "Growth Theme". In some implementations, the scene card of "Growth Theme" can be referred to as the third scene card. The operation OP6 can be referred to as the second operation.

[0248] In response to this operation OP6, the intelligent assistant application can control the electronic device to perform corresponding interface responses.

[0249] Exemplarily, in some embodiments, the intelligent assistant can, in response to the user's operation OP6, instruct the electronic device to switch the display interface to 82.

[0250] In this example of interface 82, the intelligent assistant can display a dialogue bar including a display column set 801 to the user. The display column set 801 can include a preset number of display columns. This preset number can also be referred to as the maximum number of display columns.

[0251] Each display column included in the display column set 801 can correspond to an available rule configured correspondingly under the current scene card.

[0252] For example, the current scenario card can be "Growth Theme". Combining the foregoing description of CV analysis, the middleware module can aggregate all the images after configuring the tags according to each rule in the growth theme, so as to obtain the set of available images corresponding to each rule in the growth theme. In this way, the middleware module can determine all the available rules in the current growth theme, as well as the set of available images corresponding to the available rules. The middleware module can also determine the names of the display columns corresponding to each available rule. The middleware module can also determine the display priorities of the display columns corresponding to all the available rules when they are displayed.

[0253] In this way, when the intelligent assistant needs to display the interface 82 (such as when the intelligent assistant receives the operation OP6), it can obtain the display columns corresponding to the growth theme and the display priorities of each display column from the middleware module.

[0254] Taking the preset number as 3 as an example. Through CV analysis, the middleware module determines that the names of the available display columns under the growth theme include: "Produce a video of the child playing with the father", "Generate a warm video of the child and the mother", "Generate a growth video of the child", etc.

[0255] In this way, the middleware module can send the names of the 3 display columns and the relevant information of the available images included in each display column to the intelligent assistant. The middleware module can also send the display priorities of the 3 display columns to the intelligent assistant respectively.

[0256] Correspondingly, the intelligent assistant can, according to the received information, instruct the electronic device to display the interface 82 as shown in Figure 8 . Among them, the higher the display priority, the higher the position of the corresponding display column in the display column set 801. The display column with the highest display priority in the display column set 801 can be called the first display column.

[0257] Combined with Figure 9 For Figure 8 in the display column set 801 is illustrated by way of example.

[0258] Such as Figure 9 shown, taking the display column 901 of producing a video of the child playing with the father in the display column set 801 as an example.

[0259] This display column 901 can at least include an image part 902 and a text part 903.

[0260] Among them, the image part 902 can correspond to the wonderful images in the corresponding available image set (such as image set 91) of the display column 901. In some embodiments, the middle platform module can select wonderful images (such as image a) from the image set (such as image set 91) corresponding to the current display column 901 according to the pre-configured judgment logic of wonderful images. The middle platform module can also send the image information (such as image ID) of the wonderful image to the intelligent assistant, so that the intelligent assistant can use the wonderful image as the image part 902 when the display column 901 is displayed.

[0261] Similarly, the thumbnail in the display column of "Generate a warm video of the child and the mother" can be the wonderful image (such as image b) in the corresponding image combination; the thumbnail in the display column of "Generate a growth video of the child" can be the wonderful image (such as image c) in the corresponding image combination.

[0262] The text part 903 can be correspondingly displayed as the name corresponding to the display column 901. The acquisition and generation method of the specific name can refer to the foregoing related description, which will not be elaborated here.

[0263] In some embodiments, the display column 901 may further include a button 904. The button 904 can be used to trigger further processing of the display column 901. For example, after the user clicks the button 904, the intelligent assistant can instruct the electronic device to perform video synthesis processing on the image set 91 corresponding to the display column 901. Thus, the video file corresponding to the image set 91 is obtained, that is, the intelligent video production for the image set 91 is completed.

[0264] It can be understood that it is different from the display of different scene cards in the foregoing interface 81. In the embodiments of the present application, when the CV analysis can obtain available display columns, the image part of the display column can be replaced by the wonderful images in the corresponding image set. Instead of the background pictures in each scene card being displayed as preset images.

[0265] In this way, taking the Figure 8 scene example of the interface 82 shown as an example, in the case where the CV analysis has been completed and at least one available display column in the current scene card can be obtained, the intelligent assistant can control the electronic device to display each available display column. In addition, when the display interface 81 is displayed, the prompt statement displayed under the card theme can also be replaced by the name of the display column with the highest display priority in the available display columns.

[0266] For example, as shown in the interface 82, taking the display priorities of "Make a video of the child playing with the father", "Generate a warm video of the child and the mother", and "Generate a growth video of the child" decreasing in turn as an example. In this way, in the interface 81, the prompt statement of this growth theme can be displayed as "Make a video of the child playing with the father".

[0267] It should be noted that, in some embodiments of the present application, when there are more than 3 available display columns in the scenario card corresponding to the user input operation OP6 (such as the scenario card with a growth theme), the intelligent assistant can display the 3 available display columns with the highest display priority on the interface 82. Thereafter, after the user inputs the operation OP6 for the next time, the intelligent assistant can perform a rotation display on all available display columns.

[0268] Exemplarily, taking the available display columns including display column 1 to display column 4 with the display priority decreasing in turn as an example. When the user inputs the operation OP6 for the first time, the intelligent assistant can display the display column 1 to display column 3 on the interface 82. When the user inputs the operation OP6 for the second time, the intelligent assistant can perform a rotation display on other display columns on the interface 82. For example, the intelligent assistant can display display column 2 to display column 4 for the user in the display column set 801 of the interface 82. This enables the user to see a variety of different available display columns on the interface 82 after inputting the operation multiple times. Thereby enriching the user's usage options.

[0269] In addition, in combination with Figure 7 and Figure 8 the description in, referring to Figure 10 . In some other embodiments of the present application, when the electronic device receives a click operation on the control 704 in the gallery application by the user, after the CV analysis has been completed, it can directly jump to and display the interface of the available display columns capable of generating a video. For example, the intelligent assistant application can control the electronic device to jump and switch from the interface 73 to the display interface 82. Thereby improving the usage efficiency of the intelligent video composition function by the user.

[0270] In the above description of the switching mechanism for displaying available display columns, it is taken as an example that the electronic device has completed the process CV analysis for the growth theme and can obtain at least one available display column in the scenario card before receiving the operation OP6.

[0271] In some other embodiments, when the electronic device receives an operation such as OP6 for any scenario card, if the CV analysis has not been completed, or after the CV analysis it is determined that the scenario card indicated by the operation has no available display columns, the intelligent assistant can be configured with other display interaction logics.

[0272] Exemplarily, taking the case where when receiving the operation OP6, the electronic device has completed the CV analysis; but there are no available display columns under the growth theme as an example.

[0273] Such as Figure 8As shown, after receiving operation OP6, the intelligent assistant application can control the electronic device to switch the display interface 83. At least one recommended display column 802 can be included in this interface 83. This display column 802 can also be referred to as the fourth display column.

[0274] It can be understood that after receiving the user's operation OP6, the intelligent assistant can query the information of the available display columns corresponding to the growth theme indicated by this operation OP6 from the middle - platform module. Correspondingly, the middle - platform module can feedback to the intelligent assistant that after CV analysis, the available display columns corresponding to this growth theme are empty, or there are no available display columns for this growth theme.

[0275] In this way, the intelligent assistant can display the pre - configured display column 802 corresponding to this growth theme on the switched display interface 83. For example, this display column 802 can be a pre - configured display column with the name "Make a video of the child playing with the father". Different from the display columns shown in interface 82, the name of this display column 802 can be pre - configured, rather than generated by the middle - platform module according to the available image set. In addition, the image part of this display column 802 can be displayed as a preset image (such as Image 6) corresponding to the current scene card, rather than the wonderful images in the available image set.

[0276] Thus, by displaying this interface 83, the intelligent assistant can guide the user to further perform subsequent operations.

[0277] Exemplarily, the user can click on the display column 802. In response to this operation, the intelligent assistant can control the electronic device to switch the display interface 84. This click operation on the display column 802 can also be referred to as the third operation.

[0278] On this interface 84, operation information 803 can be displayed. This operation information 803 can correspond to the operation of the user input on the display column 802. Thus, the effect of simulated conversation can be obtained.

[0279] The interface 84 may also include prompt content 804. In this example, the middle - tier module of the electronic device has completed CV analysis, but the scene label of the growth theme corresponding to the user's operation OP6 (i.e., the click) does not include an available display column. Therefore, after the user clicks on the display column 802, the intelligent assistant will not show the video file generated corresponding to the display column 802 to the user. Correspondingly, the intelligent assistant can prompt the user in the prompt content 804 with other available display columns that can generate video files. Exemplarily, the available column 805 may be included in the prompt content 804. The available column 805 may be the available display column determined by the middle - tier module through CV analysis. For example, the available column 805 may be a display column for "generating a video of a child and a mother holding hands". The available column 805 may also be referred to as the fifth display column. In this example, the thumbnail (i.e., the image part) displayed in the available column 805 may be image d.

[0280] In this way, the user can, according to the text reminder in the prompt content 804, such as "There are no available photos for this theme in the gallery. You can try clicking on the following themes to create a video", determine that although the video file corresponding to the selected "making a video of a child and a father playing" cannot be obtained, but can try to obtain the video file corresponding to the available column 805.

[0281] In the Figure 8 illustrated switching display mechanism from interface 81 to interface 83 to interface 84, the case where CV analysis has been completed is taken as an example for explanation.

[0282] In some other embodiments, when there are not enough images in the electronic device, CV analysis cannot be performed, and thus corresponding recommended displays cannot be made according to the above - mentioned scheme.

[0283] Exemplarily, in this case, after the user clicks on the display column 802, the intelligent assistant application can instruct the electronic device to switch to the display interface 85. The interface 85 may include a text prompt 806. The text prompt 806 can prompt the user "There are not enough available photos in the gallery. Take more photos and then try again." So that after the electronic device obtains more images, it can perform reasonable sorting and display according to the previous examples. The interface 85 may also be referred to as the fourth interface. The text prompt 806 may also be referred to as the first prompt message.

[0284] In some other embodiments, when the electronic device receives the user input operation OP6, there are already images in the electronic device, but the CV analysis has not been completed yet.

[0285] In this case, the intelligent assistant application can also be configured with corresponding interaction logic to facilitate guiding the user to trigger CV analysis. It can be understood that in this example, since the electronic device has not completed the CV analysis, the sorting of the various scenario cards on the interface 81 displayed when receiving the operation OP6 can be displayed in the default preset order.

[0286] Exemplarily, refer to Figure 11 . Take the user clicking on the display column 802 on the interface as an example.

[0287] After receiving the click operation on the display column 802 input by the user, the intelligent assistant application can switch the display interface 111. In this example, this interface 111 can also include Figure 8 the operation information 803 as shown, thereby realizing the experience of a simulated conversation.

[0288] In this interface 111, a prompt box 1101 can also be included. Different from Figure 8 the prompt content 804 in, in this example, since the electronic device has not completed (or has not performed within the preset duration) the CV analysis, the intelligent assistant application can control the electronic device to display the prompt box 1101 on the interface 111. This prompt box 1101 can be used to prompt the user that CV analysis needs to be performed. For example, the prompt box 1101 can include a text prompt "In order to search for materials more accurately, intelligent image recognition is required. Please click the button below." The prompt box 1101 can also include a button 1102. This button 1102 can correspond to triggering the CV analysis. For example, the button 1102 can include the text information "Start intelligent image recognition".

[0289] Thus, this interface 111 provides an entry for the user to trigger the CV analysis. Take the user inputting a click operation on the button 1102 as an example. In this way, the electronic device can start the CV analysis. This CV analysis process can include the processes of image analysis, tag configuration, display column name generation, display priority determination, etc. provided in the above example. The specific implementation will not be elaborated.

[0290] In the embodiment of the present application, when the electronic device performs CV analysis, corresponding prompt information can be displayed on the interface.

[0291] Exemplarily, in some embodiments, when performing CV analysis, the prompt message can be displayed in the gallery application of the electronic device. For example, when performing CV analysis, the electronic device can display a progress prompt 1103 in the interface 112 of the gallery application. The progress prompt 1103 can include a progress bar and a text prompt message. The progress bar can be automatically generated according to the ratio of the images that have completed CV processing to all the images. The text prompt message can include "Intelligent clustering in progress..." etc., to prompt the user that CV analysis is currently being performed.

[0292] In other embodiments, when performing CV analysis, the current CV analysis situation can also be displayed on the main interface of the electronic device in the form of a card. For example, when performing CV analysis, the electronic device can display a progress prompt card 1104 on the main interface (such as interface 113). In this example, the CV analysis can be executed by the middle platform module. However, since the CV analysis process can be based on the images stored in the gallery, a text identifier of the gallery can be included in the progress prompt card 1104. The progress prompt card 1104 can also include a text prompt message and a progress bar. The display mechanism of the text prompt message and the progress bar can refer to the above example and will not be elaborated here.

[0293] It can be understood that interface 113 provides an example of the interface during the ongoing CV analysis. After the CV analysis is completed, the content of the card on the interface can also be updated correspondingly. For example, after the CV analysis is completed, a progress prompt card 1105 can be displayed on interface 114. The progress prompt card 1105 can include text prompts such as "Intelligent image recognition completed" indicating that the CV analysis has been completed. In this example, the progress prompt card 1105 can also include a prompt for quickly entering the intelligent video editing function interface (such as Figure 8 interface 81 or interface 82 or interface 83 as shown). Thus, when the user clicks on the progress prompt card 1105, the electronic device can quickly launch the intelligent assistant application and switch to display interface 81 or interface 82 or interface 83. Among them, the specific switching to display interface 81 or interface 82 or interface 83 can be implemented according to the logic pre-configured in the intelligent assistant application.

[0294] Thus, in the above description, through Figures 8 to 11 the provided interaction examples, interaction logic examples in different scenarios are provided in the embodiments of the present application, such as the available display columns in the scenario card when the intelligent assistant application has completed CV analysis and there is a user instruction, the available display columns in the scenario card when the intelligent assistant application has completed CV analysis and there is no user instruction, and when the CV analysis has not been completed.

[0295] In the specific implementation process, the intelligent assistant application can determine to trigger the display of any of the above interaction logics through interaction with the gallery application or the middle platform module.

[0296] Exemplarily, after receiving the user's operation OP6, the intelligent assistant application can request the CV analysis result of the card theme corresponding to the operation OP6 from the middle platform module.

[0297] When the CV analysis is completed and there are available display columns in the scenario card indicated by the user, the intelligent assistant can obtain the names of each available display column and the information of the image set under the scenario card corresponding to the growth theme from the middle platform module, and then switch the display to Figure 8 the interface 82 as shown.

[0298] When the CV analysis is completed and there are no available display columns in the scenario card indicated by the user, the intelligent assistant can obtain the information of the scenario card corresponding to the growth theme that does not include the available display columns from the middle platform module. Thus, the intelligent assistant can switch the display interface to 83. After that, after receiving the user's click operation on the display column 802, the intelligent assistant can obtain the information of the available display columns that can be made into a film currently from the middle platform module, and then switch the display interface to 84 accordingly and display the corresponding prompt content 804.

[0299] When the CV analysis has not been completed, the intelligent assistant can obtain the information that the CV analysis has not been completed from the middle platform module. Thus, the intelligent assistant can display according to the interface interaction logic as Figure 11 shown.

[0300] In the above example, after the user inputs an operation on the button 1102, the electronic device can be triggered to perform CV analysis, and the current CV analysis progress (i.e., the intelligent image recognition progress) can be displayed to the user on interfaces such as interface 112 and interface 113.

[0301] In some other embodiments of the present application, after the user inputs an operation on the button 1102, the intelligent assistant application can also display the current CV analysis progress to the user in the intelligent video editing interaction interface.

[0302] Exemplarily. As Figure 11As shown, after the user clicks button 1102, the intelligent assistant application can control the switching of the display interface 115. In this interface 115, the intelligent assistant application can show the response situation after the input operation to the user in the form of a simulated conversation. For example, a conversation bar 1106 can be displayed in the interface 115. The simulated conversation information such as "Start intelligent image recognition" can be included in the conversation bar 1106. The conversation bar 1106 can correspond to the operation of the user inputting and clicking button 1102. A progress prompt card 1107 can also be included in this interface 115. Similar to the examples of the above progress prompt cards 1103, progress prompt card 1104, and progress prompt card 1105, the progress prompt card 1107 can also show the progress of the current CV analysis to the user in the form of text information (such as intelligent image recognition, intelligent clustering in progress) and a progress bar.

[0303] In addition, after the CV analysis is completed, relevant prompts similar to "Intelligent image recognition has been completed" in the progress prompt card 1105 can also be refreshed in this interface 115. The specific implementation will not be elaborated.

[0304] It can be understood that in the above example, the interaction between the intelligent assistant and the middle platform module is used as an example to implement the interaction of each interface. In the case where the CV analysis ability is provided by the gallery application, the intelligent assistant can perform the above interaction with the gallery application, and then trigger the corresponding interaction logic.

[0305] The above Figures 7 to 11 In the implementation of the provided solution, the intelligent assistant can be described in detail by taking the display of various scene cards and display columns based on the stored images (such as the images stored in the gallery) as an example. In some other embodiments of the present application, the display of the scene cards and / or display columns can also be combined with the data of the cloud server.

[0306] Exemplarily, referring to Figure 12 , in some embodiments of the present application, the electronic device can have a communication connection with the cloud server. In this way, in different scenarios, one or more of the above pre-configured parameters (such as the background images of each scene card, the types of scene cards, the display information of the recommended columns in the case of no available display columns, etc.) can be obtained by the electronic device from the cloud server. Thus, the cloud server can centrally manage the intelligent video composition function of the electronic device.

[0307] In some other embodiments, the CV analysis ability corresponding to the above middle platform module can also be deployed in the cloud server. Thus, the intelligent assistant application can control the interaction between the electronic device and the cloud server to determine whether the CV analysis has been performed currently and the relevant results after the CV analysis is completed, and then trigger the interaction logic in each of the above embodiments.

[0308] The following combines Figure 13 In the example of Figure 13 , taking the scenario where the cloud server intelligently pushes scenario cards to the electronic device as an example, the function of the cloud server for managing the electronic device will be illustrated by way of example. In some embodiments, the cloud server can push no more than 3 scenario cards to the electronic device at the same time.

[0309] As Figure 13 shown, in this example, the cloud server can push a scenario card of "Autumn Outing" to the electronic device. In some implementations, the scenario card of "Autumn Outing" may not be included in the multiple scenario cards as Figure 5 shown. The cloud server can push the relevant information of the scenario card of "Autumn Outing" to the electronic device according to the search volume in the current network, pre-configured push tasks, etc.

[0310] For example, the relevant information of the scenario card of "Autumn Outing" may include information such as the background image of the scenario card, the card theme, and the prompt statement.

[0311] In this way, when the intelligent assistant application displays the interface of the intelligent video, it can display the interface 131 as Figure 13 shown. Referring to the interface 81 as Figure 8 shown, in this interface 131, it may include various scenario pictures sorted by CV analysis. In this interface 131, it may also include the scenario card 1301 of "Autumn Outing" displayed at the top. This scenario card 1301 may also be referred to as the fifth scenario card. The background image of this scenario card 1301 may be the image 14 obtained from the cloud server.

[0312] That is to say, when the intelligent assistant application displays the interface 131, if it receives a scenario card pushed by the cloud server, it can adjust the display priority of the scenario card pushed by the cloud server to the highest. So as to display the scenario card from the cloud server at the top.

[0313] In some embodiments, the scenario card displayed at the top (such as the scenario card corresponding to "Autumn Outing") may be correspondingly displayed with a heat label 1302. Thus, the user can know through this heat label 1302 that this scenario card corresponds to scenario information with a relatively high heat in the current network.

[0314] Taking the example that the user clicks on this scenario card 1301 in the interface 131. The intelligent assistant application can control the electronic device to switch to display the interface 132.

[0315] In this interface 132, it may include a display column set 1303. The display columns in this display column set 1303 may be referred to as the seventh display columns.

[0316] In some embodiments, the acquisition and display method of the display column set 1303 can refer to the display column set 801 as shown in Figure 8 . That is, the display columns in the display column set 1303 can be obtained by performing CV analysis on the image of the current electronic device.

[0317] In other embodiments, the display column set 1303 can also be obtained from the cloud server.

[0318] In this example, after the intelligent assistant receives the click operation of the user on the scenario card 1301 pushed by the cloud server, it can obtain the display columns of the scenario card 1301 from the cloud server, and then display the display column set 1303 in the display interface 132 according to the information such as the names and images of the respective display columns obtained from the cloud server.

[0319] For example, the intelligent assistant application can obtain the relevant information of the following three display columns from the cloud:

[0320] The display column with the highest display priority, whose thumbnail is image 141 and the name of the display column is "Generate an autumn scenery video in 2023";

[0321] The display column with a relatively high display priority, whose thumbnail is image 142 and the name of the display column is "Produce an autumn weekend camping video";

[0322] The display column with a relatively low display priority, whose thumbnail is image 143 and the name of the display column is "Generate a walking video in Park A".

[0323] Thus, through the display column set 1303, the user can obtain the intelligent video editing function based on the images in the network.

[0324] Taking the user's click operation on the display column in the display column set 1303 (such as the display column with the name "Generate an autumn scenery video in 2023") as an example.

[0325] The intelligent assistant can refresh the current interface in response to this operation. For example, the display interface 133. The operation information (such as generating an autumn scenery video in 2023) of the user input operation can be included in this interface 133. The prompt information 1304 and the image information 1305 can also be included in this interface 133. This interface 133 can be called the seventh interface.

[0326] In some embodiments, after receiving a click operation on the user input "generate an autumn scenery video in 2023", the intelligent assistant can interact with the cloud server to obtain response information for this display column. For example, the intelligent assistant can obtain from the cloud server that the prompt information 1304 is "Here are some selected photos of the autumn scenery in 2023. Please choose one". Thus, the intelligent assistant can display this prompt information 1304 in the current content column. Also, for example, the intelligent assistant can obtain from the cloud server the available images corresponding to the current display column. Thus, the intelligent assistant can display the image information 1305, and show the available images corresponding to the current display column to the user in this image information 1305. For example, the images obtained from the cloud shown in this image information 1305 can include: Image 142, Image 144, Image 145, Image 146, Image 147, and Image 148, etc.

[0327] The image information 1305 can also include operable controls, such as a "generate video" control, etc. Thus, when the user wants to obtain the video file based on the network images, the user can input a click operation on the "generate video" control to trigger the electronic device to generate a video file based on the obtained network images.

[0328] Thus, through the interaction examples provided in the above various embodiments, the electronic device (such as the intelligent assistant application in the electronic device) can better provide the user with an interaction experience from images to videos through interaction configurations based on different logics.

[0329] It can be understood that, in order to implement the above functions, the electronic device provided in the embodiments of the present application includes the corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should easily realize that, combining the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.

[0330] The embodiments of the present application can divide the functional modules of the above electronic device according to the above method examples. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0331] The above has introduced the solution provided by the embodiments of the present application mainly from the perspective of each functional module. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of the examples described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the way of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described function for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0332] The above integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiments of the present application is illustrative, only a logical function division, and there may be other division methods in actual implementation.

[0333] Exemplarily, Figure 14 shows a schematic composition diagram of an electronic device 1400. As Figure 14 shown, the electronic device 1400 may include: a processor 1401 and a memory 1402. The memory 1402 is used to store computer execution instructions. Exemplarily, in some embodiments, when the processor 1401 executes the instructions stored in the memory 1402, the electronic device 1400 can be made to execute the methods shown in any of the above embodiments. In the embodiments of the present application, the electronic device 1400 may further be configured with a display screen 1403, whereby the processor 1400 can display different interface images to the user on the display screen 1403 based on the interaction examples provided in the above embodiments.

[0334] It should be noted that all relevant contents of the steps involved in the above method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be repeated here.

[0335] Figure 15 shows a schematic composition diagram of a chip system 1500. The chip system 1500 may include: a processor 1501 and a communication interface 1502, for supporting related devices to implement the functions involved in the above embodiments. In a possible design, the chip system further includes a memory for storing necessary program instructions and data of the electronic device. The chip system may be composed of chips or may include chips and other discrete devices. It should be noted that, in some implementation manners of the present application, the communication interface 1502 may also be referred to as an interface circuit.

[0336] It should be noted that all relevant contents of the steps involved in the above method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be repeated here.

[0337] The functions, actions, operations, steps, etc. in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from a website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated media. The available medium can be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid state disk (SSD)), etc.

[0338] Although the present application has been described in conjunction with specific features and their embodiments, it is obvious that various modifications and combinations can be made without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely exemplary illustrations of the present application as defined by the appended claims and are considered to cover any and all modifications, variations, combinations, or equivalents within the scope of the present application. Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalent technologies, the present application is also intended to include these changes and modifications.

Claims

1. A display method, characterized in that, Applied to an electronic device, the electronic device being configured with a display screen; the method includes: Receiving a first operation, the first operation being used to instruct the electronic device to display an interface of a first function; the first function corresponds to generating a video file according to an image; Displaying a first interface; Wherein, the first interface corresponds to the first function, and the first interface includes at least two scene cards, and each of the scene cards is correspondingly displayed with a background picture, a card theme, and a prompt statement; In the first interface, a first scene card is displayed before a second scene card; the first scene card and the second scene card are included in the at least two scene cards; The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card; each of the available display columns corresponds to a video file that can be formed into a film, or, The display priority of the first scene card pre-configured in the electronic device is higher than that of the second scene card.

2. The method according to claim 1, wherein The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card; Before displaying the first interface, the method further includes: Determining a first number of available display columns of the first scene card, and a second number of available display columns of the second scene card.

3. The method according to claim 2, wherein At least one image is stored in the electronic device; Before determining the first number and the second number, the method further includes: Determining the attribute information of each image, the attribute information including information of at least one of the following dimensions: character attribute, location attribute, time attribute, event attribute; According to the attribute information of the image, labeling at least one tag for the image, and the tag of the image corresponds to the attribute information of the image; For each rule in each scene card, determining a set of available images that match the rule; each of the scenes is configured with at least one rule, and each of the rules is configured with at least one tag.

4. The method according to claim 3, wherein Determining the first number includes: Determining that the number of available rules included in the first scene card is the first number; the available rules included in the first scene card are the rules in all the rules correspondingly configured for the first scene card for which the set of available images is not empty.

5. The method according to claim 3 or 4, wherein Determining the second number includes: Determining that the number of available rules included in the second scene card is the second number; the available rules included in the second scene card are the rules in all the rules correspondingly configured for the second scene card for which the set of available images is not empty.

6. The method according to claim 4, characterized in that, The first number is not 0; The prompt statement of the first scene card is the same as the name of the first display column; The first display column corresponds to a first rule, and the first rule is the rule with the largest number of corresponding available images among all the available rules of the first scene card.

7. The method according to any one of claims 3-6, characterized in that, The background picture of the first scene card is a preset image.

8. The method according to any one of claims 3-7, characterized in that, The first interface further includes a third scene card; The method further includes: Receive a second operation, which is an operation on a third scenario card, and the second operation is used to instruct the electronic device to display the details of the third scenario card; Display a second interface; Wherein, the second interface includes at least one display column, and each display column corresponds to a rule configured for the third scenario card.

9. The method according to claim 8, wherein, The at least one display column included in the second interface includes a second display column and a third display column; The second display column is displayed before the third display column; The number of available images corresponding to the rule of the second display column is greater than the number of available images corresponding to the rule of the third display column.

10. The method according to claim 9, wherein, Before displaying the second interface, the method further includes: Determine the name of the second display column according to the labels of the available images in the second display column.

11. The method according to claim 8, wherein, The second interface includes a fourth display column; The fourth display column is a display column of the pre-configured third scenario card.

12. The method according to claim 11, wherein, Before displaying the second interface, the method further includes: Determine that the available set of images for each rule in the third scenario card is empty.

13. The method according to claim 11 or 12, characterized in that, The images displayed in the fourth display column are the same as the background picture displayed in the third scenario card.

14. The method according to any one of claims 11-13, characterized in that The method further includes: Receive a third operation, which is an operation on the fourth display column; In response to the third operation, display a third interface; The third interface includes a fifth display column; the available image set corresponding to the rule of the fifth prompt column is not empty.

15. The method according to any one of claims 11-13, characterized in that, The method further includes: Receive a third operation, which is an operation on the fourth display column; In response to the third operation, display a fourth interface; The fourth interface includes a first prompt message for prompting the user to take an image; before receiving the third operation, determine that the available image sets of the rules of the scenario are all empty.

16. The method according to claim 1, wherein The display priority of the first scenario card pre-configured by the electronic device is higher than the display priority of the second scenario card; After displaying the first interface, the method further includes: Receive a fourth operation, which is an operation on a fourth scenario card, and the fourth operation is used to instruct the electronic device to display the details of the fourth scenario card; the fourth scenario card is displayed in the first interface; In response to the fourth operation, display a fifth interface; the fifth interface includes a sixth display column; the sixth display column is a display column of the pre-configured fourth scenario card.

17. The method according to claim 16, wherein The method further includes: Receive a fifth operation, which is an operation on the sixth display column; In response to the fifth operation, display a second prompt message for prompting the user to trigger intelligent image recognition processing; The intelligent image recognition processing includes: Determine the attribute information of each of the said images, where the attribute information includes information on at least one of the following dimensions: character attribute, location attribute, time attribute, event attribute; Based on the attribute information of the said images, label at least one tag for the said images, where the tags of the said images correspond to the attribute information of the said images; For each rule in each scenario card, determine the set of available images that match the said rule; each of the said scenarios is configured with at least one rule, and each of the said rules is configured with at least one tag.

18. The method according to any one of claims 1-17, characterized in that, The first interface further includes a fifth scenario card; the fifth display card is displayed before the first scenario card; Before displaying the first interface, the method further includes: Receiving a first push message, where the first push message includes the background image, card theme, and prompt statement of the fifth scenario card.

19. The method according to claim 18, wherein After displaying the first interface, the method further includes: Receiving a sixth operation, where the sixth operation is used to instruct the electronic device to display the details of the fifth scenario card; In response to the sixth operation, display a sixth interface, where the sixth interface includes a seventh display column pre-configured for the fifth scenario card; Receiving a seventh operation, where the seventh operation is an operation on the seventh display column; In response to the seventh operation, obtain at least one image corresponding to the seventh display column; Display a seventh interface, where the seventh interface includes the image corresponding to the seventh display column.

20. An electronic device, characterized in that, The electronic device includes: a display screen, a memory, and one or more processors; the display screen, the memory, and the processor are coupled; Wherein, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device is caused to execute the method described in any one of claims 1-19.

Images