Display method and electronic device

Abstract

Embodiments of the present application relate to the technical field of electronic devices, and provide a display method and an electronic device. The method can improve efficiency in a process in which a user uses a function corresponding to generating a video on the basis of an image. The method may comprise: receiving a first operation, the first operation being used for instructing an electronic device to display an interface of a first function, and the first function corresponding to generating a video file on the basis of an image; and displaying a first interface, the first interface corresponding to the first function, and the first interface comprising at least two scene cards. A first scene card is displayed before a second scene card. The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card. Each available display column corresponds to one video file that can be made into a clip.

Description

Display method and electronic device

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office on December 28, 2023, with application number 202311844689.1 and invention name “A display method and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the technical field of electronic devices, and in particular to a display method and electronic device. Background Art

[0003] Currently, electronic devices can automatically generate video files based on existing images under user instructions.

[0004] Generally, when images are already stored in an electronic device, the images are scattered in the gallery, so users need to spend a lot of effort to filter and obtain the desired images. The process of instructing the electronic device to generate a video based on the filtered images is also relatively cumbersome.

[0005] Summary of the Invention

[0006] The present application provides a display method and electronic device, which can improve the efficiency of users in using images to generate corresponding videos.

[0007] To achieve the above technical objectives, this application adopts the following technical solutions:

[0008] In a first aspect, a display method is provided, which is applied to an electronic device, wherein the electronic device is equipped with a display screen. The method includes: receiving a first operation, wherein the first operation is used to instruct the electronic device to display an interface of a first function. The first function corresponds to generating a video file based on an image. Displaying a first interface. The first interface corresponds to the first function, and the first interface includes at least two scene cards, each of which corresponds to displaying a background image, a card theme, and a prompt statement. In the first interface, the first scene card is displayed before the second scene card. The first scene card and the second scene card are included in the at least two scene cards. The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card. Each of the available display columns corresponds to a video file that can be made into a film, or the display priority of the first scene card preconfigured by the electronic device is higher than the display priority of the second scene card.

[0009] In this way, the electronic device can display scene cards in order based on the number of videos that can be generated. This allows scene cards that can generate more videos to be displayed at a more forward position, making it easier for users to use the image-to-video conversion function. Correspondingly, when it is impossible to obtain relevant information about the number of videos that can be generated in each scene card, each scene card can be displayed according to the default priority.

[0010] Optionally, the number of available display columns of the first scene card is greater than the number of available display columns of the second scene card. Before displaying the first interface, the method further includes: determining a first number of available display columns of the first scene card and a second number of available display columns of the second scene card.

[0011] Optionally, at least one image is stored in the electronic device. Before determining the first quantity and the second quantity, the method further includes: determining the attribute information of each of the images, the attribute information including information of at least one of the following dimensions: person attributes, location attributes, time attributes, and event attributes. Based on the attribute information of the image, at least one label is marked for the image, and the label of the image corresponds to the attribute information of the image. For each rule in each scene card, a set of available images that matches the rule is determined. Each scene is configured with at least one rule, and each rule is configured with at least one label. In this application, the processing process may also be referred to as CV analysis. Based on this, the electronic device can determine the number of videos that can be generated for each scene card.

[0012] Optionally, determining the first number includes determining that the number of available rules included in the first scenario card is the first number. The available rules included in the first scenario card are rules whose available image sets are not empty among all rules configured corresponding to the first scenario card.

[0013] Optionally, determining the second number includes: determining that the number of available rules included in the second scenario card is the second number. The available rules included in the second scenario card are rules whose available image sets are not empty among all rules configured corresponding to the second scenario card.

[0014] Optionally, the first number is not 0. The prompt statement of the first scene card is the same as the name of the first display column. The first display column corresponds to a first rule, which is the rule with the largest number of corresponding available images among all available rules of the first scene card.

[0015] Optionally, the background image of the first scene card is a preset image. Exemplarily, the background image displayed in the scene card can be a preset image.

[0016] Optionally, the first interface also includes a third scenario card. The method further includes: receiving a second operation, the second operation being an operation on the third scenario card, the second operation being used to instruct the electronic device to display details of the third scenario card; and displaying a second interface. The second interface includes at least one display column, each display column corresponding to a rule configured on the third scenario card.

[0017] Therefore, combined with the relevant interaction example of the third scene card, further relevant display and interaction implementation of each display column within the scene card is provided.

[0018] Optionally, the at least one display column included in the second interface includes a second display column and a third display column. The second display column is displayed before the third display column. The number of available images corresponding to the rule for the second display column is greater than the number of available images corresponding to the rule for the third display column. In this way, the electronic device can display each display column in sequence based on the number of available images corresponding to the display column.

[0019] Optionally, before displaying the second interface, the method further includes: determining a name for the second display column based on the labels of the available images in the second display column. In this example, the electronic device may also generate the name for the display column based on at least one label of the available images corresponding to each display column and a preset sentence format. The name of the display column may also be used to replace the prompt sentence displayed on the scene card.

[0020] Optionally, the second interface includes a fourth display column. The fourth display column is a preconfigured display column for the third scenario card. In this way, when it is impossible to obtain available images for each rule, or when all available images for each rule are empty, the electronic device can display the display column according to a preset display mechanism.

[0021] Optionally, before displaying the second interface, the method further includes: determining that the available set images of each rule in the third scene card are empty.

[0022] Optionally, the image displayed in the fourth display column is the same as the background image displayed in the third scene card.

[0023] Optionally, the method further includes: receiving a third operation, the third operation being an operation on the fourth display column. In response to the third operation, displaying a third interface. The third interface includes a fifth display column. The set of available images corresponding to the rule of the fifth prompt column is not empty. Thus, when the display column clicked by the user cannot be formed into a picture, the electronic device can display the fifth display column to show the user other display columns that can be formed into a picture for selection.

[0024] Optionally, the method further includes: receiving a third operation, the third operation being an operation on the fourth display column. In response to the third operation, displaying a fourth interface. The fourth interface includes a first prompt message, the first prompt message being used to prompt the user to capture an image. Prior to receiving the third operation, the set of available images that determines the rule for the scene is empty. Thus, the electronic device can prompt the user, through the first prompt message, to capture more images, so as to implement the sorting and display of scenes and display columns according to the above solution.

[0025] Optionally, the display priority of the first scene card preconfigured by the electronic device is higher than the display priority of the second scene card. After displaying the first interface, the method also includes: receiving a fourth operation, the third operation is an operation on the fourth scene card, and the fourth operation is used to instruct the electronic device to display the details of the fourth scene card. The fourth scene card is displayed in the first interface. In response to the fourth operation, the fifth interface is displayed. The fifth interface includes a sixth display column. The sixth display column is a preconfigured display column for the fourth scene card. This solution provides a display logic for a case where CV analysis has not yet been performed. For example, scene pictures are displayed in a preset order. For another example, after the user clicks on a scene picture, the electronic device can display a preset display column on the interface.

[0026] Optionally, the method also includes: receiving a fifth operation, which is an operation on the sixth display column. In response to the fifth operation, a second prompt message is displayed, and the second prompt message is used to prompt the user to trigger the smart image recognition processing. The smart image recognition processing includes: determining the attribute information of each image, and the attribute information includes information of at least one of the following dimensions: character attributes, location attributes, time attributes, and event attributes. According to the attribute information of the image, at least one label is marked for the image, and the label of the image corresponds to the attribute information of the image. For each rule in each scene card, a set of available images that matches the rule is determined. Each scene is configured with at least one rule, and each rule is configured with at least one label. Thus, an entry for triggering CV analysis is provided to the user, such as the second prompt message. In other implementations, the second prompt message may also include components such as function buttons.

[0027] Optionally, the first interface also includes a fifth scene card. The fifth display card is displayed before the first scene card. Before displaying the first interface, the method further includes: receiving a first push message, the first push message including a background image, a card theme, and a prompt statement of the fifth scene card. This example provides display logic for receiving a scene card pushed by a cloud server before an electronic device displays a scene image. For example, the scene card pushed by the cloud server can be displayed at the top.

[0028] Optionally, after displaying the first interface, the method further includes: receiving a sixth operation, the sixth operation being used to instruct the electronic device to display the details of the fifth scene card. In response to the sixth operation, a sixth interface is displayed, the sixth interface including a seventh display column preconfigured for the fifth scene card. A seventh operation is received, the seventh operation being an operation on the seventh display column. In response to the seventh operation, at least one image corresponding to the seventh display column is acquired. A seventh interface is displayed, the seventh interface including an image corresponding to the seventh display column. When a user clicks on a scene card pushed by a cloud server, the electronic device can obtain the display column corresponding to the card and the image information corresponding to the display column from the cloud server. This allows users to quickly acquire popular scene cards and images on the Internet.

[0029] In a second aspect, the present application further provides an electronic device comprising: a display screen, a memory, and one or more processors. The display screen, the memory, and the processor are coupled. The memory is used to store computer program code, which includes computer instructions. When the processor executes the computer instructions, the electronic device executes the technical solution provided in the first aspect and any possible implementation thereof. For example, the electronic device controls the display screen to display an interface according to the first aspect and any possible design thereof.

[0030] In a third aspect, the present application further provides a chip system, which is applied to an electronic device. The chip system may include one or more interface circuits and one or more processors. The interface circuit and the processor are interconnected via a circuit. The interface circuit is configured to receive a signal from the memory of the electronic device and send the signal to the processor. The signal includes computer instructions stored in the memory. When the processor executes the computer instructions, the electronic device implements the technical solution provided in the first aspect and any possible implementation thereof.

[0031] In a fourth aspect, the present application also provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the technical solution provided in the above-mentioned first aspect and any possible implementation thereof.

[0032] In a fifth aspect, the present application also provides a computer program product, which, when running on a computer, enables the computer to execute the technical solution provided in the above-mentioned first aspect and any possible implementation thereof.

[0033] It can be understood that the solutions provided in the second to fifth aspects of the present application can respectively correspond to the first aspect and any possible design thereof, so the beneficial effects that can be achieved are similar and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] FIG1 is a schematic diagram of an interface display provided in an embodiment of the present application;

[0035] FIG2 is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application;

[0036] FIG3 is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application;

[0037] FIG4 is a schematic diagram of the composition of a scene card provided in an embodiment of the present application;

[0038] FIG5 is a schematic diagram of a scene card provided in an embodiment of the present application;

[0039] FIG6 is a logic diagram of an interface interaction provided by an embodiment of the present application;

[0040] FIG7 is a logic diagram of an interface interaction provided by an embodiment of the present application;

[0041] FIG8 is a logic diagram of an interface interaction provided by an embodiment of the present application;

[0042] FIG9 is a logic diagram of an interface provided in an embodiment of the present application;

[0043] FIG10 is a logic diagram of an interface interaction provided by an embodiment of the present application;

[0044] FIG11 is a logic diagram of an interface interaction provided by an embodiment of the present application;

[0045] FIG12 is a logical diagram of the interaction between an electronic device and the cloud provided in an embodiment of the present application;

[0046] FIG13 is a logic diagram of an interface interaction provided by an embodiment of the present application;

[0047] FIG14 is a schematic diagram of the composition of an electronic device provided in an embodiment of the present application;

[0048] FIG15 is a schematic diagram showing the composition of a chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of the technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of this embodiment, unless otherwise specified, "plurality" means two or more.

[0050] Currently, the shooting function has become one of the most frequently used functions in electronic devices.

[0051] The user can use the electronic device to capture images, and the electronic device can store the captured images in a memory.

[0052] In this application, electronic devices can also perform processing based on stored images to provide users with a richer and more intelligent experience. The stored images may include photos taken by the electronic device and / or images obtained through other means. For example, images obtained through other means may include images obtained from the Internet, other electronic devices, or other applications.

[0053] In the following examples, it is taken that the images stored in the electronic device include photographs taken.

[0054] For example, in some embodiments of the present application, the stored image may be processed based on CV processing capabilities configured in the electronic device. CV processing may also be referred to as CV analysis.

[0055] In this example, the electronic device can use this CV processing capability to perform CV processing such as recognition, classification, and learning on the captured and stored photo images. This CV processing capability can also be called intelligent image recognition capability.

[0056] In other embodiments, the electronic device may also generate corresponding video files based on the captured and stored images through CV processing.

[0057] In other embodiments, the electronic device may also be configured with an application or software module that can call CV processing capabilities. For example, in some implementations, the electronic device can call CV processing capabilities through the gallery application configured therein to implement the above-mentioned CV processing-related operations. In other implementations, the electronic device can call CV processing capabilities through a software module configured therein (such as a middle platform module). Among them, the configuration of the middle platform module in the electronic device can be configured in the form of a system application, or in the form of a software module configured in the framework layer.

[0058] In addition, other applications (such as smart assistant applications) can be configured in the electronic device. Based on the results obtained by the above-mentioned CV processing and the pre-configured interaction logic, different interfaces are displayed to the user on the display screen of the electronic device according to the results of the CV processing and the operations input by the user.

[0059] Take for example a user instructing an electronic device to generate a video file based on an existing image.

[0060] Based on the results of the CV processing, the electronic device determines which video files can be generated from the current image. The electronic device can also assign a display priority to each video file based on a pre-configured rule file. Thus, the higher the display priority, the closer the corresponding video file is to the front of the display column on the display screen.

[0061] In addition, the electronic device can also map different video files to scene cards. Each scene card can correspond to one or more generative video files. In this way, the electronic device can also display multiple scene cards to the user on the display screen based on the CV processing results. This allows the user to quickly browse and identify the type of video they want to generate through the scene cards. In some implementations, the electronic device can also configure corresponding display priorities for each scene card based on preconfigured rules. Therefore, the higher the display priority, the closer the card is to the front of the interface.

[0062] In addition, in the present application, the electronic device may also be configured with display logic when there is no video file that can be generated.

[0063] It should be noted that in the embodiments of the present application, the scene cards or thumbnails in each interface can be displayed with corresponding pictures. In the following description, pictures are replaced with text for illustration. For example, pictures preset in an electronic device or obtained from the cloud can be replaced with "image" + "number" such as image 1. For another example, pictures in the gallery application of an electronic device can be replaced with "image" + "letter" such as image a.

[0064] As an example, refer to FIG1 , which shows two examples of interfaces provided in an embodiment of the present application.

[0065] As shown in interface 11 in Figure 1, multiple scene cards can be displayed to the user on this interface. For example, the multiple scene cards may include cards corresponding to different scenes such as "Daily Vlog", "Personal Portrait", "Family Photo", "Cute Pets", "Travel Vlog", and "Growth Theme". Before displaying these scene cards, the electronic device can configure corresponding display priorities for different scene cards according to the solution provided in the embodiment of the present application. It can be understood that the determination of the display priority is related to the image that can currently generate a video file. Therefore, the display priority can be better matched to the current user's usage habits. Therefore, the interface 11 displayed based on the display priority can make it easier for users to find the scene they want to generate a video on the interface.

[0066] As shown in the interface 12 in Figure 1, in the present application, the electronic device can also show the user the display columns that can generate video files in any scenario. In the example of Figure 1, the maximum number of display columns that can generate video files displayed on the display screen is 3 as an example. The display of the display column can also be achieved after the electronic device performs CV processing and sorts the various video files according to the CV processing results. In this way, the user can more conveniently determine the video files that can be generated at present on the interface 12. And because the display order of each display column can correspond to the current existing image, the display column displayed in a more forward position can be more in line with the user's habits, further improving the ease of use in the scenario of generating videos based on images.

[0067] The following will be combined with the accompanying drawings to describe in detail the acquisition mechanism, display mechanism, and interaction logic between each interface (such as interface 11 and interface 12 shown in FIG1 ) in the solution provided in the embodiment of the present application.

[0068] It should be noted that in the embodiments of the present application, the electronic device may include at least one of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device, or a smart city device.

[0069] The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device.

[0070] In some embodiments, the electronic device may include a processor, an external memory interface, an internal memory, a universal serial bus (USB) connector, a charging management module, a power management module, a battery, antenna 1, antenna 2, a mobile communication module, a wireless communication module, an audio module, a speaker, a receiver, a microphone, an earphone jack, a sensor module, a button, a motor, an indicator, a camera module, a display, and a subscriber identification module (SIM) card interface, etc. The sensor module may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0071] In this example, the processor may include one or more processing units, for example, the processor may include an application processor (AP), a modem processor (Modem), a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor (BP or BBP), and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0072] The processor can generate operation control signals based on instruction opcodes and timing signals to complete the control of instruction fetching and execution.

[0073] The processor may also include a memory for storing instructions and data. In some embodiments, the memory in the processor may be a cache memory. This memory can store instructions or data that have been used by the processor or that are frequently used. When the processor needs to use the instruction or data, it can directly access it from the memory. This avoids duplicate accesses, reduces processor latency, and thus improves system efficiency.

[0074] It should be noted that the structures illustrated in the above embodiments do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components, or combine or separate certain components, or arrange the components differently. Any component in the above embodiments may be implemented in hardware, software, or a combination of software and hardware.

[0075] Exemplarily, a touch panel (TP) may also be configured in the electronic device. The touch panel may be used to receive touch operations from the user. For example, the touch operations may include sliding, clicking, and other operations. In some implementations, the touch panel may be coupled to a display screen. Thus, the user may input touch operations based on the interface image displayed on the display screen. Correspondingly, the touch panel may generate corresponding operation information based on the touch operation, and the operation information may include location information, type information, and the like of receiving the touch operation. Thus, the electronic device may respond accordingly based on the currently displayed image and the operation information.

[0076] It should be noted that the above example provides an example of a hardware composition of an electronic device. In an embodiment of the present application, a software composition of an electronic device is also provided.

[0077] For example, refer to FIG2 , which is a schematic diagram of the software composition of an electronic device provided in an embodiment of the present application.

[0078] In this application, the electronic device may have a layered architecture. The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, The system is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime (ART) and native C / C++ library, hardware abstraction layer (HAL) and kernel layer.

[0079] The application layer may also be referred to as the application layer or the APP layer. The application layer may include a series of application packages.

[0080] As shown in Figure 2, the application package may include applications such as gallery, calendar, map, WLAN, music, SMS, call, navigation, Bluetooth, video, etc. As shown in Figure 2, in this application, the application package in the electronic device may also include a smart assistant application.

[0081] In this application, electronic devices can implement the interaction and display logic between various interfaces by running the smart assistant application. The details will be detailed later.

[0082] The application framework layer, also known as the framework layer, provides an application programming interface (API) and programming framework for applications in the application layer. The framework layer includes some predefined functions.

[0083] As shown in Figure 2, the framework layer may include a window manager, a content provider, a view system, a resource manager, a notification manager, an activity manager, an input manager, a middle platform module, etc.

[0084] The window manager provides window management services (WMS). WMS can be used for window management, window animation management, surface management, and as a transfer station for the input system.

[0085] Content providers are used to store and retrieve data and make it accessible to applications. This data can include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0086] The view system includes visual controls, such as those for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views. For example, a display interface containing a text notification icon might include a view for displaying text and a view for displaying images.

[0087] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0088] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads and message reminders. The Notification Manager can also display notifications in the top status bar of the system as icons or scrolling text, such as notifications from background applications, or as dialog windows on the screen. Examples include text messages in the status bar, beeps, vibrations on electronic devices, and flashing indicator lights.

[0089] The Activity Manager can provide Activity Management Service (AMS), which can be used to start, switch, and schedule system components (such as activities, services, content providers, and broadcast receivers) as well as manage and schedule application processes.

[0090] The Input Manager provides Input Management Service (IMS), which manages system inputs, such as touch screen input, key input, and sensor input. The IMS retrieves events from input device nodes and, through interaction with the WMS, distributes the events to the appropriate window.

[0091] The middle platform module configured in the framework layer can be used to support the CV processing capabilities involved in the above embodiments.

[0092] The Android runtime consists of the core libraries and the Android runtime. The Android runtime is responsible for converting source code into machine code. It primarily utilizes ahead-of-time (AOT) and just-in-time (JIT) compilation technologies.

[0093] The core library is mainly used to provide basic Java class library functions, such as basic data structures, mathematics, IO, tools, databases, networks, etc. The core library provides an API for users to develop Android applications.

[0094] Native C / C++ libraries can include multiple functional modules, such as surface manager, media framework, libc, OpenGL ES, SQLite, Webkit, etc.

[0095] The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media framework supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library supports a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG. OpenGL ES provides 2D and 3D graphics drawing and manipulation within applications. SQLite provides a lightweight relational database for electronic device applications.

[0096] The hardware abstraction layer runs in user space, encapsulates kernel layer drivers, and provides a calling interface to the upper layer. Exemplarily, the hardware abstraction layer may include a display module, an audio module, a camera module, a Bluetooth module, etc.

[0097] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and Bluetooth driver.

[0098] It should be noted that the software composition shown in FIG. 2 is merely an example and does not constitute a limitation on the electronic device in the embodiments of the present application.

[0099] In other embodiments, the electronic device may also have other components.

[0100] For example, refer to FIG3 , which is a schematic diagram of the composition of another electronic device provided in an embodiment of the present application.

[0101] In the example shown in Figure 3, the software layer (such as the application layer and the framework layer) in the electronic device is shown, and the hardware configuration (such as the hardware layer) in the electronic device is also shown. Therefore, the solution provided by the embodiment of the present application is realized by cooperating with the software layer and the hardware layer as shown in Figure 3.

[0102] As shown in FIG3 , the application layer may include smart assistant applications, gallery applications, etc.

[0103] A middle platform module can be configured in the framework layer.

[0104] The hardware layer may include a memory and a display touch module. Among them, the memory can be used to provide storage capacity. In the present application, when the user has taken a photo through an electronic device, images P1, P2, etc. maintained by the gallery application may be stored in the memory. The display touch module may be composed of a display screen, a touch panel, and respective corresponding drive modules. In this way, the display touch module can be used to receive the user's touch operation, and the corresponding drive module of the touch panel transmits the operation information upward to the application layer, and the corresponding application responds. The display touch module can also display according to the image sent from the upper layer when the application instructs the electronic device to display an image. For example, the interface 11 or interface 12 shown in Figure 1 is displayed.

[0105] In the embodiment of the present application, the images maintained by the gallery application may also be referred to as images in the gallery application, or images in the gallery, or images stored in the gallery.

[0106] The solution provided in the embodiments of the present application can be applied to the electronic device shown in FIG. 2 or FIG. 3 .

[0107] Taking the electronic device shown in FIG3 as an example, the process of performing CV analysis on the electronic device is described.

[0108] For example, in some embodiments, the CV analysis can be performed by the middle platform module in conjunction with the gallery application. In other embodiments, the triggering and / or execution process of the CV analysis can also be participated in by the smart assistant.

[0109] This application will explain in detail how to trigger CV analysis in the subsequent interface interaction. Here we briefly introduce the execution process of CV analysis.

[0110] When an electronic device performs CV analysis, the middle platform module can obtain all current images from the image library. Correspondingly, the image library can send the storage address of images such as image P1 and image P2 in the memory to the middle platform module. As a result, the middle platform module can obtain each image from the storage address.

[0111] In this application, CV analysis may include: image analysis, label configuration, display column name generation, display priority determination and other processes.

[0112] Exemplarily, the middle platform module may perform image analysis on each of the multiple images, thereby obtaining attribute information of each image.

[0113] In this application, the attribute information of an image may include information in at least one of the following four dimensions:

[0114] Person attributes, location attributes, time attributes, and event attributes.

[0115] Corresponding to each attribute information, the middle platform module can configure corresponding labels for the image. For example, through image analysis, when the image includes one or more specific attributes of the person's attributes, the middle platform module can configure the label of the corresponding attribute for the image.

[0116] Take character attributes as an example.

[0117] In some embodiments, character attributes may include individual character attributes, collective character attributes, and combined character attributes.

[0118] Among them, individual character attributes may include: individual, myself, lover, husband, wife, grandfather, grandmother, father, mother, etc.

[0119] In this way, through image analysis, the middle platform module can assign the corresponding person attributes to the image when the image includes any one or more of the above-mentioned individual person attributes. For example, through image analysis, it is determined that the person attribute "I" is included in image P1. Then, the middle platform module can assign the label "I" to this image P1.

[0120] General character attributes may include: child, son, daughter, family member, close friend, etc.

[0121] In this way, through image analysis, the middle platform module can assign the corresponding character attributes to the image when the image includes any one or more of the above-mentioned character attributes. For example, through image analysis, it is determined that the character attribute "child" is included in image P2. Then, the middle platform module can assign the label "child" to image P1.

[0122] The collective attributes of characters may include: a family, a family of three, etc.

[0123] In this way, through image analysis, the middle platform module can configure the corresponding character attributes for the image when the image includes any one or more of the above-mentioned character attributes. For example, through image analysis, it is determined that image P2 includes the character attribute of "family". Then, the middle platform module can configure the label "family" for image P1.

[0124] It is understandable that for the same image, the assigned character attribute labels can be one or more. For example, after image analysis of image P2, the labels "child" and "family" can be assigned to image P2. If the image does not include any of the above character attributes, the middle platform module may not assign character labels to the current image.

[0125] Take the location attribute as an example.

[0126] In some embodiments, location attributes may include specific attributes, general attributes, and the like.

[0127] Among them, specific attributes may include: hometown, local area, etc.

[0128] In this way, through image analysis, the middle platform module can assign the corresponding location attribute to the image when the image includes any one or more of the above-mentioned specific attributes. For example, through image analysis, it is determined that image P1 includes the specific attribute of "hometown". Then, the middle platform module can assign the label "hometown" to image P1.

[0129] The general attributes may include: locality, city, etc.

[0130] The region corresponds to the clustering result of multiple pre-configured regions. For example, the regions include region L1, region L2, region L3, etc. The city corresponds to the clustering result of multiple pre-configured cities. For example, the regions include city C1, city C2, etc.

[0131] Thus, through image analysis, the middle platform module can assign the corresponding location attribute to the image when the image includes any one or more of the above-mentioned general attributes. For example, through image analysis, it is determined that the location attribute of "city C1" is included in image P2. Then, the middle platform module can assign the label "city C1" to image P2.

[0132] Similar to the configuration of person tags, for the same image, one or more location tags can be configured based on the specific image analysis results. Alternatively, if the current image does not correspond to any of the above location attributes, no location attribute tag will be configured for the image.

[0133] Take the time attribute as an example.

[0134] In some embodiments, character attributes may include relative time periods, important holidays, birthdays / anniversaries, and other attributes.

[0135] The relative time period attributes may include: today, yesterday, weekend, last week, this year, the last three years, spring, summer, autumn, winter, etc.

[0136] Thus, through image analysis, the middleware module can assign a label with the corresponding time attribute to the image when the image's shooting time corresponds to any one or more of the above time attributes. For example, if image analysis determines that image P1 was taken yesterday afternoon, the middleware module can assign labels such as "Yesterday," "This Year," or "Last Three Years" to image P1.

[0137] The important holiday attributes may include: the time periods of New Year's Day, New Year's Eve, Spring Festival, etc. It is understandable that the time periods included in the corresponding important holiday attributes may vary depending on the user's current location.

[0138] In this way, through image analysis, the middleware module can assign a label with the corresponding time attribute to the image when the image's shooting time corresponds to any one or more of the above-mentioned important holiday attributes. For example, through image analysis, if it is determined that image P2 was taken during the Spring Festival, the middleware module can then assign a "Spring Festival" label to image P1.

[0139] The birthday / anniversary attribute can correspond to a specific date that has been configured. The birthday / anniversary attribute can include an absolute point in time for the validity period, such as a wedding anniversary, graduation anniversary, birthday, etc.

[0140] Thus, through image analysis, the middleware module can assign a label with the corresponding time attribute to the image when the image's shooting time corresponds to any one or more of the above-mentioned birthday / anniversary attributes. For example, if image analysis determines that image P1 was taken on a graduation anniversary, the middleware module can assign a "Graduation Anniversary" label to image P1.

[0141] Furthermore, event attributes can be preconfigured in electronic devices. For example, events such as going on a trip, going to the park, and going to exercise can be included. Thus, during image analysis, if an image contains elements corresponding to an event (e.g., the location of a park, park scenery, or images containing running postures or swimming scenes), the corresponding event tag can be assigned to the image.

[0142] In this way, by analyzing the CV of all existing images, the middle platform module can configure a corresponding label for each image. The label can correspond to the attribute information of the image.

[0143] In an embodiment of the present application, the middle platform module can also aggregate one or more images together based on the labels of the configured images and according to preconfigured rules to form an image set that matches the current rules.

[0144] Exemplarily, each of the preconfigured rules may correspond to at least one tag, and each rule corresponds to a generative video scene.

[0145] For example, rule R1 corresponds to label 1, label 2, and label 3. In this way, images configured with label 1, label 2, and label 3 can be aggregated into image set 1. Image set 1 can correspond to rule R1.

[0146] Thus, the electronic device can generate a video file corresponding to the video scene of the rule R1 according to the image set 1.

[0147] As a specific example, the preconfigured regular video scenes may include: videos of children traveling, videos of weekend trips, videos of family gatherings, videos of team-building dinners, a collection of this year's scenery, a collection of scenery of city C1, etc.

[0148] As a result, the middle platform module can aggregate images whose person attributes include "child" and whose event attributes include "travel" to obtain the image set corresponding to the rule of "video of children traveling". Other similar examples are not repeated here.

[0149] In this way, the middle platform module can obtain the image set corresponding to each configured rule based on the currently stored images.

[0150] It is understood that since the image set is obtained based on the labels of each image and the matching of rules, in some embodiments, the number of images in the image set corresponding to different rules may be different. In other embodiments, there may be a situation where some or all rules do not have a matching image set.

[0151] In this application, after obtaining the image set corresponding to each rule, the middle platform module can also fill it in according to the preconfigured statement style and the labels of the images in the image set to obtain the display column name corresponding to the rule when it is displayed on the display screen.

[0152] For example, let's take the rule for a video scene of a child traveling. The pre-configured sentence pattern can be: "Generate" + character attribute + event attribute + "video". Therefore, the middle platform module can fill in the sentence pattern based on the fact that all images in the current image collection are configured with the character attribute of "child" and the event attribute of "travel", and obtain the display column name of "Generate video of child traveling".

[0153] Similarly, the middle platform module can generate corresponding column names for the rules of all current non-empty image sets (i.e., including available images).

[0154] In addition, in this application, the display priority corresponding to each rule can also be configured in the middle platform module.

[0155] In conjunction with the description in FIG1 , in some embodiments of the present application, the display priority corresponding to each rule may be the display priority of each rule in the same scene card.

[0156] For example, the rules configured in scenario card 1 include rule 1, rule 2, rule 3, rule 4, rule 5, rule 6, etc.; the display priorities of rules 1 to 6 decrease in sequence.

[0157] For the multiple rules including available images in rules 1 to 6, N rules that need to be displayed on top of the interface are determined according to the display priority. For example, N can be configured as 3.

[0158] For example, rule 2, rule 3, rule 4, and rule 5 include available images, while rule 1 and rule 6 do not include available images.

[0159] In this way, the middle platform module can determine that when the user views the details of scene card 1 for the first time, the corresponding display columns will be displayed in the order of rule 2, rule 3, and rule 4. The display column of rule 5 will not be displayed this time.

[0160] In some embodiments, when the user views the details of scene card 1 for the second time, since rule 2 has been displayed at the top and there are display columns for other rules that have not yet been displayed, the middle platform module can determine to display the corresponding display columns in the order of rule 3, rule 4, and rule 5.

[0161] In other cases, if the number of rules including available images in scene card 1 is less than N, the middle platform module can display all display columns including rules including available images in sequence according to display priority when it needs to show the details of scene card 1 to the user.

[0162] By analogy, for other card scenarios, the middle platform module can also use a similar mechanism to determine the order in which columns are displayed when the user needs to view the corresponding details.

[0163] It should be noted that the above description of the display order of display columns corresponding to the rules in each card scene is based on the example that each card scene includes at least one rule including an available image.

[0164] In other cases, there are also cases where all the rules in some scenario cards do not include available images. The display mechanism in this case will be explained later.

[0165] Therefore, through the above implementation, the middle platform module can determine the display mechanism of each display column in the interface when the user needs to view the details of any scene card.

[0166] In other embodiments of the present application, the middle platform module can also determine the display order of each scene card on the interface 11 based on the above processing mechanism.

[0167] For example, the middle platform module can configure the scene card with the largest number of rules including available images among all scene cards as the scene card with the highest display priority. Correspondingly, the lower the display priority, the smaller the number of rules including available images.

[0168] It is understandable that a rule comprising available images can correspond to a generative video file. Like this, the more rules comprising available images there are, the more the quantity of the video files that can be generated will be corresponding to the scene card.

[0169] Therefore, by displaying the scene cards that can generate more video files at a more forward position, the user can more conveniently find the scene cards that can generate rich video files on the interface 11.

[0170] In the following description, a rule that includes available images is referred to as an available rule. The display section corresponding to an available rule is referred to as an available display section. That is, for any available display section, the electronic device stores at least one image that matches the rule for that display section, and based on this, a video file corresponding to that display section can be generated.

[0171] In this way, through the above functional description of the middle platform module, in the embodiment of the present application, the middle platform module can cooperate with the gallery application to determine the display order of each scene card, the display order of each display column in each scene card, and the name of the display column.

[0172] In some embodiments of the present application, each scene card may be pre-configured in the electronic device.

[0173] Exemplarily, referring to FIG4 , an example of display elements of a scene card in an embodiment of the present application is provided.

[0174] Take the scenario card named "Growth Theme" as an example. The display elements of this scenario card may include a background image, a card theme, and a prompt statement.

[0175] The background image (such as image 6) and the card theme (such as "Growth Theme") may be pre-configured in the electronic device. The background image and the card theme may have a one-to-one correspondence. For different scene cards, the displayed background card and card theme may be different.

[0176] In this example, due to the pre-configured nature of the background image and card theme, when the images maintained by the gallery application are different (such as on different electronic devices), the background image corresponding to the same card theme can remain consistent.

[0177] In the example shown in FIG4 , the display of the prompt statement may include two situations:

[0178] In the case that the scene card does not include an available display column, the prompt statement is displayed as a preset prompt statement corresponding to the current card theme.

[0179] In the case that the scene card includes available display columns, the prompt statement is displayed as the name of the display column with the highest display priority among all display columns (that is, the name of the rule with the highest display priority).

[0180] For example, take the scenario card of the “growth theme” as shown in FIG4 .

[0181] In the case that the scene card does not include available display columns, the prompt statement in the scene card of the growth theme in the interface 11 can be displayed as the pre-configured "Make a happy growth video".

[0182] In the case where the scene card includes available display columns, for example, the name of the display column with the highest display priority is "Make a video of the child and the father playing". Then, in the scene card of the growth theme in the interface 11, the prompt sentence can be adjusted to "Make a video of the child and the father playing".

[0183] The display mechanism of other scene cards on interface 11 is similar.

[0184] In some embodiments of the present application, a plurality of scene cards may be pre-configured in the electronic device.

[0185] For example, as shown in FIG5 , there are some examples of scene cards. In this example, the scene cards may include:

[0186] The background image is Image 1, the card theme is "Daily Vlog", and the pre-configured prompt is "Record the details of daily life" scene card;

[0187] The background image is Image 2, the card theme is "Personal Photo", and the pre-configured prompt is "Generate a Personal Photo Collection Video" scenario card;

[0188] The background image is Image 3, the card theme is "Family Photo", and the pre-configured prompt is "Generate Family Photo Video" scenario card;

[0189] The background image is Image 4, the card theme is "Cute Pets", and the pre-configured prompt is "Create a video of your pet's cute moments" scene card;

[0190] The background image is Image 5, the card theme is "Travel Vlog", and the pre-configured prompt is "Generate my travel video" scenario card;

[0191] The background image is Image 6, the card theme is "Growth Theme", and the pre-configured prompt sentence is a scene card: "Make a Happy Growth Video";

[0192] The background image is Image 7, the card theme is "Daily Party", and the pre-configured prompt is "Make a video of a happy party" scene card;

[0193] The background image is Image 8, the card theme is: "Hobbies and Interests", and the pre-configured prompt sentence is a scene card of "Make My Performance Video".

[0194] In some implementations, 27 or more scene cards may be configured in the electronic device.

[0195] In this way, combined with the above functional description of the middle platform module, the middle platform module can, when performing CV analysis, for each card theme of the configuration, each rule in each card theme, and the corresponding image set. The middle platform module can also generate corresponding display column names for available rules. The middle platform module can also determine the display priority of each available rule. The middle platform module can also determine the display priority of each card theme, as well as the prompt statement of each card theme.

[0196] It should be noted that, in an embodiment of the present application, the execution of CV analysis by the middle platform module can be based on user triggering, or based on pre-configured policy triggering. For example, the pre-configured policy may include: the time is in a preset time period (such as between 0 and 2 in the morning), and / or the electronic device is charging, and / or the electronic device enters a sleep state for more than 30 minutes, and / or the time since the last CV analysis has reached a preset time length, etc. In other embodiments, the processing capability of the CV analysis can also be implemented by other functional modules or applications. For example, the processing capability of the CV analysis can be integrated into a gallery application, or integrated into a smart assistant application, etc.

[0197] Based on the above functions performed by the middle platform module, the electronic device can accurately display the interface 11 and the interface 12 shown in FIG. 1 according to the various information determined by the middle platform module.

[0198] In the following description, the smart assistant application in the electronic device interacts with the middle platform module and / or the gallery application to realize the display of each interface after the user inputs the corresponding operation. The interactive switching logic of each interface in the embodiment of this application is described in detail. The electronic device is taken as an example of a mobile phone.

[0199] In different embodiments of the present application, the smart assistant application can be triggered to run in different ways.

[0200] For example, referring to Figure 6, which is a schematic diagram of the interface interaction logic provided by an embodiment of the present application, several examples of triggering the operation of the smart assistant are provided.

[0201] In this example, it is taken that the electronic device displays a main interface (such as interface 61) as an example.

[0202] In some embodiments, a user may input a voice command to the electronic device. For example, the user may say "Hello, smart assistant" to the electronic device. In response to the voice command, the electronic device may run the smart assistant application and switch the display interface 62. In other implementations, the voice command may also be configured as other voice commands, for example, the voice command may include the name of the smart assistant.

[0203] As shown in interface 62, it is an example of an interface of a smart assistant application.

[0204] In this example, the smart assistant application can provide a variety of simulated functions with users. For example, the simulated interaction functions may include a conversation function, a recommendation function, a smart film function, a knowledge question and answer function, etc.

[0205] Correspondingly, the interface 62 may include a function bar 601. The function bar 601 may include function options corresponding to each of the above-mentioned simulation functions. When one of the function options is in an activated state, a display effect different from that of other inactivated function options may be displayed on the function bar 601. For example, in the interface 62, the dialogue function is in an activated state, and the recommendation function, the smart film function, the knowledge question and answer function, etc. are in an inactivated state. In this way, the function options of the dialogue function in the function bar 601 may be displayed with display effects such as enlarged font and bold font. In this way, the user can clearly understand the currently activated function options through the display effect of the function bar 601.

[0206] In response to the user's voice command, the smart assistant application, after running, can perform a corresponding simulated conversation function on the conversation function interface 62. For example, a conversation bar 602 is displayed on the interface 62. In the conversation bar 602, the smart assistant can display text information corresponding to the user's voice command. For example, the conversation bar 602 can display "Hello! I am your smart assistant." Thus, in this conversation function, the smart assistant can provide the user with a conversation function through the interactive display of the conversation bar.

[0207] It should be noted that, in this application, after the smart assistant application is running, a feature icon corresponding to the smart assistant application may also be displayed on the corresponding interface 62. This allows the user to know that the current smart assistant is in operation.

[0208] For example, the characteristic icon corresponding to the smart assistant may be icon 603 on interface 62. Icon 603 may be an interactive icon, and when the user inputs different operations, icon 603 may be displayed in different states accordingly. Taking the example of a user inputting a click operation to icon 603, icon 603 may be displayed as an expression state indicating "listening", thereby simulating a dialogue state with the user. Correspondingly, the smart assistant may control the electronic device to prepare to receive the operation to be input by the user, so as to facilitate a corresponding response.

[0209] In the example shown in FIG6 , another interactive example of running a smart assistant application is provided.

[0210] When the electronic device displays interface 61, the user can input an operation to trigger the running of the smart assistant application. The operation can be pre-configured. For example, the operation can be configured to press the power off button for 3 seconds.

[0211] Correspondingly, the electronic device can switch to display interface 63. On this interface 63, the electronic device can display a special icon 603 corresponding to the smart assistant application on top of interface 61 (e.g., on top of the lower half of the display screen). The display of icon 603 can indicate that the current smart assistant application has started running.

[0212] A button 604 may also be displayed on the icon 603. The button 604 is an interface display entry provided to the user. When the user wants to see the interface of the smart assistant application on the electronic device, the user can input an operation on the button 604 to achieve the purpose.

[0213] For example, the user may input an operation OP2 on the button 604. The operation OP2 may be an operation of pressing the button 604 and pulling it up. The corresponding electronic device may then switch to the dialogue function interface shown in the display interface 62.

[0214] It should be noted that in the example of Figure 6, the default display interface of the smart assistant application is the dialogue function interface (such as interface 62). In other embodiments of the present application, after the smart assistant application runs and displays the corresponding interface, the interface can also be an interface corresponding to other function options.

[0215] After the smart assistant controls the electronic device to display interface 62, the user can also instruct the electronic device to switch to displaying interfaces of other functional options through other operations on the interface.

[0216] For example, referring to FIG7 , a user instructs an electronic device to display an interface of the smart photo editing function as an example.

[0217] In some embodiments, on the interface 62 , the user may input an operation OP3 , which corresponds to instructing the electronic device to display the interface of the smart photo editing function. For example, the operation OP3 may include clicking the “Smart Photo Editing” function option in the function bar 601 .

[0218] In response to the operation OP3, the smart assistant can instruct the electronic device to switch the display interface 71. The interface 71 can be the interface of the "Smart Photo" function. In conjunction with the description in Figure 1, the interface 71 can also correspond to the interface 11 in Figure 1.

[0219] In other embodiments, the user may input an operation OP4 on the interface 62 , which corresponds to instructing the electronic device to display an interface of other functions. For example, the operation OP4 may include a left swipe operation in the dialog box 602 .

[0220] Take the example of the function bar 601 in interface 62. For example, the order in which the function options are displayed from left to right is dialogue, recommendation, smart film, and knowledge question and answer. Accordingly, the user can enter operation OP4 based on the order of the function options. For example, if you want to view the interface of the function options to the right of the currently activated function option, you can enter the left swipe operation in the current content interface (such as the dialogue bar 602 in the dialogue function).

[0221] In response to operation OP4, the smart assistant may instruct the electronic device to display the interface of the function options to the right of the currently activated function option (such as the conversation function). For example, the smart assistant may instruct the electronic device to display interface 72. Interface 72 may be an interface corresponding to the recommended function.

[0222] In this application, the recommendation function of the smart assistant can provide users with recommendations of various different types of images / videos based on local / network resources.

[0223] For example, in this example, the interface 72 of the recommendation function may include a recommendation card for "Store Exploration Video Script" (such as the background image of the recommendation card can be displayed as image 9), a recommendation card for "Friendship Growth Novels" (such as the background image of the recommendation card can be displayed as image 10), a recommendation card for "Past and Present" (such as the background image of the recommendation card can be displayed as image 11), a recommendation card for "Daily Vlog" (such as the background image of the recommendation card can be displayed as image 1), a recommendation card for "Baby's Children's Story" (such as the background image of the recommendation card can be displayed as image 12), a recommendation card for "Time Travel Science Fiction Novels" (such as the background image of the recommendation card can be displayed as image 13), etc.

[0224] It is understandable that in some implementations, at least one recommendation card included in the interface 72 of the recommendation function may come from the capabilities provided by other function options. For example, the recommendation card for "Daily Vlog" may be obtained from the capabilities of the smart filming function. In this interface 72, the recommendation card for "Daily Vlog" may be a card recommended based on local resources (such as images stored in the gallery). Based on the recommendation card for "Daily Vlog", the user may be provided with the capability entry for intelligently generating video files of the corresponding type.

[0225] It should be noted that in this application, when the smart assistant application displays the interface of different function cards, the content interface will change due to the different content that needs to be displayed. For example, in the interface 62 of the dialogue function, the content interface may include a dialogue bar 602 as shown in Figure 6. For another example, in the interface 72 of the recommendation function, the content interface may include a card display bar 701. The card display bar may include multiple recommendation cards. For another example, in the interface 71 of the smart film function, the content interface may include a card display bar 702. The card display bar may include multiple scene cards.

[0226] On this interface 72, the user can also input operation OP5 to instruct the electronic device to switch to displaying the interface of the smart photo editing function. For example, operation OP5 may include inputting a left swipe operation in the card display bar 701. It is understood that similar to the description of operation OP4, in response to operation OP5, the smart assistant application can instruct the electronic device to switch to displaying the interface of the smart photo editing function to the right of the recommendation function.

[0227] Therefore, the user can instruct the electronic device to display the interface 71 of the smart filming function by operating OP4 and operating OP5.

[0228] In the above examples, two interactive examples are provided for displaying the smart photo editing interface after entering the smart assistant interface. In other embodiments, the electronic device also provides other entrances for displaying the smart photo editing interface.

[0229] Take the electronic device displaying the main interface (such as interface 61) as an example. Interface 61 may include icons of one or more applications. Take the example of including icon 703 of the gallery application on interface 61. The user can click icon 703 to instruct the electronic device to enter the gallery application. Correspondingly, the electronic device can display the interface of the gallery application. Different functional options can be displayed in the interface of the gallery application (such as at the bottom of the interface). For example, the functional options may include photos, albums, memories, creations, etc.

[0230] In some implementations, after the gallery application is launched, an interface corresponding to the "Photo" function option may be displayed. This interface may include one or more thumbnails of the captured photos. Correspondingly, the gallery application may enter an interface 73 corresponding to the "Create" function option at the user's instruction (e.g., by clicking the Create function option).

[0231] In other implementations, after the gallery application is started, it can instruct the electronic device to display the interface 73 corresponding to the "Create" function option.

[0232] In this example, the gallery application may display an entry to the Smart Photo Editing function on interface 73. For example, a control 704 may be displayed on interface 73. This allows the user to quickly access the corresponding function interface through control 704 when they want to further process an image stored in the gallery. For example, the user may click control 704 to instruct the electronic device to display the Smart Photo Editing function interface.

[0233] In response to the operation of the click control 704, the electronic device can run the smart assistant application and display the interface 71 corresponding to the smart film-making function under the control of the smart assistant application.

[0234] In combination with the above description on CV processing and interface 11, in this application, the display of the interface 71 can be realized based on the result of CV processing.

[0235] Exemplarily, one or more scene cards may be displayed in interface 71. The composition of each scene card may refer to the description in FIG4 . For example, each scene card may include a background image, a card theme, and a prompt statement. The background image of the scene card may be a preset background image that corresponds one-to-one to the card theme. In some implementations, the prompt statement may be displayed as a pre-configured prompt statement corresponding to the card theme. In other implementations, the prompt statement may be flexibly adjusted according to the name of the display column that can generate a video file included in the current card theme.

[0236] In addition, as shown in the example of FIG5 , a plurality of scene cards may be pre-stored in the electronic device so as to be displayed when the interface of the smart filming function needs to be displayed.

[0237] In some embodiments, on the interface 71 , the display order of each scene card may correspond to the result of the CV analysis.

[0238] For example, based on CV analysis, the middle platform module can determine the number of available rules included in each scene card. The more available rules there are, the more video files can be generated corresponding to the scene card. In this way, the middle platform module can sort the scene cards from large to small according to the number of available rules included. Therefore, when the smart assistant needs to display the interface of the smart film-making function, it can obtain the sorting results of each scene card from the middle platform module and instruct the electronic device to display according to the sorting results.

[0239] In this application, two or more scene cards can be displayed in the same row. In this way, the display priority can be sorted from high to low: in the same row, the display priority decreases from left to right. In addition, in different rows, the display priority decreases from top to bottom.

[0240] Combined with the example of interface 71 in Figure 7. According to the sorting results (such as display priority) from the middle platform module, the smart assistant application can determine that the display priority of the scene card "Daily Vlog" can be higher than that of "Personal Photo". Thus, when the scene cards "Daily Vlog" and "Personal Photo" are displayed on the same line, the scene card "Daily Vlog" can be displayed on the left side of "Personal Photo". The smart assistant application can determine that the display priority of the scene card "Daily Vlog" can be higher than that of "Family Photo". Thus, when the scene cards "Daily Vlog" and "Family Photo" are displayed on different lines, the scene card "Daily Vlog" can be displayed above the "Family Photo". And so on, the smart assistant can control the electronic device to display the interface of the smart filming function according to the display priority of each scene card.

[0241] In other embodiments of the present application, on the interface 71 , the display order of each scene card may also be related to other factors.

[0242] For example, in some implementations, for scene cards with the same display priority, the middle platform module (or smart assistant application) can determine the display order of each scene card based on the number of images corresponding to all available rules included in the scene card. For example, the scene card containing more images is configured to be displayed in a higher order.

[0243] In some implementations, for scene cards with the same display priority and number of included images, the middle platform module (or smart assistant application) can determine the display order of each scene card based on the acquisition time of the images included in the scene card. For example, when an image with a later acquisition time (i.e., closer to the current moment) is included, the corresponding scene card is configured to be displayed in a higher order.

[0244] It is understandable that in other cases, the current electronic device has not performed CV analysis, or the available images for CV analysis are too few (such as less than a preset number threshold) or empty, then the middle platform module cannot obtain the CV analysis results. Correspondingly, when the smart assistant needs to display the interface of the smart film function, the middle platform module can send the pre-configured display order of each scene card to the smart assistant. Thus, the smart assistant can control the electronic device to display according to the pre-configured display order of each scene card.

[0245] In some embodiments of the present application, any one of the operations of triggering the display interface 71 as shown in Figure 7 can be referred to as the first operation. Correspondingly, the smart film-making function can be referred to as the first function. The interface 71 can be referred to as the first interface. Accordingly, the interface 71 may include a first scene card and a second scene card. The first scene card may be a scene card displayed before the second scene card. For example, the first scene card may be a "Daily Vlog" and the second scene card may be a "Personal Portrait". For another example, the first scene card may be a "Growth Theme" and the second scene card may be a scene card displayed subsequently.

[0246] The above-mentioned internal processing mechanism and interface interaction logic have been used to explain in detail the interface display of the smart film function in the embodiment of the present application. In the embodiment of the present application, an interactive display logic based on the user's operation on the scene card is also provided.

[0247] For example, refer to FIG8 , which is a logic diagram of another interface interaction provided in an embodiment of the present application.

[0248] In the example shown in FIG8 , the user can click on any scene card in the interface of the smart film function (such as interface 81 ) to trigger further processing and display related to the scene. The interface 81 may correspond to the interface 71 shown in FIG7 .

[0249] As shown in FIG8 , a user enters operation OP6 on interface 81 as an example. Operation OP6 can be a click operation on any scene card on interface 81. For example, operation OP6 can be a click operation on a scene card for the "Growth Theme" theme. In some implementations, the scene card for the "Growth Theme" theme can be referred to as a third scene card. Operation OP6 can be referred to as a second operation.

[0250] In response to operation OP6, the smart assistant application can control the electronic device to perform a corresponding interface response.

[0251] For example, in some embodiments, the smart assistant may instruct the electronic device to switch the display interface 82 in response to the user's operation OP6.

[0252] In the example of the interface 82, the intelligent assistant may present to the user a dialog box including a display column set 801. The display column set 801 may include a preset number of display columns. The preset number may also be referred to as the maximum number of display columns.

[0253] Each display column included in the display column set 801 may correspond to an available rule configured accordingly under the current scene card.

[0254] For example, the current scene card can be a "growth theme". Combined with the above description of CV analysis, the middle platform module can aggregate all images after the configuration label according to each rule in the growth theme, so as to obtain the set of available images corresponding to each rule in the growth theme. In this way, the middle platform module can determine all the available rules in the current growth theme, as well as the set of available images corresponding to the available rules. The middle platform module can also determine the name of the display column corresponding to each available rule. The middle platform module can also determine the display priority of the display columns corresponding to all available rules when displaying.

[0255] In this way, when the smart assistant needs to display the interface 82 (such as after the smart assistant receives the operation OP6), it can obtain the display columns corresponding to the growth theme and the display priority of each display column from the middle platform module.

[0256] Take the preset number of 3 as an example. The middle platform module uses CV analysis to determine that the names of the available display columns under the growth theme include: "Make a video of children playing with their father", "Generate a warm video of children and their mother", "Generate a child's growth video", etc.

[0257] In this way, the middle platform module can send the names of the three display columns and the relevant information of the available images included in each display column to the smart assistant. The middle platform module can also send the display priorities of the three display columns to the smart assistant respectively.

[0258] Correspondingly, the smart assistant can instruct the electronic device to display interface 82 as shown in Figure 8 based on the received information. Among them, the higher the display priority, the higher the corresponding display column is positioned in the display column set 801. The display column with the highest display priority in the display column set 801 can be called the first display column.

[0259] The display column set 801 in FIG8 is illustrated with reference to FIG9 .

[0260] As shown in FIG9 , a display column 901 for making a video of a child and his father playing in the display column set 801 is taken as an example.

[0261] The display column 901 may include at least an image portion 902 and a text portion 903 .

[0262] Among them, the image portion 902 can correspond to a wonderful image in the corresponding available image set (such as image set 91) of the display column 901. In some embodiments, the middle platform module can select a wonderful image (such as image a) from the image set (such as image set 91) corresponding to the current display column 901 based on the pre-configured judgment logic of the wonderful image. The middle platform module can also send the image information (such as image ID) of the wonderful image to the smart assistant so that the smart assistant can use the wonderful image as the image portion 902 when displaying the display column 901.

[0263] Similarly, the thumbnails in the display column of "Generate a heartwarming video of a child and his mother" can be wonderful images in the corresponding image combination (such as image b); the thumbnails in the display column of "Generate a video of a child's growth" can be wonderful images in the corresponding image combination (such as image c).

[0264] The text portion 903 may be displayed as the name corresponding to the display column 901. The specific method for obtaining and generating the name may refer to the aforementioned related description, which will not be repeated here.

[0265] In some embodiments, display section 901 may further include a button 904. This button 904 may be used to trigger further processing of display section 901. For example, after the user clicks button 904, the intelligent assistant may instruct the electronic device to perform video synthesis processing on the image set 91 corresponding to display section 901. This obtains the video file corresponding to image set 91, thus completing the intelligent film synthesis for image set 91.

[0266] It is understood that this is different from the display of different scene cards in the aforementioned interface 81. In the embodiment of the present application, when the CV analysis can obtain an available display column, the image portion of the display column can be replaced by a wonderful image in the corresponding image set. Rather than the background image in each scene card being displayed as a preset image.

[0267] Thus, taking the scenario example of interface 82 shown in FIG8 , after the CV analysis has been completed and the available display columns in at least one current scenario card are available, the smart assistant can control the electronic device to display each available display column. In addition, when displaying interface 81, the prompt sentence displayed under the card theme can also be replaced with the name of the display column with the highest display priority among the available display columns.

[0268] For example, as shown in interface 82, the display priority of "make a video of a child playing with his father", "make a heartwarming video of a child and his mother", and "make a video of a child's growth" is lowered in order. Thus, in interface 81, the prompt sentence of the growth theme can be displayed as "make a video of a child playing with his father".

[0269] It should be noted that in some embodiments of the present application, if there are more than three available display columns for the scene card corresponding to the user input operation OP6 (such as the scene card of the growth theme), the smart assistant can display the three available display columns with the highest display priority on the interface 82. Thereafter, after the user inputs the operation OP6 next time, the smart assistant can rotate and display all available display columns.

[0270] For example, the available display columns include display columns 1 to display columns 4, and the display priority decreases in sequence. When the user inputs operation OP6 for the first time, the smart assistant can display display columns 1 to display columns 3 on the interface 82. When the user inputs operation OP6 for the second time, the smart assistant can rotate and display other display columns on the interface 82. For example, the smart assistant can show the user display columns 2 to display columns 4 in the display column set 801 of the interface 82. In this way, after the user inputs multiple operations, he can see a variety of different available display columns on the interface 82. This enriches the user's usage options.

[0271] In addition, in conjunction with the descriptions in Figures 7 and 8, refer to Figure 10. In other embodiments of the present application, when the electronic device receives a user click operation on control 704 in the gallery application, it can directly jump to the interface that displays available display columns capable of generating videos after completing the CV analysis. For example, the smart assistant application can control the electronic device to jump from interface 73 to display interface 82, thereby improving the user's efficiency in using the smart filming function.

[0272] The above description of the switching mechanism for displaying available display columns is based on the example that the electronic device has completed the process CV analysis for the growth theme before receiving the operation OP6 and is able to obtain at least one available display column in the scene card.

[0273] In other embodiments, when the electronic device receives operation OP6 or the like for any scene card, the CV analysis has not been completed, or when it is determined through CV analysis that the scene card indicated by the operation has no available display column, the smart assistant can be configured with other display interaction logic.

[0274] For example, when the operation OP6 is received, the electronic device has completed the CV analysis; but the growth theme does not include available display columns.

[0275] As shown in Figure 8, after receiving the operation OP6, the smart assistant application can control the electronic device to switch the display interface 83. The interface 83 can include at least one recommended display column 802. The display column 802 can also be called the fourth display column.

[0276] It is understood that after receiving the user's operation OP6, the smart assistant can query the middle platform module for information about the available display columns corresponding to the growth theme indicated by the operation OP6. Correspondingly, the middle platform module can feedback to the smart assistant that after CV analysis, the available display column corresponding to the growth theme is empty, or that there is no available display column for the growth theme.

[0277] In this way, the smart assistant can display a preconfigured display column 802 corresponding to the growth theme on the switched display interface 83. For example, the display column 802 can be a preconfigured display column named "Make a video of children playing with their father." Unlike the display column shown in interface 82, the name of the display column 802 can be preconfigured, rather than generated by the middle platform module based on the available image set. In addition, the image part of the display column 802 can be displayed as a preset image (such as image 6) that corresponds to the current scene card, rather than a wonderful image in the available image set.

[0278] Therefore, by displaying the interface 83, the smart assistant can guide the user to perform further subsequent operations.

[0279] For example, the user can click on the display column 802. In response to this operation, the smart assistant can control the electronic device to switch the display interface 84. The click operation on the display column 802 can also be referred to as a third operation.

[0280] Operation information 803 may be displayed on the interface 84. The operation information 803 may correspond to the operation input by the user on the display column 802, thereby achieving a simulated dialogue effect.

[0281] The interface 84 may also include prompt content 804. In this example, the middle platform module of the electronic device has completed the CV analysis, but the scene label of the growth theme clicked by the user's operation OP6 does not include an available display column. Therefore, after the user clicks on the display column 802, the smart assistant will not show the user the video file generated corresponding to the display column 802. Correspondingly, the smart assistant can prompt the user in the prompt content 804 for other available display columns that can generate video files. Exemplarily, the prompt content 804 may include an available column 805. The available column 805 can be an available display column determined by the middle platform module after CV analysis. For example, the available column 805 can be a display column for "Generate a video of a child and mother holding hands". The available column 805 can also be called the fifth display column. In this example, the thumbnail (i.e., the image part) displayed by the available column 805 can be image d.

[0282] In this way, the user can determine according to the text reminder in the prompt content 804, such as "There are no photos available for this theme in the gallery, you can try to click on the following themes to make a film", and although it is impossible to obtain the video file corresponding to the selected "Make a video of children and father playing", the user can try to obtain the video file corresponding to the available column 805.

[0283] In the switching display mechanism from interface 81 to interface 83 to interface 84 as shown in FIG8 , the completed CV analysis is taken as an example for description.

[0284] In other embodiments, when there are not enough images in the electronic device, CV analysis cannot be performed, and corresponding recommendations cannot be displayed according to the above solution.

[0285] For example, in this case, after the user clicks on display column 802, the smart assistant application can instruct the electronic device to switch to display interface 85. This interface 85 may include a text prompt 806. This text prompt 806 may prompt the user "There are not enough usable photos in the gallery. Go take more photos and try again." This allows the electronic device to obtain more images and then reasonably sort and display them according to the above example. This interface 85 can also be called the fourth interface. The text prompt 806 can also be called the first prompt information.

[0286] In some other embodiments, when the electronic device receives the operation OP6 input by the user, the electronic device already has an image, but the CV analysis has not been completed yet.

[0287] In this case, the smart assistant application can also be configured with corresponding interaction logic to guide the user to trigger CV analysis. It is understandable that in this example, since the electronic device has not yet completed the CV analysis, the order of the various scene cards on the interface 81 displayed when receiving the operation OP6 can be displayed according to the default preset order.

[0288] For example, refer to Figure 11. Take the example of a user clicking on the display column 802 on the interface.

[0289] The smart assistant application can switch the display interface 111 after receiving the user's input of a click operation on the display column 802. In this example, the interface 111 can also include the operation information 803 shown in Figure 8, thereby realizing the experience of simulating a conversation.

[0290] The interface 111 may also include a prompt box 1101. Unlike the prompt content 804 in Figure 8, in this example, since the electronic device has not completed (or has not performed within a preset time period) CV analysis, the smart assistant application can control the electronic device to display a prompt box 1101 on the interface 111. The prompt box 1101 can be used to prompt the user that a CV analysis is required. For example, the prompt box 1101 may include a text prompt "In order to search for materials more accurately, smart image recognition is required. Please click the button below." The prompt box 1101 may also include a button 1102. The button 1102 may correspond to triggering CV analysis. For example, the button 1102 may include the text message "Start smart image recognition".

[0291] Thus, interface 111 provides the user with an entry point for triggering CV analysis. For example, a user clicking button 1102 can initiate CV analysis. This CV analysis process can include image analysis, label configuration, display column name generation, and display priority determination, as described in the above examples. The specific implementation will not be elaborated upon.

[0292] In an embodiment of the present application, when the electronic device performs CV analysis, corresponding prompt information can be displayed on the interface.

[0293] For example, in some embodiments, during CV analysis, the electronic device's gallery application may display this prompt. For example, during CV analysis, the electronic device may display a progress prompt 1103 in the gallery application's interface 112. This progress prompt 1103 may include a progress bar and text prompt information. The progress bar may be automatically generated based on the proportion of images that have completed CV processing among all images. The text prompt information may include "Intelligent clustering in progress..." to remind the user that CV analysis is currently in progress.

[0294] In other embodiments, when performing CV analysis, the current CV analysis status can also be displayed in the form of a card on the main interface of the electronic device. For example, when performing CV analysis, the electronic device can display a progress prompt card 1104 on the main interface (such as interface 113). In this example, the CV analysis can be performed by the middle platform module. However, since the CV analysis process can be based on images stored in the gallery, the text logo of the gallery can be included in the progress prompt card 1104. The progress prompt card 1104 can also include text prompt information and a progress bar. The display mechanism of the text prompt information and the progress bar can refer to the above example and will not be repeated here.

[0295] It is understandable that interface 113 provides an example of an interface during which CV analysis is in progress. After the CV analysis is completed, the card content on the interface can also be updated accordingly. For example, after the CV analysis is completed, a progress prompt card 1105 can be displayed on interface 114. The progress prompt card 1105 may include text prompts such as "Smart Image Recognition Completed" indicating that the CV analysis has been completed. In this example, the progress prompt card 1105 may also include a prompt for quickly entering the interface of the smart film function (interface 81 or interface 82 or interface 83 as shown in Figure 8). Thus, when the user clicks on the progress prompt card 1105, the electronic device can quickly pull up the smart assistant application and switch the display interface 81 or interface 82 or interface 83. Among them, the specific switching display interface 81 or interface 82 or interface 83 can be implemented according to the logic decision pre-configured in the smart assistant application.

[0296] Therefore, in the above description, the interaction examples provided in Figures 8 to 11 provide examples of interaction logic in different scenarios such as the available display columns in the scene card where CV analysis has been completed and there is a user indication, the available display columns in the scene card where CV analysis has been completed and there is no user indication, and the CV analysis has not been completed in an embodiment of the present application.

[0297] During the specific implementation process, the smart assistant application can determine whether to trigger any of the above-mentioned interaction logics for display by interacting with the gallery application or the middle platform module.

[0298] For example, after receiving the user's operation OP6, the smart assistant application can request the middle platform module to analyze the CV results of the card theme corresponding to the operation OP6.

[0299] When the CV analysis is completed and there are available display columns in the scene card indicated by the user, the smart assistant can obtain the names of the available display columns and image collection information under the scene card corresponding to the growth theme from the middle platform module, and then switch to display the interface 82 shown in Figure 8.

[0300] If the CV analysis is complete and there are no available display columns in the scenario card indicated by the user, the smart assistant can obtain information from the middle platform module that the scenario card corresponding to the growth theme does not include available display columns. As a result, the smart assistant can switch the display interface 83. Thereafter, after receiving the user's click operation on the display column 802, the smart assistant can obtain information about the currently available display columns that can be formed from the middle platform module, and then switch the display interface 84 accordingly and display the corresponding prompt content 804.

[0301] If the CV analysis is not yet completed, the smart assistant can obtain the information of the current CV analysis that has not been completed from the middle platform module. The smart assistant can then display it according to the interface interaction logic shown in Figure 11.

[0302] In the above example, after the user inputs an operation on button 1102, the electronic device can be triggered to perform CV analysis and display the current CV analysis progress (i.e., smart image recognition progress) to the user on interfaces such as interface 112 and interface 113.

[0303] In other embodiments of the present application, after the user inputs an operation on button 1102, the smart assistant application can also display the progress of the currently executed CV analysis to the user in the interactive interface of the smart film.

[0304] Exemplary. As shown in Figure 11, after the user clicks button 1102, the smart assistant application can control the switching display interface 115. In this interface 115, the smart assistant application can show the user the response after the input operation in the form of a simulated dialogue. For example, a dialogue bar 1106 can be displayed in the interface 115. The dialogue bar 1106 may include a simulated dialogue information of "Start Smart Image Recognition". The dialogue bar 1106 may correspond to the operation of the user input clicking button 1102. The interface 115 may also include a progress prompt card 1107, similar to the examples of the above-mentioned progress prompt card 1103, progress prompt card 1104, and progress prompt card 1105. The progress prompt card 1107 can also show the user the progress of the current CV analysis in the form of text information (such as smart image recognition, intelligent clustering) and a progress bar.

[0305] In addition, after the CV analysis is completed, a related prompt similar to the "Smart Image Recognition Completed" in the progress prompt card 1105 can be refreshed in the interface 115. The specific implementation will not be repeated here.

[0306] It is understandable that the above examples use the smart assistant interacting with the middle platform module to implement various interface interactions. In the case where the CV analysis capability is provided by the gallery application, the smart assistant can interact with the gallery application as described above, thereby triggering the corresponding interaction logic.

[0307] In the implementation schemes provided in Figures 7 to 11 above, the intelligent assistant can display various scene cards and display columns based on stored images (such as images stored in a library) as an example. In other embodiments of the present application, the display of the scene cards and / or display columns can also be performed in conjunction with data from a cloud server.

[0308] For example, referring to FIG12 , in some embodiments of the present application, the electronic device may be in communication with a cloud server. Thus, in different scenarios, one or more of the aforementioned pre-configured parameters (such as the background image of each scene card, the type of scene card, and the display information of the recommended column when no display column is available) can be obtained by the electronic device from the cloud server. This allows the cloud server to centrally manage the intelligent filming function of the electronic device.

[0309] In other embodiments, the CV analysis capabilities corresponding to the aforementioned mid-stage module may also be deployed in a cloud server. Thus, the smart assistant application can control the electronic device to interact with the cloud server, determine whether a CV analysis has been performed, and the relevant results after the CV analysis is completed, thereby triggering the interaction logic in each of the aforementioned embodiments.

[0310] The following describes the function of the cloud server managing electronic devices by taking the cloud server intelligently pushing scene cards to electronic devices as an example in conjunction with the example in Figure 13. In some embodiments, the cloud server can push no more than three scene cards to the electronic device at the same time.

[0311] As shown in Figure 13, in this example, the cloud server can push a scene card for "Autumn Play" to the electronic device. In some implementations, this scene card for "Autumn Play" may not be included in the multiple scene cards shown in Figure 5. The cloud server can push relevant information about the scene card for "Autumn Play" to the electronic device based on the current search volume on the network, pre-configured push tasks, etc.

[0312] For example, the relevant information of the "Autumn Outing" scene card may include the background image of the scene card, the card theme, the prompt sentence and other information.

[0313] In this way, when the smart assistant application displays the smart video interface, it can display interface 131 as shown in Figure 13. Referring to interface 81 in Figure 8, this interface 131 can include various scene images sorted according to CV analysis. This interface 131 can also include a scene card 1301 for "Autumn Play" displayed at the top. This scene card 1301 can also be called the fifth scene card. The background image of this scene card 1301 can be image 14 obtained from the cloud server.

[0314] That is, when the smart assistant application receives a scene card pushed from the cloud server when displaying the interface 131, the display priority of the scene card pushed by the cloud server can be adjusted to the highest, so as to display the scene card from the cloud server at the top.

[0315] In some embodiments, the top-displayed scene card (such as the scene card corresponding to the autumn play) can be displayed with a corresponding heat label 1302. Thus, the user can know through the heat label 1302 that the scene card corresponds to the scene information with higher heat in the current network.

[0316] For example, the user clicks on the scene card 1301 in the interface 131. The smart assistant application can control the electronic device to switch the display interface 132.

[0317] The interface 132 may include a display column set 1303. The display column in the display column set 1303 may be referred to as a seventh display column.

[0318] In some embodiments, the acquisition and display method of the display item set 1303 can refer to the display item set 801 in Figure 8. That is, the display items in the display item set 1303 can be acquired by performing CV analysis on the image of the current electronic device.

[0319] In other embodiments, the display column set 1303 may also be obtained from a cloud server.

[0320] In this example, after receiving the user's click operation on the scene card 1301 pushed by the cloud server, the smart assistant can obtain the display column of the scene card 1301 from the cloud server, and then display the display column set 1303 in the display interface 132 based on the name, image and other information of each display column obtained from the cloud server.

[0321] For example, the smart assistant app can obtain information about the following three display columns from the cloud:

[0322] The thumbnail is image 141, and the display column name is "Generate 2023 Autumn Scenery Video" which has the highest display priority;

[0323] The thumbnail is image 142, which displays a column named "Making an Autumn Weekend Camping Video" with a higher display priority;

[0324] The thumbnail is image 143, which displays a column named "Generate A Park Walking Video" with a lower display priority.

[0325] Thus, through the display column set 1303, the user can obtain the intelligent film-making function based on images on the Internet.

[0326] Take for example a user inputting a click operation on a display column in the display column set 1303 (such as the display column of “Generate 2023 Autumn Scenery Video”).

[0327] The smart assistant can refresh the current interface in response to the operation. For example, interface 133 is displayed. Interface 133 may include operation information of the user input operation (such as generating a video of autumn scenery in 2023). Interface 133 may also include prompt information 1304 and image information 1305. Interface 133 can be referred to as the seventh interface.

[0328] In some embodiments, after receiving the user input of a click operation on "Generate 2023 Autumn Scenery Video", the smart assistant can interact with the cloud server to obtain response information for the display column. For example, the smart assistant can obtain the prompt information 1304 from the cloud server as "Selected photos of the 2023 autumn scenery for you, please select one." The smart assistant can thus display the prompt information 1304 in the current content column. For another example, the smart assistant can obtain the available images corresponding to the current display column from the cloud server. Thus, the smart assistant can display image information 1305, and show the user the available images corresponding to the current display column in the image information 1305. For example, the images obtained from the cloud displayed in the image information 1305 may include: image 142, image 144, image 145, image 146, image 147, and image 148, etc.

[0329] The image information 1305 may also include operable controls, such as a "generate video" control, etc. Thus, when a user wants to obtain a video file based on the network image, he or she may click on the "generate video" control to trigger the electronic device to generate a video file based on the obtained network image.

[0330] Therefore, through the scheme interaction examples provided by the above-mentioned embodiments, electronic devices (such as smart assistant applications in electronic devices) can better provide users with an interactive experience from images to videos through interactive configurations based on different logics.

[0331] It is understandable that the electronic device provided in the embodiment of the present application includes a hardware structure and / or software module for performing each function in order to realize the above functions. Those skilled in the art should easily appreciate that, in combination with the units and algorithm steps of each example described in the embodiment disclosed herein, the embodiment of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiment of the present application.

[0332] The embodiment of the present application can divide the functional modules of the above-mentioned electronic device according to the above-mentioned method example. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0333] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of each functional module. Those skilled in the art should easily appreciate that, in combination with the units and algorithm steps of each example described in the embodiment disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in a hardware or computer software driven hardware manner depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0334] The above-mentioned integrated modules can be implemented in the form of hardware or software functional modules. It should be noted that the division of modules in the embodiment of the present application is schematic and is only a logical function division. In actual implementation, there may be other division methods.

[0335] Exemplarily, FIG14 shows a schematic diagram of the composition of an electronic device 1400. As shown in FIG14 , the electronic device 1400 may include: a processor 1401 and a memory 1402. The memory 1402 is used to store computer-executable instructions. Exemplarily, in some embodiments, when the processor 1401 executes the instructions stored in the memory 1402, the electronic device 1400 may execute any of the methods shown in the above embodiments. In an embodiment of the present application, the electronic device 1400 may also be configured with a display screen 1403, so that the processor 1400 can display different interface images to the user on the display screen 1403 based on the interaction examples provided in the above embodiments.

[0336] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0337] Figure 15 shows a schematic diagram of the composition of a chip system 1500. The chip system 1500 may include: a processor 1501 and a communication interface 1502, which are used to support related devices to implement the functions involved in the above embodiments. In one possible design, the chip system also includes a memory for storing program instructions and data necessary for electronic devices. The chip system can be composed of chips, or it can include chips and other discrete devices. It should be noted that in some implementations of the present application, the communication interface 1502 may also be referred to as an interface circuit.

[0338] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0339] The functions, actions, operations, steps, etc. in the above embodiments can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using a software program, they can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that can be integrated with the medium. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0340] Although the present application has been described with reference to specific features and embodiments thereof, it is apparent that various modifications and combinations may be made thereto without departing from the spirit and scope of the present application. Accordingly, this specification and the drawings are merely illustrative of the present application as defined by the appended claims and are deemed to cover any and all modifications, variations, combinations or equivalents within the scope of the present application. Obviously, those skilled in the art may make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus, the present application is intended to include such modifications and variations as fall within the scope of the claims of the present application and their equivalents.

Claims

1. A display method, characterized in that, Applied to an electronic device, the electronic device being configured with a display screen; the method includes: Receiving a first operation for instructing the electronic device to display an interface of a first function; the first function corresponds to generating a video file according to an image; Displaying a first interface; Wherein, the first interface corresponds to the first function, and the first interface includes at least two scene cards, and each of the scene cards is correspondingly displayed with a background picture, a card theme, and a prompt statement; In the first interface, a first scene card is displayed before a second scene card; the first scene card and the second scene card are included in the at least two scene cards; The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card; each of the available display columns corresponds to a video file that can be formed into a film, or, The display priority of the first scene card pre-configured in the electronic device is higher than that of the second scene card.

2. The method according to claim 1, wherein The number of available display columns of the first scene card is greater than the number of available display columns of the second scene card; Before displaying the first interface, the method further includes: Determining a first number of available display columns of the first scene card and a second number of available display columns of the second scene card.

3. The method according to claim 2, wherein At least one image is stored in the electronic device; Before determining the first number and the second number, the method further includes: Determining attribute information of each of the images, the attribute information including information of at least one of the following dimensions: character attribute, location attribute, time attribute, event attribute; According to the attribute information of the image, labeling at least one tag for the image, and the tag of the image corresponds to the attribute information of the image; For each rule in each scene card, determining a set of available images that match the rule; each of the scenes is configured with at least one rule, and each of the rules is configured with at least one tag.

4. The method according to claim 3, wherein The determining the first number includes: Determining that the number of available rules included in the first scene card is the first number; the available rules included in the first scene card are the rules in all the rules correspondingly configured for the first scene card for which the set of available images is not empty.

5. The method according to claim 3 or 4, wherein The determining the second number includes: Determining that the number of available rules included in the second scene card is the second number; the available rules included in the second scene card are the rules in all the rules correspondingly configured for the second scene card for which the set of available images is not empty.

6. The method according to claim 4, wherein The first number is not 0; The prompt statement of the first scene card is the same as the name of the first display column; The first display column corresponds to a first rule, and the first rule is the rule among all the available rules of the first scene card for which the number of corresponding available images is the largest.

7. The method according to any one of claims 3-6, characterized in that, The background picture of the first scene card is a preset image.

8. The method according to any one of claims 3-7, characterized in that, The first interface further includes a third scene card; The method further includes: Receive a second operation, where the second operation is an operation on a third scenario card, and the second operation is used to instruct the electronic device to display details of the third scenario card; Display a second interface; Wherein, the second interface includes at least one display column, and each display column corresponds to a rule configured for the third scenario card.

9. The method according to claim 8, wherein The at least one display column included in the second interface includes a second display column and a third display column; The second display column is displayed before the third display column; The number of available images corresponding to the rule of the second display column is greater than the number of available images corresponding to the rule of the third display column.

10. The method according to claim 9, wherein Before displaying the second interface, the method further includes: Determine the name of the second display column according to the labels of the available images in the second display column.

11. The method according to claim 8, wherein The second interface includes a fourth display column; The fourth display column is a display column of the pre-configured third scenario card.

12. The method according to claim 11, wherein Before displaying the second interface, the method further includes: Determine that the available set of images for each rule in the third scenario card is empty.

13. The method according to claim 11 or 12, characterized in that, The images displayed in the fourth display column are the same as the background picture displayed in the third scenario card.

14. The method according to any one of claims 11-13, characterized in that, The method further includes: Receive a third operation, where the third operation is an operation on the fourth display column; In response to the third operation, display a third interface; The third interface includes a fifth display column; the available image set corresponding to the rule of the fifth prompt column is not empty.

15. The method according to any one of claims 11-13, characterized in that, The method further includes: Receive a third operation, where the third operation is an operation on the fourth display column; In response to the third operation, display a fourth interface; The fourth interface includes a first prompt message for prompting the user to take an image; before receiving the third operation, determine that the available image sets of the rules of the scenario are all empty.

16. The method according to claim 1, characterized in that The display priority of the first scenario card pre-configured by the electronic device is higher than the display priority of the second scenario card; After displaying the first interface, the method further includes: Receive a fourth operation, where the third operation is an operation on a fourth scenario card, and the fourth operation is used to instruct the electronic device to display details of the fourth scenario card; the fourth scenario card is displayed in the first interface; In response to the fourth operation, display a fifth interface; the fifth interface includes a sixth display column; the sixth display column is a display column of the pre-configured fourth scenario card.

17. The method according to claim 16, characterized in that, The method further includes: Receive a fifth operation, where the fifth operation is an operation on the sixth display column; In response to the fifth operation, display a second prompt message for prompting the user to trigger intelligent image recognition processing; The intelligent image recognition processing includes: Determine the attribute information of each of the images, where the attribute information includes information on at least one of the following dimensions: person attribute, location attribute, time attribute, event attribute; Based on the attribute information of the image, label the image with at least one label, where the label of the image corresponds to the attribute information of the image; For each rule in each scenario card, determine the set of available images that match the rule; each scenario is configured with at least one rule, and each rule is configured with at least one label.

18. The method according to any one of claims 1 to 17, characterized in that, The first interface further includes a fifth scenario card; the fifth display card is displayed before the first scenario card; Before displaying the first interface, the method further includes: Receiving a first push message, where the first push message includes the background image, card theme, and prompt statement of the fifth scenario card.

19. The method according to claim 18, wherein After displaying the first interface, the method further includes: Receiving a sixth operation, where the sixth operation is used to instruct the electronic device to display the details of the fifth scenario card; In response to the sixth operation, display a sixth interface, where the sixth interface includes a seventh display column pre-configured for the fifth scenario card; Receiving a seventh operation, where the seventh operation is an operation on the seventh display column; In response to the seventh operation, obtain at least one image corresponding to the seventh display column; Display a seventh interface, where the seventh interface includes the image corresponding to the seventh display column.

20. An electronic device, characterized in that, The electronic device includes: a display screen, a memory, and one or more processors; the display screen, the memory, and the processor are coupled; Wherein, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor executes the computer instructions, the electronic device is caused to execute the method described in any one of claims 1-19.

Images