Statement recommendation methods and electronic devices

Abstract

This application discloses a statement recommendation method and an electronic device. The method, applied to an electronic device, includes: displaying a first interface, wherein the first interface includes a first control; and displaying a second interface in response to a trigger operation on the first control, wherein the second interface includes K recommendation cards and K recommendation statements in a one-to-one correspondence. Each recommendation card displays a corresponding recommendation statement, and the K recommendation statements are determined based on user profile data and user photo data. Each recommendation card triggers the electronic device to process the photo data into a video based on the recommendation statement corresponding to each recommendation card, thereby obtaining a video associated with the recommendation statement corresponding to each recommendation card. K is a positive integer. Based on the statement recommendation method provided in this application, the efficiency of video generation can be improved, and the user experience can be enhanced.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and more specifically, to a sentence recommendation method and an electronic device. Background Technology

[0002] After interaction between the terminal device and the user, the terminal device can process the photo data stored on the terminal device to generate a video, thereby meeting the user's needs.

[0003] In traditional technologies, when a terminal device interacts with a user, the terminal device recognizes the user's input commands (e.g., voice or text) and then processes the photo data stored on the terminal device based on a fixed template of recommended statements to generate a video. However, this method suffers from problems such as the inability to generate a video from the photo data stored on the terminal device based on the fixed template of recommended statements, or the generated video failing to meet the user's needs, resulting in a poor user experience. Furthermore, the above implementation requires frequent dialogue between the terminal device and the user, leading to low video generation efficiency.

[0004] Therefore, improving the efficiency of video generation and enhancing the user experience have become urgent issues that need to be addressed. Summary of the Invention

[0005] This application provides a sentence recommendation method and an electronic device that can improve the efficiency of video generation and enhance the user experience.

[0006] In a first aspect, this application provides a statement recommendation method applied in an electronic device. The method includes: displaying a first interface, wherein the first interface includes a first control; and displaying a second interface in response to a trigger operation on the first control, wherein the second interface includes K recommendation cards and K recommendation statements that correspond one-to-one. Each recommendation card displays a corresponding recommendation statement, and the K recommendation statements are determined based on the user's profile data and the user's photo data. Each recommendation card is used to trigger the electronic device to process the photo data into a video based on the recommendation statement corresponding to each recommendation card, so as to obtain the video associated with the recommendation statement corresponding to each recommendation card, where K is a positive integer.

[0007] Each recommendation card displays a corresponding recommendation statement, and the content of the recommendation statement displayed on each card is not specifically limited. For example, the recommendation statement displayed on a recommendation card may include time, place, people, and event. Optionally, each recommendation card may also include a corresponding cover image.

[0008] User profile data includes characteristic data used to represent users of electronic devices. For example, user profile data may include one or more of the following: age, gender, interests, hobbies, birthday, graduation date, wedding date, hometown, residential address, and relationships (e.g., relationships may include, but are not limited to, parent-child relationships, romantic relationships, parent-child relationships, or friendship relationships).

[0009] In the above technical solution, after receiving a trigger operation on the first control of the first interface, the electronic device can directly display a second interface including K recommendation cards. Each recommendation card is used to generate a video based on photos in the photo data associated with the recommendation statement corresponding to each recommendation card. This method avoids the problem of low video generation efficiency caused by frequent dialogue between the user and the electronic device, thus improving video generation efficiency. Since the recommendation statement displayed on each recommendation card is determined based on the user's profile data and photo data, it ensures that the recommendation statement displayed on each recommendation card is content that the user is interested in. This allows the video generated based on each recommendation card to better meet the user's needs. This method avoids the problem that videos cannot be generated based on photo data processing using fixed template recommendation statements, and that the generated videos cannot meet the user's needs, thus improving the user experience. In summary, this method can improve video generation efficiency and enhance the user experience.

[0010] In one possible implementation, displaying a second interface in response to a triggering operation on a first control includes: displaying a third interface in response to a triggering operation on the first control, wherein the third interface includes multiple cards corresponding to multiple preset categories; and displaying the second interface in response to a triggering operation on one of the multiple cards.

[0011] There are no specific limitations on the various preset categories; they can be set according to user needs. For example, each preset category can be, but is not limited to, any of the following: My Daily Video Recordings (video blog, Vlog), Family Photos, Daily Gatherings, Growth Themes, Travel Vlog, Food Collection, My Photo Album, Hobbies, or City Architecture, etc.

[0012] In the above technical solution, after the user triggers the first control on the first interface, the electronic device displays multiple cards including multiple preset categories. The user can then trigger a card from one of the preset categories according to their needs. Afterwards, the electronic device displays a second interface including K recommended cards belonging to that preset category. This allows the video generated based on each recommended card to better meet the user's needs, thereby improving the user experience. In this implementation, the electronic device can display the second interface after the user performs only two trigger operations. This method also helps improve the efficiency of video generation.

[0013] In another possible implementation, after displaying the second interface in response to a triggering operation on the first control, the method further includes: displaying a fourth interface in response to a triggering operation on the first recommendation card among the K recommendation cards, wherein the fourth interface includes a thumbnail of a first video, the first video being a video associated with the first recommendation statement generated by the electronic device after processing the photo data into a single image according to the first recommendation statement.

[0014] In the above technical solution, after receiving a trigger operation on the first control of the first interface, the electronic device can directly display a second interface including K recommendation cards. Then, after receiving a trigger operation on the first recommendation card, the electronic device displays a fourth interface including a thumbnail of the first video. The first video is video data generated from photos in photo data associated with the first recommendation statement corresponding to the first recommendation card. This method can improve the convenience and efficiency of video generation. Since the first recommendation statement is determined based on the user's profile data and photo data, it is ensured that the first recommendation statement is content of interest to the user. This allows the video generated by the electronic device based on the first recommendation statement displayed on the first recommendation card to better meet the user's needs, thus improving the user experience.

[0015] In another possible implementation, in response to a triggering operation on the first control, a third interface is displayed, including: in response to a triggering operation on the first control, displaying an interface including a second control and a thumbnail corresponding to the photo data; and in response to a triggering operation on the second control, displaying the third interface.

[0016] The thumbnails corresponding to the photo data can be thumbnails of all the photos in the photo data, or thumbnails of a portion of the photos in the photo data; there is no specific limitation on this.

[0017] In another possible implementation, the method further includes: classifying the photo data to obtain K photo sets corresponding to K different event types, wherein the K photo sets correspond one-to-one with K recommendation statements, and each recommendation statement is determined based on the corresponding photo set and the user's profile data; analyzing each photo set to obtain memory information for each photo set, wherein the memory information includes information about the photos recorded in each photo set; and determining the recommendation statement corresponding to each photo set based on the memory information and profile data to obtain K recommendation statements.

[0018] The memory information for each photo set includes information recorded in the photos within that set, without specifying particular details about the information recorded in each photo set. For example, the memory information for each photo set includes the time, location, people, and events recorded in the photos within that set.

[0019] In the above technical solution, the electronic device can classify the user's photo data according to event type. Then, based on the user's profile data and the photo data set for each event type, it generates a recommendation statement corresponding to each event type. This method is relatively simple to implement. Since the recommendation statement displayed on each recommendation card is determined based on the user's profile data and photo data, it is possible to ensure that the recommendation statement displayed on each recommendation card is content that the user is interested in. This allows the video generated based on each recommendation card to better meet the user's needs, thus improving the user experience.

[0020] In another possible implementation, the memory information of each photo set specifically includes the time, location, people, and events recorded in the photos of each photo set. The event is one of K different event types. Based on the memory information and portrait data of each photo set, the recommendation statement corresponding to each photo set is determined to obtain K recommendation statements. This includes: determining the person information based on the portrait data and the people recorded in the photos of each photo set; and generating the recommendation statement corresponding to each photo set based on the person information and the memory information of each photo set to obtain K recommendation statements.

[0021] A person's information can include the person, the person's relationships with other people, and the person's role (e.g., child, daughter, son, father, or mother).

[0022] In the above technical solution, when the memory information of each photo set specifically includes time, location, people, and events, the electronic device can generate recommendation statements including time, location, people, and events based on the user profile and the memory information of each photo set.

[0023] In another possible implementation, the photo data is classified to obtain K photo sets corresponding to K different event types, including: filtering the photo data according to at least one preset time range to obtain at least one photo set that meets at least one preset time range; and classifying the at least one photo set that meets at least one preset time range according to event type to obtain K photo sets.

[0024] In another possible implementation, the electronic device includes a first application, a second application, and a media processing module. The first interface is the interface of the first application, and the second interface is displayed in response to a trigger operation on a first control, including: in response to a trigger operation on the first control, the first application sends a start command to the second application, wherein the start command carries the identifier of the first interface and the identifier of the first control; after receiving the start command, the second application sends a recommendation statement loading command to the media processing module, wherein the recommendation statement loading command is used to request the acquisition of recommendation cards for generating videos based on photo data; after the media processing module acquires the recommendation statement loading command, the media processing module generates K card information corresponding to the K recommendation cards based on the portrait data and photo data; the media processing module sends the K card information to the second application; after the second application loads the card information, it displays the second interface.

[0025] There is a one-to-one correspondence between K card information pieces and K recommended cards. Each card information piece is used to generate a corresponding recommended card. Each card information piece may include the recommendation statement from the recommended card. Optionally, each card information piece may also include other information, including but not limited to a card cover image and a card URL. The card URL indicates the address of the resource (e.g., parameters) corresponding to each recommended card, and this resource is used to generate the structure of each recommended card (e.g., an oval or square card structure). Thus, the electronic device can obtain the resource corresponding to each recommended card based on the address indicated by the URL of each recommended card.

[0026] In the above technical solution, a smart video creation entry (i.e., a first control) is added to the first application of the electronic device. The user can launch the second application of the electronic device by triggering this entry. The second interface of the second application displays a recommendation card with multiple recommendation statements generated based on the user's real photo data and user profile data. The recommendation statement displayed on each recommendation card can be used as a prompt for smart video creation, thereby effectively improving the convenience and efficiency of the user's video creation.

[0027] In another possible implementation, the electronic device further includes a media learning module, and after the second application receives the start command, the method further includes: the media processing module sending a query command to the media learning module; the media learning module sending query results including portrait data and photo data to the media processing module, so that the media processing module can acquire the portrait data and photo data.

[0028] In the above technical solution, the media processing platform can obtain the portrait data and photo data stored in the media learning module by interacting with it. Then, the media processing platform can determine the K recommendation statements corresponding to the K recommendation cards included in the second interface based on the obtained portrait data and photo data.

[0029] In another possible implementation, the first application is a gallery, and the photo data includes photos stored in the gallery, while the second application is a voice assistant.

[0030] In the above technical solution, a smart video creation entry (i.e., the first control) is added to the image library application of the electronic device. Users can activate the voice assistant of the electronic device by triggering this entry. The second interface of the voice assistant displays a recommendation card with multiple recommendation statements generated based on the user's real photo data and user profile data. The recommendation statement displayed on each recommendation card can be used as a prompt for smart video creation, thereby effectively improving the convenience and efficiency of users creating videos.

[0031] In another possible implementation, the first interface is the desktop of the electronic device, wherein the desktop of the electronic device includes icons of one or more applications, or the first interface is the interface of an application on the electronic device.

[0032] In the above technical solution, users can access the first interface through multiple different methods provided by the electronic device. This method can flexibly trigger the electronic device to display the first interface.

[0033] In another possible implementation, K is a preset value.

[0034] K is a preset value, and this preset value has an upper limit. The value of K can be predefined or dynamically adjusted. There is no specific limitation on the value of K; it can be set according to the actual scenario. For example, K can be set to 1, 2, or 3, or similar values, depending on the user's needs. Or, K can be set to 2 or 4, etc., depending on the performance of the electronic device.

[0035] In the above technical solution, K is a preset value, that is, the second interface displayed by the electronic device includes a preset K recommendation cards, which can save the resources consumed by the electronic device in generating recommendation cards.

[0036] Secondly, this application provides a statement recommendation device applied in an electronic device. The device includes a processing unit, wherein the processing unit is configured to: display a first interface, wherein the first interface includes a first control; and, in response to a trigger operation on the first control, display a second interface, wherein the second interface includes K recommendation cards and K recommendation statements in a one-to-one correspondence, each recommendation card displays a corresponding recommendation statement, the K recommendation statements are determined based on the user's profile data and the user's photo data, and each recommendation card is used to trigger the electronic device to process the photo data into a video based on the recommendation statement corresponding to each recommendation card, so as to obtain a video associated with the recommendation statement corresponding to each recommendation card, where K is a positive integer.

[0037] In one possible implementation, the processing unit is further configured to: display a third interface in response to a trigger operation on the first control, wherein the third interface includes a plurality of cards corresponding to a plurality of preset categories; and display the second interface in response to a trigger operation on one of the plurality of cards.

[0038] In another possible implementation, the processing unit is further configured to: display an interface including a second control and a thumbnail corresponding to the photo data in response to a trigger operation on the first control; and display the third interface in response to a trigger operation on the second control.

[0039] In another possible implementation, the processing unit is further configured to: after displaying the second interface in response to a trigger operation on the first control, perform the following operation: in response to a trigger operation on the first recommendation card among the K recommendation cards, display a fourth interface, wherein the fourth interface includes a thumbnail of a first video, the first video being a video associated with the first recommendation statement generated by the electronic device after processing the photo data into a single image based on the first recommendation statement.

[0040] In another possible implementation, the processing unit is further configured to: classify the photo data to obtain K photo sets corresponding to K different event types, wherein the K photo sets correspond one-to-one with the K recommendation statements, and each recommendation statement is determined based on the corresponding photo set and the user's profile data; analyze each photo set to obtain memory information for each photo set, wherein the memory information includes information about the photos recorded in each photo set; and determine the recommendation statement corresponding to each photo set based on the memory information of each photo set and the profile data to obtain the K recommendation statements.

[0041] In another possible implementation, the memory information of each photo set specifically includes the time, location, people, and events recorded in the photos of each photo set, wherein the event is one of the K different event types, and the processing unit is further configured to: determine the person information of the person based on the portrait data and the memory information of each photo set, including the people recorded in the photos of each photo set; and generate a recommendation statement corresponding to each photo set based on the person information of the person and the memory information of each photo set, so as to obtain the K recommendation statements.

[0042] In another possible implementation, the processing unit is further configured to: filter the photo data according to at least one preset time range to obtain at least one set of photos that satisfy the at least one preset time range; and classify the at least one set of photos that satisfy the at least one preset time range according to event type to obtain the K sets of photos.

[0043] In another possible implementation, the first interface is the desktop of the electronic device, wherein the desktop of the electronic device includes icons of one or more applications, or the first interface is the interface of an application of the electronic device.

[0044] In another possible implementation, K is a preset value.

[0045] Thirdly, an electronic device is provided, including a unit for executing any of the statement recommendation methods in the first aspect. The device may be a terminal device or a chip within a terminal device. The device may include an input unit and a processing unit.

[0046] When the device is a terminal device, the processing unit may be a processor, and the input unit may be a communication interface; the terminal device may also include a memory for storing computer program code, which, when the processor executes the computer program code stored in the memory, causes the terminal device to execute any of the statement recommendation methods in the first aspect.

[0047] When the device is a chip within a terminal device, the processing unit can be an internal processing unit of the chip, and the input unit can be an output interface, pin, or circuit, etc.; the chip may also include memory, which can be memory within the chip (e.g., registers, cache, etc.) or memory located outside the chip (e.g., read-only memory, random access memory, etc.); the memory is used to store computer program code, and when the processor executes the computer program code stored in the memory, it causes the chip to execute any of the statement recommendation methods in the first aspect.

[0048] In one possible implementation, the memory is used to store computer program code; the processor executes the computer program code stored in the memory, and when the computer program code stored in the memory is executed, the processor is used to execute any of the statement recommendation methods in the first aspect.

[0049] Fourthly, a computer-readable storage medium is provided, the computer-readable storage medium storing computer program code, which, when executed by a statement recommendation device, causes the statement recommendation device to perform any of the statement recommendation methods in the first aspect.

[0050] Fifthly, a computer program product is provided, the computer program product comprising: computer program code, which, when executed by a statement recommendation device, causes the statement recommendation device to perform any of the statement recommendation methods in the first aspect.

[0051] It is understood that the beneficial effects of the second to fifth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here.

[0052] It should be understood that the descriptions of technical features, technical solutions, beneficial effects, or similar language in this application do not imply that all features and advantages can be achieved in any single embodiment. Rather, it is understood that the description of a feature or beneficial effect means that a specific technical feature, technical solution, or beneficial effect is included in at least one embodiment. Therefore, the descriptions of technical features, technical solutions, or beneficial effects in this specification do not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions, and beneficial effects described in this embodiment can be combined in any suitable manner. Those skilled in the art will understand that embodiments can be implemented without one or more specific technical features, technical solutions, or beneficial effects of a particular embodiment. In other embodiments, additional technical features and beneficial effects may be identified in specific embodiments that do not embody all embodiments. Attached Figure Description

[0053] Figure 1 This is a schematic diagram of the hardware system of the electronic device 100 provided in the embodiments of this application.

[0054] Figure 2 This is a schematic diagram of the software system of the electronic device 100 provided in the embodiments of this application.

[0055] Figure 3 This is a schematic diagram of the system architecture applicable to the statement recommendation method provided in the embodiments of this application.

[0056] Figure 4 This is a schematic diagram illustrating a process for obtaining image data and memory nodes provided in an embodiment of this application.

[0057] Figure 5 This is a schematic diagram of the entry interface of an electronic device provided in an embodiment of this application.

[0058] Figure 6 This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0059] Figure 7 This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0060] Figure 8A This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0061] Figure 8B This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0062] Figure 9A This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0063] Figure 9B This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0064] Figure 10 This is a schematic diagram of a smart interface for an electronic device provided in an embodiment of this application.

[0065] Figure 11 This is a schematic diagram of the entry interface of an electronic device provided in an embodiment of this application.

[0066] Figure 12 This is a schematic diagram of the entry interface of an electronic device provided in an embodiment of this application.

[0067] Figure 13 This is a schematic diagram of the entry interface of an electronic device provided in an embodiment of this application.

[0068] Figure 14 This is a schematic diagram of a statement recommendation method provided in an embodiment of this application.

[0069] Figure 15 The above Figure 14 A schematic diagram illustrating the specific implementation flow of S1412 in the provided statement recommendation method.

[0070] Figure 16 This is a schematic diagram of a statement recommendation method provided in an embodiment of this application.

[0071] Figure 17 This is a schematic diagram of a statement recommendation device provided in an embodiment of this application. Detailed Implementation

[0072] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0073] In the embodiments of this application, any two of the three descriptive methods, namely "picture", "image" and "photo", can be interchanged, that is, any two of these three descriptive methods have the same meaning.

[0074] The camera hardware testing method provided in this application can be applied to electronic devices, such as mobile phones, smart screens, tablets, wearable electronic devices, in-vehicle electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), projectors, in-vehicle devices, etc. In other words, this application does not impose any restrictions on the specific type of electronic device.

[0075] The hardware and software structures of the electronic device will be described in detail below with reference to the accompanying drawings.

[0076] Figure 1 This is a schematic diagram of the hardware system of the electronic device 100 provided in the embodiments of this application.

[0077] The type of electronic device 100 is not specifically limited and can be selected according to the actual scenario. For example, electronic device 100 can be a mobile phone, smart screen, tablet computer, wearable electronic device, in-vehicle electronic device, augmented reality (AR) device, virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), projector, in-vehicle equipment, etc. This application embodiment does not impose any restrictions on the specific type of electronic device 100.

[0078] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0079] It should be noted that, Figure 1 The structure shown does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include... Figure 1 The components shown may include more or fewer components, or the electronic device 100 may include... Figure 1 The components shown may be a combination of certain components, or the electronic device 100 may include... Figure 1 Sub-components of some of the components shown. Figure 1 The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0080] Processor 110 may include one or more processing units. For example, processor 110 may include at least one of the following processing units: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and neural network processing unit (NPU). These different processing units may be independent devices or integrated devices.

[0081] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0082] The processor 110 may also include a memory for storing instructions and data. For example, the processor 110 may store instructions for executing the camera hardware testing method provided in the embodiments of this application. For example, the processor 110 may store data obtained from executing the camera hardware testing method provided in the embodiments of this application. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or is reusing. If the processor 110 needs to reuse the instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system. In some embodiments, the processor 110 may include one or more interfaces. For example, processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and a USB interface.

[0083] Figure 1The connection relationships between the modules shown are merely illustrative and do not constitute a limitation on the connection relationships between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of various connection methods described in the above embodiments.

[0084] Electronic device 100 can implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0085] Display screen 194 can be used to display images or videos. For example, display screen 194 can display images or videos captured by a camera application of an electronic device. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED (Micro OLED), or a quantum dot light-emitting diode (QLED). In some embodiments, electronic device 100 may include one or N displays screens 194, where N is a positive integer greater than 1.

[0086] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0087] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can perform algorithmic optimization of image noise, brightness, and color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0088] Camera 193 is used to capture images (e.g., still images) or videos. For example, the images or videos captured by camera 193 can be stored below. Figure 3 The illustrated image database 340 includes database 342. An object is projected onto a photosensitive element by an optical image generated through a lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into standard red-green-blue (RGB), YUV, or other image signal formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0089] The external memory interface 120 can be used to connect an external memory card, such as a secure digital (SD) card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage.

[0090] Internal memory 121 can be used to store computer executable program code, which includes instructions. For example, internal memory 121 can store instructions for executing the camera hardware testing method provided in the embodiments of this application. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store an operating system and an application program required for at least one function (e.g., sound playback function and image playback function). The data storage area may store data created during the use of electronic device 100 (e.g., audio data and phonebook). In addition, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, and universal flash storage (UFS). Processor 110 executes various processing methods of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory disposed in the processor.

[0091] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, y-axis, and z-axis). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in scenarios such as navigation and motion-sensing games.

[0092] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, such as in a shooting scenario, the electronic device 100 can utilize the distance sensor 180F for distance measurement to achieve fast focusing. For example, the distance sensor 180F can be, but is not limited to, a TOF sensor.

[0093] Touch sensor 180K, also known as a touch device, can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a touch screen. Touch sensor 180K is used to detect touch operations applied to or near it. For example, touch sensor 180K is used to detect the following text... Figure 5 The example shown illustrates a user-triggered touch operation on the video creation control 510. For instance, the touch sensor 180K is used to detect the following text... Figure 6 The user-triggered control 600 is shown to perform a touch operation. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the type of touch event. The touch sensor 180K can provide visual output related to the touch operation via the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 and in a different location from the display screen 194.

[0094] Motor 191 can generate vibration. In some implementations, motor 191 can be a camera autofocus motor (AF). Camera AF is used to adjust the lens focus to make the subject sharp and clear. It can drive the lens components to adjust back and forth according to the user's manual operation or the instructions of the autofocus system. Camera AF is usually driven by the camera's internal electronic control system or motor, which precisely controls the movement of each lens component according to the user's operation or the instructions of the automatic control algorithm to achieve the shooting requirements and desired shooting effect. In other implementations, motor 191 can be used for incoming call notifications or for touch feedback. Motor 191 can produce different vibration feedback effects for touch operations applied to different applications. Motor 191 can also produce different vibration feedback effects for touch operations applied to different areas of display screen 194. Different application scenarios (e.g., time reminders, receiving messages, alarm clocks, and games) can correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0095] The hardware system of electronic device 100 has been described in detail above. The software system of electronic device 100 is described below. The software system can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment takes a layered architecture as an example to exemplarily describe the software system of electronic device 100.

[0096] For example, Figure 2 A schematic diagram of the software system of the electronic device 100 provided in this application embodiment. See also... Figure 2 The software system adopts a layered architecture. This layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom: the application layer 210, the application framework layer 220, the Android Runtime and core library layer 230, the hardware abstraction layer (HAL) 240, and the kernel layer 250.

[0097] Application layer 210 may include a series of application packages. For example, application packages may include applications such as voice assistants (e.g., YOYO Smart Assistant), camera, gallery, video editing, chat, calling, maps, navigation, calendar, Bluetooth, music, and video.

[0098] The aforementioned applications may include more specific functional modules, and there are no specific limitations on the role and number of functional modules included in each application. For example, a language assistant may include a dialogue module, a language model, a sentence recommendation module, and a card creation and loading module. For example, a video editing application may include an editing module, a playback module, and service modules (such as a computer vision analysis module and a transition recognition module). For example, a gallery application may include a business module and a notification module. For example, a camera application may include a photo-taking module.

[0099] The aforementioned applications can be used to generate application data. For example, a language assistant is used to answer questions entered by a user. For example, in response to a user triggering the language assistant, the language assistant displays at least one recommendation card to the user, wherein the at least one recommendation card includes a recommendation statement, and the at least one recommendation card is associated with one or more photos corresponding to the recommendation statement.

[0100] For example, photo galleries are used to generate photos. Similarly, video editors are used to edit videos (e.g., add effects and / or remove video content) to obtain an edited video.

[0101] The application framework layer 220 provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer 220 includes some predefined functions.

[0102] like Figure 2 As shown, the application framework layer 220 may include a window manager, notification manager, activity manager, input manager, view system, content provider, resource manager, etc.

[0103] The window manager provides a window management service (WMS), which can be used for window management, window animation management, surface management, and as a relay station for the input system.

[0104] Content providers store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, etc.

[0105] A view system includes visual controls, such as controls that display text, controls that display images, etc. View systems can be used to build applications.

[0106] A display interface can consist of one or more views. For example, a display interface including a text message notification icon can include a view that displays text and a view that displays images. For example, a display interface can be, but is not limited to, the views listed below (5 to 5). Figure 13 The page shown in the image.

[0107] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and so on.

[0108] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0109] The Activity Manager Service (AMS) can be used to start, switch, and schedule system components (such as activities, services, content providers, and broadcast receivers), as well as manage and schedule application processes.

[0110] The input manager can provide an input management service (IMS), which can be used to manage system inputs, such as touchscreen input, keypad input, and sensor input. IMS retrieves events from input device nodes and, through interaction with the WMS, distributes these events to the appropriate windows.

[0111] The Android Runtime consists of core libraries and a virtual machine. The Android Runtime is responsible for scheduling and managing the Android system.

[0112] The core library consists of two parts: one part is the functionalities that need to be called by programming languages ​​(e.g., Java), and the other part is the Android core library.

[0113] Application layer 210 and application framework layer 220 run in a virtual machine. The virtual machine executes the programming files (e.g., Java files) of application layer 210 and application framework layer 220 as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0114] The core library layer 230 can include multiple functional modules. For example: surface manager, media framework, libc, SQLite, OpenGL ES, Webkit, etc.

[0115] The Surface Manager is used to manage the display subsystem and provides the fusion of two-dimensional (2D) and three-dimensional (3D) layers for multiple applications.

[0116] The media framework supports playback and recording of various commonly used audio and video formats, as well as still image files.

[0117] libc (the C library) is the standard library for the C programming language. libc is one of the lowest-level libraries in the system, implemented through Linux system calls. For example, libc can be used to connect or disconnect camera services, set camera shooting parameters, start and stop previewing, and take photos.

[0118] The Hardware Abstraction Layer (HAL) is an interface layer located between the operating system kernel and upper-level software, designed to abstract hardware. The HAL is an abstract interface for device kernel drivers, providing application programming interfaces (APIs) that allow access to the underlying device to higher-level Java API frameworks. The HAL contains multiple library modules, such as the Camera HAL (e.g., aperture, TOF sensor, lens, or focus motor), the Vendor repository, the display, Bluetooth, and audio. Each library module implements an interface for a specific type of hardware component. For example, the Camera HAL provides the camera firmware (FWK) with an interface to access hardware components like the camera lens. The Vendor repository provides the media firmware (FWK) with an interface to access hardware components like the encoder. When the system framework layer API requires access to the portable device's hardware, the Android operating system loads the library module for that hardware component.

[0119] The kernel layer 250 is the foundation of the Android operating system; all the final functions of the Android operating system are implemented through the kernel layer. The kernel layer can contain display drivers, camera drivers, audio drivers, and sensor drivers.

[0120] It should be noted that the application provides Figure 2 The illustrated software architecture diagram of the electronic device is merely an example and does not limit the specific module divisions within different layers of the Android operating system. For details, please refer to the descriptions of the Android operating system software architecture in conventional technologies. Furthermore, the shooting method provided in this application can also be implemented based on other operating systems (e.g., iOS or HarmonyOS), which will not be listed here.

[0121] Figure 3 This is a schematic diagram of the system architecture applicable to the statement recommendation method provided in the embodiments of this application. For example... Figure 3As shown, the system architecture includes an entry point 300, a voice assistant 310, a media processing platform 320, a media learning platform 330, a gallery database 340, and a video editing platform 350. It is understandable that... Figure 3 Each module shown is a module in the terminal device.

[0122] Entry point 300 includes multiple entry methods, namely desktop entry point 300a, gallery application entry point 300b and system entry point 300c. Each entry method is used to call the dialogue module 311 in the voice assistant 310. That is, through each entry point, one can enter the dialogue module 311 in the voice assistant 310 so that the electronic device can display the interface corresponding to the dialogue module 311.

[0123] For example, desktop entry point 300a may include any of the following entry methods: desktop shortcut entry point, global search entry point, YOYO desktop card entry point, or gallery desktop card entry point. For example, Figure 5 The mobile phone desktop S5 shown includes a desktop shortcut entry 500. In response to the user triggering the video creation control 510 in the desktop shortcut entry 500, the mobile phone can display the interface corresponding to the dialogue module 311 in the voice assistant 310.

[0124] For example, the gallery application entry point 300b may include any of the following entry methods: a floating ball of the voice assistant 310 on the gallery's creation page or image page. For example, Figure 13 The floating ball 1300 shown in the photo page S13 provided by the mobile phone can display the interface corresponding to the dialogue module 311 in the voice assistant 310 when the user triggers the floating ball 1300.

[0125] For example, system entry 300c may include any of the following entry methods: voice or power button. For instance, using the power button, when the electronic device displays a desktop including at least one application icon, the user presses the power button and holds it for approximately 0.5 to 1 second. Then, in response to the vibration of the electronic device, the user releases their finger, and the screen of the electronic device displays the interface of the dialogue module 311 in the voice assistant 310, indicating successful entry into the dialogue module 311. For instance, using voice, in the voice wake-up interface, the user says "Hello YOYO" to successfully wake up the voice assistant 310. After waking up the voice assistant 310, the user says "Please open the dialogue module 311 of the voice assistant 310," and the screen of the electronic device displays the interface of the dialogue module 311 in the voice assistant 310, indicating successful entry into the dialogue module 311.

[0126] The voice assistant 310 obtains user input commands through an interactive interface providing voice and / or text dialogue, and issues a data loading command associated with the user's input command to the creation card management module 321 in the media processing platform 320. The data loading command carries an entry identifier (e.g., a desktop shortcut entry identifier) ​​and a smart video identifier; the entry identifier identifies the entry point, and the smart video identifier identifies the smart video. The smart video button or control on the terminal device is used to launch the YOYO smart assistant on the terminal device and displays recommended statements (also known as prompts) generated based on the user's profile data and photo data in the skill interface of the launched YOYO smart assistant to generate smart videos.

[0127] In one example, the voice assistant 310 may include Figure 3The diagram shows a dialogue module 311, a language model 312, a creation card loading module 313, a sentence recommendation module 314, a text creation module 315, and a knowledge question answering module 316. Specifically, the dialogue module 311 is used to acquire user input commands, such as text or voice. The language model 312 is used to recognize the user input commands acquired by the dialogue module 311 and send the recognition results corresponding to the user input commands to the creation card loading module 313. For example, the language model 312 can be, but is not limited to, a large language model (LLM). The creation card loading module 313 is used to generate data loading commands associated with the user input commands based on the recognition results obtained from the language model 312, and send the data loading commands to the creation card management module 321 included in the media processing platform 320, so that the creation card management module 321 returns the recommendation information associated with the user input commands obtained based on the data loading commands to the creation card loading module 313. The creation card loading module 313 can also acquire edited videos from the editing module 351 of the video editing 350. In one example, the recommendation information may include a recommendation statement. In another example, the recommendation information may include a recommendation statement, a Uniform Resource Locator (URL) for a card encapsulating the recommendation statement, and a cover image for the card encapsulating the recommendation statement. In one example, the target recommendation statement may be a statement containing four elements: time, place, person, and event. For example, the target recommendation statement may be "Yesterday, Xiaoming played with his classmates at the school gate," where "playing" is the event. In another example, the target recommendation statement may be a statement containing four elements: time, place, person, and interest. For example, the target recommendation statement may be "Yesterday, Xiaoming took photos in the park," where "taking photos" is the interest. The statement recommendation module 314 is used to display the recommendation information obtained by the creation card loading module 313 to the user. For example, the statement recommendation module 314 may, but is not limited to, display the recommendation information to the user in the form of a recommendation card. The text creation module 315 is used to perform text editing processing on images and / or videos, such as adding text. The knowledge question answering module 316 is used to answer questions entered by the user.

[0128] The name of the voice assistant 310 is not specifically limited. For example, the name of the voice assistant 310 can be, but is not limited to, YOYO Smart Assistant or YOYO Smart Assistant.

[0129] The media processing platform 320 is used to obtain the data loading instruction associated with the user's input instruction from the voice assistant 310, and process the profile data and memory nodes obtained from the media learning platform 330 according to the data loading instruction to obtain the recommendation information mentioned above. Then, the recommendation information is returned to the voice assistant 310 so that the voice assistant 310 loads the recommendation information and displays it to the user.

[0130] Profile data includes data used to represent the characteristics of users of terminal devices, and there are no specific limitations on the content included in profile data. For example, profile data may include, but is not limited to, one or more of the following: the user's age, gender, interests, hobbies, birthday, graduation date, university, marriage date, account, hometown, residential address, work experience, and the user's relationships with others (e.g., parents, spouse, children, friends, teachers, and colleagues).

[0131] Memory nodes include the time range corresponding to the photos stored on the terminal device, the location corresponding to the photos stored on the terminal device, the event corresponding to the photos stored on the terminal device, and the people associated with the photos stored on the terminal device. There are no specific limitations on the time range and the event. For example, the time range can be, but is not limited to, at least one of the following: yesterday, this week, last week, this month, last month. For example, the event can be, but is not limited to, at least one of the following: birthday, family gathering, wedding, graduation ceremony, travel, outing, food, sports, scenery, with a cat, with a dog. The people associated with the photo include the people involved in the photo. For example, if photo A includes Xiaoming and Xiaozhang, then the people associated with photo A include Xiaoming and Xiaozhang.

[0132] In one example, the media processing platform 320 may include Figure 3 The diagram shows the creation card management module 321, the memory material processing module 322, and the final product module 323. Specifically, the creation card management module 321 obtains a data loading instruction from the creation card loading module 313 and sends it to the memory material processing module 322. The memory material processing module 322 obtains the aforementioned portrait data and memory nodes from the media learning platform 330, and processes the portrait data and memory nodes according to the data loading instruction to obtain the aforementioned recommendation information. The creation card management module 321 obtains the recommendation information from the memory material processing module 322 and obtains the data associated with the recommendation information. Next, the creation card management module 321... Figure 3 The shown search material module retrieves the materials corresponding to the recommended information, and then... Figure 3The shown material filtering module filters the materials obtained from the material searching module. Next, the material selection module further refines the materials from the filtering module. Then, the theme title generation module generates title information from the materials obtained from the filtering module. Finally, the final video module 323 processes the title information and materials obtained from the theme title generation module to produce a video associated with the recommended statements in the recommendation information. The final video module 323 can send the obtained video to the creation card loading module 313, allowing the video to be displayed to the user through the interface of the voice assistant 310. The final video module 323 can also send the obtained video to the video editor 350, enabling the video editor 350 to edit the video data obtained in the preceding steps (e.g., adding effects, text, audio, etc.).

[0133] The media learning platform 330 is used to learn from images obtained from database 342 in the image library database 340, and stores the learned image data and memory nodes. In one example, the media learning platform 330 may include... Figure 3 The diagram shows a portrait learning module 331, a portrait storage module 332, a memory learning module 333, and a memory storage module 334. Specifically, the portrait learning module 331 learns user portraits from images retrieved from the database 342 and sends the obtained user portrait data to the portrait storage module 332 for storage. The memory learning module 333 learns the time, location, and people from images retrieved from the database 342 to obtain memory nodes and sends these memory nodes to the memory storage module 334 for storage. Subsequently, when the media processing platform 320 needs to obtain portrait data and memory nodes, the media processing platform 320 can obtain portrait data from the portrait storage module 332 and memory nodes from the memory storage module 334.

[0134] Gallery database 340 is used to store photos and extract information from those photos. In one example, gallery database 340 may include... Figure 3 The diagram shows a computer vision (CV) analysis module 341 and a database 342. Specifically, the computer vision analysis module 341 is used to extract information from images. For example, if an image shows children playing in a park, the computer vision analysis module 341 can process the image to obtain information about the children playing in the park. The database 342 is used to store images and the information extracted from the images by the computer vision analysis module 341. For example, the images stored in the database 342 could be images taken by the camera of an electronic device, or images obtained by the electronic device through a chat application, etc.

[0135] The video editing module 350 is used to process the video acquired from the authoring card loading module 313. The processing performed by the video editing module 350 on the acquired video is not specifically limited and can be configured according to actual needs. In one example, the video editing module 350 may include... Figure 3 The diagram shows an editing module 351, a playback module 352, and a highlight service module 353. The highlight service module 353 includes a computer vision analysis module, a transition recognition module, an original sound recognition module, and a highlight fragment analysis module. Specifically, the computer vision analysis module analyzes the video and obtains corresponding analysis results. The transition recognition module identifies transitions or transitions between adjacent frames in the video. The original sound recognition module identifies the audio in the video. The highlight fragment analysis module extracts important or highlight fragments from the video.

[0136] It should be understood that the above Figure 3 The system architecture shown is for illustrative purposes only and does not constitute any limitation on the system architecture applicable to the statement recommendation methods provided in the embodiments of this application. For example, Figure 3 The voice assistant 310 shown may also exclude the text creation module 315. For example, Figure 3 The image learning module 331 and image storage module 332 in the media learning platform 330 shown can be merged into one module.

[0137] Below, in conjunction with Figure 4 The architecture shown describes the specific process of obtaining profile data and memory nodes involved in the statement recommendation method provided in this application embodiment.

[0138] Figure 4 This is a schematic diagram illustrating a process for acquiring image data and memory nodes provided in an embodiment of this application. For example... Figure 4 As shown, the architecture includes media services 410, a capability platform 420, and a voice assistant 430. It is understandable that... Figure 4 The modules shown are all modules in the terminal device. Figure 4 The various modules shown and Figure 3 The modules shown can be modules in the same terminal device.

[0139] Media services 410 include a media data center 411, a camera application 412, a gallery application 413, and video editing 414. The media data center 411 includes gallery behavior, video editing behavior, camera tags, and image tags. The camera application 412 includes filter recommendations and mode recommendations (e.g., portrait mode). The gallery application 413 includes highlight moments and mode recommendations. The video editing 414 includes template recommendations, music recommendations, material recommendations, and motion effect recommendations.

[0140] The capability platform 420 includes a decision center 421, a media learning platform 422, and a perception platform 423. The decision center 421 includes material recommendations, food recommendations, and travel recommendations. The media learning platform 422 learns from user media data obtained from the media data center 411 through interface 1 to learn the user's preferences (also known as interests or hobbies), such as, but not limited to, these preferences. Figure 4 The data shows food preferences, travel preferences, photography preferences, video editing preferences, and travel preferences. The perception platform 423 is used to perceive information, which may include, but is not limited to, one or more of the following: the location of the electronic device's stop point, the WiFi at the electronic device's stop point, the in-vehicle WiFi connected to the electronic device, and the app used by the user on the electronic device.

[0141] The decision center 421 queries the media learning platform 422 for user preferences through interface 2, and sends the queried user preferences to the voice assistant 430 through interface 4, so that the voice assistant 430 can obtain the user preferences. At the same time, the decision center 421 can also send the queried user preferences to the video editor 414 through interface 3.

[0142] It should be noted that, Figure 4 The voice assistant 430 and Figure 3 The voice assistant 310 corresponds to this. Figure 4 Media learning platform 422 and Figure 3 The media learning platform in the middle corresponds to 330. Figure 4 Video editing 414 and Figure 3 The video clip 350 corresponds to this.

[0143] It should be understood that the above Figure 4 The illustrated process for obtaining image data and memory nodes is merely illustrative and does not constitute a limitation on the process for obtaining image data and memory nodes involved in the statement recommendation method provided in this application embodiment.

[0144] To better understand the statement recommendation method provided in this application, before introducing the statement recommendation method provided in this application, we will first introduce the user interface (UI) of the electronic device involved in the statement recommendation method provided in this application. It should be noted that the UI is the medium interface for interaction and information exchange between an application or operating system and the user; it realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in specific computer languages ​​such as Java and Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, and finally presented as content that the user can recognize, such as images, text, buttons, and other controls. Controls, also called widgets, are the basic elements of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, images, and text. The attributes and content of controls in the interface are defined through tags or nodes, such as XML using tags, nodes, etc. <textview> 、 <imgview> 、 <videoview>Nodes define the controls contained in the interface. Each node corresponds to a control or property within the interface. After parsing and rendering, the nodes are presented as content visible to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0145] In one example, taking the path to Smart Integrated Circuits accessed by a user through a desktop card provided by an electronic device as an example, the user interface of the electronic device involved in this application embodiment is described. Please refer to... Figure 5 When the user triggers the video creation control 510 in the desktop card 500 displayed on the phone's S5 home screen, the phone displays the smart video creation interface S6, as shown below. Figure 6 As shown. The intelligent image processing interface S6 provides a control 600 and a text box 610 containing thumbnails of photos. After the user triggers the control 600, the phone displays as shown. Figure 7 The Smart Video Rendering Interface S7 shown includes multiple preset categories, which may include, but are not limited to, categories such as Daily Vlog, My Photo Collection, Family Contract, Growth Theme, Travel Vlog, and Food Collection displayed on the Smart Video Rendering Interface S7. In response to a triggering operation of a category in the Smart Video Rendering Interface S7, the mobile phone displays the aforementioned recommended information included in that category. For example, taking the family photo category triggered by the user in the Smart Video Rendering Interface S7 as an example, the mobile phone displays... Figure 8A The Smart Video Creation Interface S8A shown includes a dialog box 800A displaying three recommendation cards (recommendation card 801a, recommendation card 802b, and recommendation card 803c). Each recommendation card includes a cover image and a recommendation statement. Recommendation card 801 displays the recommendation statement "Create a video of the child playing with dad yesterday," and its cover image is 8010. Recommendation card 802 displays the recommendation statement "Generate a heartwarming video of the child and mom from last month," and its cover image is 8020. Recommendation card 803 displays the recommendation statement "Generate a video of the child's growth from last year to this year," and its cover image is 8030. For example, taking the Daily Vlog category triggered by the user in the Smart Video Creation Interface S7 as an example, the phone displays as follows... Figure 8B The intelligent video editing interface S8B shown contains a dialog box 800B displaying three recommendation cards. Each recommendation card includes a recommendation statement and a cover image. The three recommendation statements are, in order: "Make a video of your baby dancing," "Make a video of your trip to Nanjing," and "Generate a video of yesterday's badminton game." Then, in response to user triggering... Figure 8A The first recommended card in the dialog box shown in the 800A displays the following: If the phone's gallery contains multiple pictures of the child and father playing yesterday, the phone will display the following... Figure 9A The smart video interface S9A shown displays the text 900 (the user's input command) "Make a video of the child playing with dad yesterday," and the text 910 "The gallery is currently scanning images; you can check the progress in the gallery." In response to the phone generating the video of the child playing with dad yesterday, the phone displays the following... Figure 9B The smart video interface S9B shown displays the text 920, "I think I've generated a video of your child playing with their father yesterday, come and take a look~", and the generated video 930. When the user needs to view the video 930, the user triggers the open video control 940 in the video 930, which allows them to view the content of the video 930.

[0146] Optionally, in response to the user triggering the first recommended card in dialog box 800A, if no pictures of the child playing with their father yesterday are stored in the phone's gallery, the phone displays as follows: Figure 10 The smart video creation interface S10 shown contains the text 1000 (i.e., the user's input command) "Create a video of the child playing with his father yesterday" and the text 1010 "There are no photos available for this topic in the gallery. You can try clicking on the following topic to create a video: Generate a video of the child holding hands with his mother last month".

[0147] It should be noted that, as an example above, after the user triggers the video creation control 510 displayed on the phone's desktop S5, the phone displays the smart video editing interface S6, illustrating how to access the provided embodiment of this application through the phone's desktop card. Figure 8A The dialog box 800A in the intelligent video creation interface S8A shows three recommendation cards corresponding to three recommendation statements. In another example, after the user triggers the video creation control 510 on the phone's desktop S5, the phone can directly display... Figure 8A The intelligent video creation interface S8A is shown. In another example, after the user triggers the video creation control 510 on the phone's desktop S5, the phone displays as follows: Figure 7 The Smart Photo Interface S7 is shown. Then, in response to a trigger operation in the Family Photo category of the Smart Photo Interface S7, the phone displays as follows: Figure 8A The intelligent integrated interface S8A is shown.

[0148] In another example, taking the path where a user accesses the smart image processing system via a global search provided by an electronic device as an example, the user interface of the electronic device involved in this application is described. For example, a user can access the global search page by pulling down the home screen of their phone. Please refer to [link / reference]. Figure 11 The user interface S11 shown has a global search control 1100 at its bottom. After the user enters the keyword "smart" into the global search control 1100, the user interface S11 displays a smart image processing control 1110. In response to a trigger operation on the smart image processing control 1110, the phone displays as follows: Figure 7 The Smart Photo Interface S7 is shown. Subsequently, in response to a trigger operation in the Family Photo category of the Smart Photo Interface S7, the phone displays as follows: Figure 8A The smart image processing interface S8A is shown. Alternatively, in response to a trigger operation on the smart image processing control 1110, the mobile phone can directly display, as shown... Figure 8A The intelligent integrated interface S8A is shown.

[0149] In another example, taking the path from the creation page in the gallery provided by the electronic device to the smart image creation process as an example, the user interface of the electronic device involved in the embodiments of this application is introduced. For the user triggering the gallery to display the creation page, please refer to... Figure 12 The creation page S12 shown displays the Smart Film Rendering Control 1200. In response to a trigger operation on the Smart Film Rendering Control 1200, the mobile phone displays as follows: Figure 7 The Smart Photo Interface S7 is shown. Subsequently, in response to the trigger operation of the family photo in the Smart Photo Interface S7, the phone displays as follows: Figure 8A The smart imaging interface S8A is shown. Alternatively, in response to a trigger operation on the smart imaging control 1200, the mobile phone directly displays, as shown... Figure 8A The intelligent integrated interface S8A is shown.

[0150] In another example, taking the path from a floating ball in the gallery provided by the electronic device to access the smart photo gallery as an example, the user interface of the electronic device involved in this application embodiment is introduced. After the user enters the photo album in the gallery, the mobile phone displays as follows: Figure 13 The photo page S13 shown displays the Smart Photo Floating Ball 1300. Subsequently, in response to a trigger operation on the floating ball 1300, the phone displays as follows... Figure 7 The Smart Photo Interface S7 is shown. Subsequently, in response to the trigger operation of the family photo in the Smart Photo Interface S7, the phone displays as follows: Figure 8A The S8A smart interface is shown. Alternatively, in response to a trigger operation on the floating ball 1300, the phone directly displays, as shown below. Figure 8A The intelligent integrated interface S8A is shown.

[0151] It should be noted that the above-described user interfaces are merely exemplary and do not constitute any limitation on the user interfaces to which the statement recommendation method provided in this application applies.

[0152] Next, combined Figures 14 to 16 The statement recommendation method provided in the embodiments of this application will be described in detail.

[0153] Below, based on the above Figure 3 Taking the system architecture shown as an example, combined with Figure 14 This application introduces a statement recommendation method provided by an embodiment. Figure 14 This is a flowchart illustrating a sentence recommendation method provided in an embodiment of this application. It can be understood that... Figure 14 The method shown can be executed by a terminal device, such as the one described above. Figure 1 The electronic device shown. (e.g.) Figure 14 As shown, the recommended methods for this statement include S1401 to S1421, which will be described in detail below.

[0154] S1401, The user sends a trigger command to the gallery on the terminal device to view the creation page of the gallery.

[0155] The trigger command for viewing the gallery's creation page is used to trigger the display of the creation page in the gallery on the terminal device. This creation page includes a Smart Photo control. In this embodiment, the Smart Photo control on the terminal device is used to launch the YOYO Smart Assistant on the terminal device, and display recommended statements (also known as prompts) generated based on the user's profile data and photo data in the skill interface of the launched YOYO Smart Assistant to generate Smart Photos.

[0156] There are no specific limitations on the trigger commands for viewing the creation page of the gallery; they can be set according to the actual application scenario. For example, the trigger commands for viewing the creation page of the gallery can be, but are not limited to, clicking or double-clicking the creation control in the gallery.

[0157] S1402, in response to a trigger command to view the creation page of the gallery, the display of the gallery on the terminal device includes the creation page of the smart image control.

[0158] In one example, after a user triggers the gallery icon (e.g., display on the desktop of the terminal device), the terminal device displays the gallery's main page. Then, in response to the user triggering the creation controls on the gallery's main page, the terminal device displays the gallery's creation page, such as... Figure 12 The creation page S12 shown is... Figure 12 The image also shows a smart integrated control 1200.

[0159] S1403, the user sends a trigger command to the smart image creation page of the terminal device's gallery.

[0160] In one example, the user's finger triggers the action (e.g., a single click or a double click). Figure 12 The Smart Image Creation Control 1200 shown is used to trigger the Smart Image Creation Control on the creation page of the image library.

[0161] Optionally, after the creation page of the gallery is displayed on the terminal device, if the user does not need to obtain the video generated by Smart Film, the user can exit the creation page of the gallery by swiping down, but not limited to the gesture. After that, the terminal device displays a desktop that includes one or more application identifiers (e.g., icons).

[0162] For example, users can target Figure 12 The creation page S12 shown executes a swipe-down gesture operation. Afterwards, the interface displayed on the terminal device is as follows: Figure 5 As shown.

[0163] S1404, in response to the user triggering the Smart Photo control on the gallery's creation page, the gallery sends a command to YOYO Smart Assistant to start YOYO Smart Assistant (carrying the gallery's creation page identifier and Smart Photo identifier).

[0164] When a user triggers the Smart Photo Conversion control on the gallery's creation page, the gallery sends a command to YOYO Smart Assistant to launch the assistant. This command includes the gallery's creation page identifier and the Smart Photo Conversion identifier, allowing YOYO Smart Assistant to generate and load recommended content based on the command. Optionally, the command to launch YOYO Smart Assistant may also carry other information, without specific limitations. For example, this information may include, but is not limited to, the launch time.

[0165] The creation page identifier in a stock photo library is used to identify the creation page of that library, and there are no specific limitations on the form of the creation page identifier. For example, the creation page identifier can be the number of that creation page.

[0166] The Smart Video Generator is used to identify Smart Video Generator controls. The terminal device's Smart Video Generator can recommend phrases for generating videos to the user based on the user's profile data and memory nodes mentioned earlier. The form of the Smart Video Generator is not specifically limited. For example, the Smart Video Generator can be a preset icon or symbol of a Smart Video Generator control.

[0167] S1405, YOYO Smart Assistant sends a binding command to the media processing platform. Correspondingly, the media processing platform receives the binding command sent by YOYO Smart Assistant.

[0168] The binding directive is used to request the binding of the YOYO smart assistant and the media processing platform. The binding directive can carry the address information of the media processing platform. For example, the binding directive can be the onBindAppClip directive.

[0169] S1406, the media processing platform sends a binding success message to the YOYO Smart Assistant. Correspondingly, the YOYO Smart Assistant receives the binding success message from the media processing platform.

[0170] For example, a successful binding message could be a SmartVideoCreationClip.

[0171] Thus, after the terminal device executes S1405 and S1406, the YOYO smart assistant on the terminal device and the media processing platform on the terminal device are successfully bound. After that, data interaction can be performed between the YOYO smart assistant and the media processing platform.

[0172] Optionally, if there is no need for data interaction between YOYO Smart Assistant and the Media Processing Platform, the binding relationship between them can be deleted, thereby saving network resources.

[0173] S1407, YOYO Smart Assistant sends a recommended text loading command to the media processing platform. Correspondingly, the media processing platform receives the recommended text loading command sent by YOYO Smart Assistant.

[0174] The recommendation statement loading instruction is used to request recommendation information for generating the final product (i.e., video). The recommendation information may include the URL of the recommendation card, the recommendation statement, and the cover photo of the recommendation card.

[0175] S1408, the media processing platform loads instructions based on the recommended statements and generates query instructions (used to query the user profile data and user memory nodes of the terminal device).

[0176] The query command is used to query the user profile data and user memory nodes of the terminal device.

[0177] User profile data includes characteristic data used to represent users of terminal devices, and there are no specific limitations on the content included in user profile data. For example, user profile data may include, but is not limited to, one or more of the following: the user's age, gender, interests, hobbies, birthday, graduation date, university, marriage date, account, hometown, residential address, work experience, and the user's relationships (e.g., relationships may include, but are not limited to, parent-child relationships, romantic relationships, parent-child relationships, friendship relationships, teacher-student relationships, or colleague relationships).

[0178] A user's memory nodes include the time range corresponding to the photos stored on the terminal device, the location corresponding to the photos stored on the terminal device, the event corresponding to the photos stored on the terminal device, and the people associated with the photos stored on the terminal device. There are no specific limitations on the time range and the event. For example, the time range can be, but is not limited to, at least one of the following: yesterday, this week, last week, this month, last month. For example, the event can be, but is not limited to, at least one of the following: birthday, family gathering, wedding, graduation ceremony, travel, outing, food, sports, scenery, with a cat, with a dog. The people associated with the photo refer to the people involved in the photo. For example, if photo A includes Xiaoming and Xiaozhang, then the people associated with photo A include Xiaoming and Xiaozhang. For example, let's describe a user's memory nodes using all photos stored in the terminal device's gallery, including photo A and photo B. In one example, photo A records the event of Xiaoming and Xiaoli flying a kite in the park on January 1, 2024. Photo B records the event of Xiaoming reading in the library on January 4, 2024. Based on this, a user's memory nodes can include: a time range from January 1, 2024 to January 4, 2024; locations including parks and libraries; events including flying kites and reading books; and people including Xiaoming, and the existence of Xiaoming and Xiaoli.

[0179] For example, if a user's profile data includes their birthday, the user's birthday can be represented by the following code:

[0180]

[0181] For example, a user's memory node applicable to embodiments of this application can be represented by the following code:

[0182]

[0183]

[0184] It should be noted that the examples of user profile data and user memory nodes mentioned above do not constitute any limitation on the user profile data and user memory nodes applicable to the embodiments of this application.

[0185] Thus, after the media processing platform obtains the recommendation statement loading instruction, it can generate a query instruction for the user's profile data and memory nodes on the query terminal device. Then, the media processing platform sends this query instruction to the media learning platform, so that the media learning platform returns the query results to the media processing platform. S1409, the media processing platform sends the query instruction to the media learning platform. Correspondingly, the media learning platform receives the query instruction sent by the media processing platform.

[0186] S1410, the media learning platform performs a query based on the query command and obtains the query results (carrying the user's profile data and the user's memory nodes).

[0187] The query results carry user profile data and user memory nodes, and there is no specific limit to the number of user memory nodes included in the query results. For example, the query results may include one or more user memory nodes.

[0188] In one example, after a preset period of time following the screen being turned off while the terminal device is charging, the profile learning module included in the media learning platform can initiate a profile learning function based on application data generated by applications on the terminal device to obtain the user profile data mentioned above. For example, the application can be, but is not limited to, a gallery, video, photo album, memo, or contacts. Simultaneously, the memory learning module included in the media learning platform can initiate a memory learning function based on images and / or videos on the terminal device to obtain the user's memory nodes mentioned above. For example, the images and / or videos on the terminal device can be, but is not limited to, data stored in a gallery, video, or photo album. Subsequently, the profile storage module included in the media learning platform can store the user profile data obtained from the profile learning module, and the memory storage module included in the media learning platform can store the user's memory nodes obtained from the memory learning module.

[0189] The preset duration is not specifically limited; it can be set according to the operating performance of the terminal device. For example, when the terminal device has high operating performance, the preset duration can be shorter, such as 15 seconds or 30 seconds. When the terminal device has high operating performance, the preset duration can be longer, such as 60 seconds or 100 seconds.

[0190] In practical applications, to reduce the power consumption of terminal devices, in this embodiment, within a preset time range, when the terminal device performs multiple charging and screen-off operations, the media learning platform executes the portrait learning function and memory learning function as described above only after a preset time period following one of the multiple charging and screen-off operations. The specific charging and screen-off operation within the multiple charging and screen-off operations is not specifically limited; for example, it can be, but is not limited to, the first or second screen-off operation in the multiple charging and screen-off operations. The preset time range is not specifically limited; for example, it can be, but is not limited to, 12 hours or 24 hours.

[0191] S1411, the media learning platform sends the query results (carrying user profile data and user memory nodes) to the media processing platform. Correspondingly, the media processing platform receives the query results sent by the media learning platform.

[0192] S1412, The media processing platform processes the query results and generates recommendation results (carrying K card information, each card information includes the URL of each card, the recommendation statement in each card and the cover photo of each card, where K is a positive integer).

[0193] As mentioned earlier, after receiving the recommendation statement loading instruction from the YOYO Smart Assistant, the media processing platform first obtains user data (i.e., user profile data and user memory nodes) from the media learning platform to generate the final recommendation statement. Then, the media processing platform processes this user data to obtain the data requested by the recommendation statement loading instruction (i.e., the recommendation result). In one example, the recommendation result carries K card information items, where each card information item includes the URL of each card, the recommendation statement in each card, and the cover photo of each card. The cover photo of each card is not specifically limited; for example, the cover photo of each card is a photo associated with the recommendation statement in that card. For example, when a card information item includes the recommendation statement "Make a video of the child playing with dad yesterday," the cover photo included in that card information item could be a photo from the photos of the child playing with dad yesterday. Optionally, each card information item may also carry other information, which is not specifically limited; for example, other information may include, but is not limited to, the device model of the terminal device.

[0194] K is a preset positive integer, and there are no specific restrictions on the value of K. For example, K can be equal to 1, 2, 3, or 5, etc.

[0195] As an example of this application, for the specific implementation process of the media processing platform in processing query results and generating recommendation results, please refer to [link to relevant documentation]. Figure 15 S1412-0 to S1412-15 are shown. In one example, the media processing platform includes a memory material processing module that executes S1412. The following example demonstrates the execution of S1412 by the memory material processing module. Figure 15 The S1412-0 to S1412-15 shown are described in detail.

[0196] S1412-0, the memory material processing module obtains the i-th time range, where i is a positive integer.

[0197] The i-th time range can correspond to a single moment or a period of time, without specific limitations. For example, the i-th time range could be 3 PM yesterday, yesterday, this week (excluding yesterday), last week, this month (excluding this week and last week), or last month, etc.

[0198] There are no specific restrictions on how the memory material processing module obtains the i-th time range. For example, the memory material processing module may store a predefined i-th time range.

[0199] In one example, when the memory material processing module executes S1412-1 for the first time after executing S1411, i can be equal to 1. Then, when the memory material processing module executes S1412-1 for the second time after executing S1411, i equals 2, and so on. When the memory material processing module executes S1412-1 for the Wth time after executing S1411, i equals W, where W is an integer greater than 2.

[0200] For example, if W equals 2, the first time frame could be yesterday, and the second time frame could be this week (excluding yesterday). For example, if W equals 5, the first time frame could be yesterday, the second time frame could be this week (excluding yesterday), the third time frame could be last week, the fourth time frame could be this month (excluding this week and last week), and the fifth time frame could be last month (excluding yesterday).

[0201] S1412-1, the memory material processing module queries the query results according to the i-th time range to obtain the memory node of the user corresponding to the i-th time range.

[0202] As mentioned earlier, memory nodes include the time range corresponding to the photos stored in the terminal device, the location corresponding to the photos stored in the terminal device, the event corresponding to the photos stored in the terminal device, and the person associated with the photos stored in the terminal device. In other words, the time range corresponding to each memory node is the time range included in that memory node. In one example, the query results include multiple memory nodes for a user, which can correspond to different time ranges. Therefore, the memory material processing module can query these multiple memory nodes according to the i-th time range to obtain the user's memory nodes corresponding to the i-th time range. Subsequently, the memory material processing module processes the user's memory nodes corresponding to each time range (i.e., the i-th time range), thus improving data processing efficiency.

[0203] S1412-2, the memory material processing module clusters the memory nodes of the user corresponding to the i-th time range according to the preset events, and obtains at least one event class corresponding to the i-th time range.

[0204] The i-th time range corresponding to at least one event class means that the i-th time range corresponds to one event class, or the i-th time range corresponds to multiple event classes, where the multiple event classes correspond to multiple different events in a preset event type. For example, taking the user's memory nodes corresponding to the i-th time range as including user memory node 1, user memory node 2, and user memory node 3 as an example, clustering the user's memory nodes corresponding to the i-th time range according to the preset events can yield event class 1 including user memory node 1, and event class 2 including user memory node 2 and user memory node 3. The events corresponding to event class 1 and the events corresponding to event class 2 are different.

[0205] There are no specific limitations on the preset events; they can be set according to actual needs. In one example, the preset events include one or more of the following: birthday, family gathering, wedding, graduation ceremony, travel, outing, food, sports, scenery, and pet companionship (e.g., with a cat or a dog).

[0206] It should be noted that after the memory material processing module clusters the memory nodes of users corresponding to the same time range (i.e., the i-th time range), the principle of the subsequent processing flow executed by the memory material processing module for the memory nodes of users corresponding to each class is the same.

[0207] S1412-3, the memory material processing module aggregates the photos or videos of events associated with at least one event class corresponding to the i-th time range to obtain the aggregation result of at least one event class corresponding to the i-th time range.

[0208] In one example, when the i-th time range corresponds to multiple event classes, these multiple event classes correspond to multiple aggregation results, where each aggregation result is the aggregation result of the corresponding event class.

[0209] S1412-4, the memory material processing module determines whether the photos or videos included in the aggregation results corresponding to at least one event class for the i-th time range include people.

[0210] In one example, if there are multiple event classes corresponding to the i-th time range, and these multiple event classes correspond to multiple aggregate results, then the memory material processing module needs to determine whether the photos or videos included in the aggregate results of each event class corresponding to the i-th time range include people.

[0211] As an example of this application, the memory material processing module can determine whether the photos or videos included in the aggregation results corresponding to each event class include people based on the fields in the memory nodes of the users corresponding to each event class. Specifically, in one example, when the memory nodes of the users corresponding to each event class include a "person" field, the memory material processing module can determine that the photos or videos included in the aggregation results corresponding to each event class include people based on this "person" field. Simultaneously, the memory material processing module can determine the person whose identifier is included in the photos or videos included in the aggregation results corresponding to each event class based on the field value of this "person" field. Here, the person's identifier indicates a person with a mapping relationship to that identifier. For example, if there is a mapping relationship 1 between person identifier 1 and person 1, the memory material processing module can determine person 1 based on mapping relationship 1 and person identifier 1. In another example, when the memory nodes of the users corresponding to each event class do not include a "person" field, the memory material processing module can determine that the photos or videos included in the aggregation results corresponding to each event class do not include people.

[0212] As another example of this application, the memory material processing module can also perform person recognition on the photos or videos included in the aggregated results corresponding to each event class, in order to identify whether the photos or videos included in the aggregated results corresponding to each event class contain people. The specific implementation of person recognition is not limited; for example, the memory material processing module can, but is not limited to, perform the person recognition process based on a neural network model.

[0213] Thus, after the memory material processing module determines that the photos or videos included in the aggregation results corresponding to each event class for the i-th time range include people, the memory material processing module executes S1412-5 to obtain the information of people in the photos or videos included in the aggregation results corresponding to each event class for the i-th time range. After the memory material processing module determines that the photos or videos included in the aggregation results corresponding to each event class do not include people, the memory material processing module executes S1412-6, that is, to further determine whether the photos or videos included in the aggregation results corresponding to each event class include locations.

[0214] S1412-5, the memory material processing module obtains the person information i from the photos or videos included in the aggregated results corresponding to at least one event class in the i-th time range based on the user's profile data in the query results and the people in the photos or videos included in the aggregated results corresponding to at least one event class in the i-th time range.

[0215] The person information i can include the person and their relationship. The relationship is not specifically limited; for example, it can include, but is not limited to, father and son, mother and daughter, teacher and student, colleagues, friends, etc. For instance, taking a photo that includes person A and person B in the aggregation result corresponding to at least one event class in the i-th time range, the person information i includes the following information: person A is the child, and person B is person A's father.

[0216] In one example, the memory material processing module executes steps S1412-5 above, that is, the memory material processing module finds the portrait data of people in photos or videos included in the aggregated results corresponding to at least one event class for the i-th time range from the user's portrait data in the query results. Then, the memory material processing module determines the relationships between people in person information i based on the portrait data found in the aforementioned steps. Thus, the memory material processing module obtains the people and their relationships in person information i.

[0217] S1412-6, The memory material processing module determines whether the photos or video data included in the aggregation results corresponding to at least one event class for the i-th time range include locations.

[0218] In one example, if there are multiple event classes corresponding to the i-th time range, and these multiple event classes correspond to multiple aggregation results, then the memory material processing module needs to determine whether the photos or videos included in the aggregation results of each event class corresponding to the i-th time range include locations.

[0219] As an example of this application, the memory material processing module can determine whether the photos or videos included in the aggregation results for each event class include locations based on the fields in the memory nodes of the users corresponding to each event class. Specifically, when the memory nodes of the users corresponding to each event class include a location field, the memory material processing module can determine that the photos or videos included in the aggregation results for each event class include locations. When the memory nodes of the users corresponding to each event class do not include a location field, the memory material processing module can determine that the photos or videos included in the aggregation results for each event class do not include locations.

[0220] Thus, after the memory material processing module determines that the photos or videos included in the aggregation results for each event class corresponding to the i-th time range contain locations, it executes S1412-7 to obtain the locations in the photos or videos included in the aggregation results for each event class corresponding to the i-th time range. After the memory material processing module determines that the photos or videos included in the aggregation results for each event class corresponding to the i-th time range do not contain locations, it executes S1412-8.

[0221] S1412-7, The memory material processing module obtains the location i in the photos or videos included in the aggregation result corresponding to at least one event class for the i-th time range.

[0222] In one example, the memory material processing module can obtain the location in the photos or videos included in the aggregation results corresponding to at least one event class in the i-th time range in the following way: if the photos or videos included in the aggregation results corresponding to at least one event class in the i-th time range include people, the memory material processing module obtains the location from the field value of the location field in the memory node corresponding to the user in the aggregation results corresponding to at least one event class in the i-th time range, where the field value of the location field represents the location.

[0223] For example, the location field in a user's memory node can be the city field. Based on this, the location field and the corresponding field value in the user's memory node for the i-th time range can be represented as: "city": "Changsha".

[0224] S1412-8, the memory material processing module counts the number of photos or videos included in the aggregation results corresponding to at least one event class in the i-th time range, which is called the number A.

[0225] Thus, the memory material processing module can count the number of photos or videos included in the aggregated result of each event class in the i-th time range, which is called the number A.

[0226] S1412-9, the memory material processing module determines whether the number A meets the preset quantity 1.

[0227] The preset quantity of 1 is not specifically limited and can be set according to user needs. In one example, the preset quantity of 1 is a fixed value, such as, but not limited to, 5, 7, 8, or 10. In another example, the preset quantity of 1 is a data range, such as [5, 10].

[0228] Thus, after the memory material processing module determines that the number A meets the preset quantity of 1, it executes S1412-10 to generate recommended statements for at least one event class corresponding to the i-th time range. If the memory material processing module determines that the number A does not meet the preset quantity of 1, it updates i to i+1 and executes S1412-0 again. That is, the memory material processing module re-executes a process similar to S1412-0 to S1412-9 for a new time range to obtain recommended statements determined based on the user's memory nodes corresponding to this new time range. It should be understood that the specific value of the time range is different each time the memory material processing module executes S1412-0.

[0229] S1412-10, the memory material processing module generates recommended statements corresponding to at least one event class for the i-th time range according to the preset statement format, based on the person information i, the i-th time range, the location i, and the i-th time range corresponding to at least one event class.

[0230] The preset statement formats include people, time, location, and event. For example, a preset statement format could be: "Generate a video of [people], [time], [location], and [event]", where the brackets [] can be referred to as slot information, such as [people] which can be called people slot information. Another example is: "Generate a heartwarming video of [people], [time], [location], and [event]". Yet another example is: "Generate a memory video of [people], [time], [location], and [event]".

[0231] The recommended statement for the i-th time range corresponding to at least one event class includes person information i, the i-th time range, location i, and the i-th time range corresponding to at least one event class.

[0232] In one example, the memory material processing module generates a recommended statement corresponding to at least one event class in the i-th time range according to a preset statement format, based on the person information i, the i-th time range, the location i, and at least one event class corresponding to the i-th time range. For example, it may include the following steps: the memory material processing module updates the person slot information in the preset statement format to person information i, updates the time slot information in the preset statement format to the i-th time range, updates the location slot information in the preset statement format to location i, and updates the event slot information in the preset statement format to at least one event class corresponding to the i-th time range, thereby generating a recommended statement corresponding to at least one event class in the i-th time range.

[0233] For example, taking the following preset statement format as an example: "Generate a video of [person], [time], [location], [event]", the recommended statement for the i-th time range corresponding to at least one event class can be expressed as: "Generate a video of [person information i], [i-th time range], [location i], [i-th time range corresponding to at least one event class]".

[0234] Thus, after the memory material processing module executes S14121-10 to obtain the recommended statements for each event class corresponding to the i-th time range, the memory material processing module can continue to execute S1412-11, that is, determine the number of currently generated recommended statements associated with the event.

[0235] S1412-11, The memory material processing module counts the number of currently generated recommendation statements related to the event as number B.

[0236] In this embodiment, when there are multiple recommended statements associated with an event, these multiple recommended statements may correspond to the same or different time ranges. In one example, after the recall material processing module executes S1412-9 for the first time, and then executes S1412-10, S1412-11, S1412-12, and S1412-14 sequentially, when there are multiple recommended statements associated with the event, these multiple recommended statements correspond to the same time range. In another example, after the recall material processing module executes S1412-9 for the first time, and then executes S1412-0 again, when there are multiple recommended statements associated with the event, these multiple recommended statements correspond to different time ranges.

[0237] S1412-12, the memory material processing module determines whether the quantity B meets the preset quantity 2.

[0238] The preset quantity 2 is not specifically limited and can be set according to user needs. In one example, the preset quantity 2 is a fixed value, such as, but not limited to, 1, 2, 3, or 5. In another example, the preset quantity 2 is a data range, such as [2, 5].

[0239] Thus, after the recall material processing module determines that the number of recommended statements associated with the event meets the preset number of 2, it executes S1412-14 to determine the B currently generated recommended statements associated with the event as the K recommended statements corresponding to the K card information carried in the recommendation results. If the recall material processing module determines that the number of recommended statements associated with the event does not meet the preset number of 2, it executes S1412-13, meaning the recall material processing module can also process the query results according to the i-th time range to generate recommended statements corresponding to at least one interest category for the i-th time range.

[0240] In this embodiment, the principle by which the memory material processing module processes the query results according to the i-th time range and generates interest-related recommendation statements is the same as the principle described in S1412-0 to S1412-10 above, where the memory material processing module processes the query results according to the i-th time range and generates event-related recommendation statements. The difference is that the events in S1412-0 to S1412-10 are all replaced with interests, and the preset statement format in S1412-10 should be replaced with a statement including people, time, location, and interests. For example, in this case, the preset statement format may be, but is not limited to, the following statement: "Generate [video, highlight video, or memory video] of [people] [time] [location] [interest]". In addition, in this implementation, the memory material processing module can determine the interests of the person based on the user's profile data in the query results and the people in the photos or videos included in the aggregation results corresponding to at least one event class in the i-th time range. There is no specific limitation on the interests; for example, interests may be, but are not limited to, one or more of the following: playing games, singing, dancing, reading, practicing calligraphy, and playing basketball. For example, the specific implementation of the memory material processing module in processing the query results according to the i-th time range to generate interest-related recommendation statements will not be detailed here. Optionally, the aforementioned person's interests can also be replaced with the person's hobbies, without specific limitations.

[0241] S1412-14, the memory material processing module determines the B currently generated recommendation statements associated with the event as the K recommendation statements corresponding to the K card information carried in the recommendation results.

[0242] In this embodiment, the order of the K recommended statements corresponding to the K card information can be determined according to the time range corresponding to each recommended statement. In one example, the recommended statements corresponding to the time ranges can be arranged in chronological order. For example, taking 3 (i.e., K equals 2) recommended statements corresponding to 3 time ranges (i.e., time range A, time range B, and time range 3) as an example, time range A is yesterday, time range B is this week (excluding yesterday), and time range C is last week. Then, the recommended statement corresponding to time range C is the first recommended statement, the recommended statement corresponding to time range B is the second recommended statement, and the recommended statement corresponding to time range A is the third recommended statement. In another example, the recommended statements corresponding to the time ranges can be arranged according to the length of the time range. For example, the recommended statement corresponding to the time range with the shortest time length can be the first recommended statement among the K recommended statements, the recommended statement corresponding to the time range with the second shortest time length can be the second recommended statement among the K recommended statements, and so on, with the recommended statement corresponding to the time range with the longest time length being the last recommended statement among the K recommended statements.

[0243] S1412-15, if the sum of the number of currently generated event-related recommendation statements and the number of interest-related recommendation statements meets the preset number 2, the recall material processing module determines the currently generated event-related recommendation statements and interest-related recommendation statements as the K recommendation statements corresponding to the K card information carried by the recommendation results.

[0244] The above section, in conjunction with S1412-0 to S1412-15, details the specific principle of the memory material processing module provided in this application's embodiments executing S1412. The following section describes, with examples, the recommended statements generated based on the above principles.

[0245] For example, the memory material processing module processes the query results according to each of the 5 time ranges (i.e., the values ​​of i mentioned above are 1, 2, 3, 4, and 5 respectively). The 5 time ranges are as follows: yesterday (i.e., the first time range), this week (excluding yesterday), last week (i.e., the third time range), this month (i.e., excluding this week and last week), and last month (i.e., the fifth time range). First, when the memory material processing module processes the query results according to "yesterday" and obtains more than 8 photos or videos associated with the event corresponding to "yesterday" (i.e., the preset number), the format of the event association recommendation statement generated by the memory material processing module can be as follows: "Generate a memory video of [person] yesterday [location] [event]". Secondly, when the memory material processing module processes the query results by "this week (excluding yesterday)," and the number of photos or videos associated with the events corresponding to "this week (excluding yesterday)" is greater than 8 (i.e., the preset number), the recommended statement generated by the memory material processing module can be in the following format: "Generate [Video] of [Person] this week [Location] [Event]". Then, when the memory material processing module processes the query results by "last week," and the number of photos or videos associated with the events corresponding to "last week" is greater than 8 (i.e., the preset number), the recommended statement generated by the memory material processing module can be in the following format: "Generate [Memory Video] of [Person] last week [Location] [Event]". Finally, when the memory material processing module processes the query results by "this month (excluding this week and last week)," and the number of photos or videos associated with the events corresponding to "this month (excluding this week and last week)" is greater than 8 (i.e., the preset number), the recommended statement generated by the memory material processing module can be in the following format: "Generate [Highlight Video] of [Person] this month [Location] [Event]". Finally, when the memory material processing module processes the query results according to "last month" and obtains more than 8 photos or videos associated with the events corresponding to "last month" (i.e., the preset number), the format of the recommendation statement generated by the memory material processing module can be as follows: "Generate [video] of [person] [location] [event] last month".

[0246] In one example, the preset quantity 2 equals 5. After executing the aforementioned multiple steps, the recall material processing module can know that the number of recommended statements associated with the current event is 5, which satisfies the preset quantity 2. Then, the recall material processing module can determine the 5 recommended statements obtained in the aforementioned steps as the K recommended statements corresponding to the K card information carried by the recommendation result.

[0247] In another example, the preset quantity 2 equals 8. After executing the aforementioned steps, the recall material processing module can determine that the number of event-related recommended statements (i.e., 5) does not meet the preset quantity 2 (i.e., 8). Therefore, the recall material processing module can process the query results according to the aforementioned 5 time ranges to generate 3 interest-related recommended statements. Subsequently, if the number of event-related and interest-related recommended statements obtained by the recall material processing module meets the preset quantity, the currently generated event-related and interest-related recommended statements are determined as the K recommended statements corresponding to the K card information carried in the recommendation results.

[0248] At this point, after executing S1412-0 to S1412-15, the media processing platform obtains recommendation results carrying information on K cards. Each card information includes the URL of each card, the recommendation statement in each card, and the cover photo of each card (K is a positive integer).

[0249] S1413, the media processing platform sends the recommendation results to the YOYO Smart Assistant. Correspondingly, the YOYO Smart Assistant receives the recommendation results sent by the media processing platform.

[0250] S1414, in response to YOYO Smart Assistant loading recommendation results, YOYO Smart Assistant displays a recommendation interface including K recommended cards corresponding to K card information.

[0251] YOYO Smart Assistant loads recommendation results by loading the resources of K cards based on the URLs of the K recommended cards.

[0252] YOYO Smart Assistant displays a recommendation interface containing K recommended cards corresponding to K card information. The presentation format of each recommended card in the interface is not specifically limited. For example, if K equals 3, these three recommended cards can be, but are not limited to, […]. Figure 8A The form shown in the text 800 of the smart display interface S8A is such that the time range corresponding to the first recommendation card in the text 800 (e.g., the day before yesterday) is earlier than the time range corresponding to the second recommendation card (e.g., yesterday), and the time range corresponding to the second recommendation card is earlier than the time range corresponding to the third recommendation card (e.g., today).

[0253] It should be noted that S1401 to S1414 above describe the path to smart cards via the gallery creation page as an example. Optionally, smart cards can also be accessed via other paths, such as the desktop cards, global search, or the floating ball in the gallery as mentioned above.

[0254] Thus, after executing S1401 to S1414 above, the statement recommendation method provided in this application can be implemented. In some implementations, after executing S1401 to S1414 above, the following can also be executed: Figure 14 S1415 to S1421 are shown by the dashed lines. S1415 to S1421 will be described below.

[0255] S1415, the user sends a trigger operation to YOYO Smart Assistant for one of the K recommendation cards in the recommendation interface.

[0256] S1416, in response to the user's trigger operation on one of the K recommendation cards in the recommendation interface, YOYO Smart Assistant generates a smart video production instruction corresponding to that recommendation card.

[0257] In step S1416 above, the smart video generation instruction corresponding to a recommendation card is used to instruct the generation of a video corresponding to the recommendation statement in that recommendation card. For example, if the recommendation statement in one of the K recommendation cards triggered by the user is "Make a video of the child playing with dad yesterday", then the smart video generation instruction corresponding to that recommendation card is used to instruct the generation of a video of the child playing with dad yesterday.

[0258] S1417, YOYO Smart Assistant sends a smart video generation command to the media processing platform. Correspondingly, the media processing platform receives the smart video generation command sent by YOYO Smart Assistant.

[0259] S1418, the media processing platform generates video according to the intelligent video generation instructions.

[0260] The media processing platform, based on the intelligent video generation command, searches the terminal device's image library for photos or videos corresponding to that command. Then, it filters and refines the searched photos or videos to obtain the target photos or videos corresponding to the command. Finally, it generates a video based on the target photos or videos. The filtering and refining processes are not specifically limited and can be predefined according to user needs. For example, the filtering process may include, but is not limited to, at least one of the following: removing duplicate photos, removing blurry photos, and removing photos with poor lighting. Similarly, the refining process may include, but is not limited to, at least one of the following: selecting photos or videos of people facing forward, selecting photos or videos of people in happy moments, and selecting photos or videos containing multiple people.

[0261] For example, in S1418 above, the video generated by the media processing platform can be as follows: Figure 9B The video 930 shown in the intelligent integrated dialogue interface S9B has a length of 20 seconds.

[0262] S1419, the media processing platform sends video to the video editing service. Correspondingly, the video editing service receives the video sent by the media processing platform.

[0263] Thus, after executing S1419, the video editing service can receive the video sent by the media processing platform. Then, within the video editing service, the video can be edited according to the user's editing needs. Editing can include, but is not limited to, one or more of the following: rendering, transitions, special effects, adding text, adding audio, adding filters, etc.

[0264] S1420, the media processing platform sends a video to the YOYO smart assistant. Correspondingly, the YOYO smart assistant receives the video sent by the media processing platform.

[0265] S1421, YOYO Smart Assistant displays a recommendation interface including videos.

[0266] Thus, after receiving a video, the YOYO Smart Assistant can display a video recommendation interface. Optionally, the video recommendation interface in step S1421 above may also include the K recommendation cards in step S1414 above, and information about one of the K recommendation cards selected by the user in step S1416 above.

[0267] For example, the YOYO smart assistant displaying a recommendation interface including videos in S1412 above can be as follows: Figure 9B The smart video interface S9B shown displays the text 920, "I think I've generated a video of your child playing with their father yesterday, come and take a look~", and the generated video 930. When the user needs to view the video 930, the user triggers the open video control 940 in the video 930, which allows them to view the content of the video 930.

[0268] It should be understood that the above Figure 14 The illustrated statement recommendation methods are for illustrative purposes only and do not constitute any limitation on the statement recommendation methods provided in this application. For example, in another example, the recommendation card may only include the recommendation statement; in this case, the recommendation card does not include a cover image. For example, in another example, the recommendation statement displayed on the recommendation card may include a statement that includes time, people, and events. For example, in another example, the recommendation statement displayed on the recommendation card may include a statement that includes time, place, people, and interests (also known as hobbies or preferences).

[0269] In this embodiment, a Smart Video Entry (i.e., Smart Video Control) is added to the gallery application of the terminal device. After the user triggers this Smart Video Entry, the YOYO Smart Assistant on the terminal device is launched. The YOYO Smart Assistant's skill page displays K recommendation cards containing K recommendation statements generated based on the user's memory nodes determined from real photo data and the user's profile data. Since each recommendation card is used to generate a video from photos in the photo data associated with the recommendation statement corresponding to each card, this method avoids the low video generation efficiency problem associated with videos generated through frequent dialogue between the user and the electronic device; that is, this method can improve video generation efficiency. Because the recommendation statements displayed on each recommendation card are determined based on the user's profile data and photo data, it ensures that the recommendation statements displayed on each recommendation card are content of interest to the user. This allows the videos generated based on each recommendation card to better meet the user's needs. This method avoids the problems of videos that cannot be generated based on fixed template recommendation statements when processing photo data, and the generated videos failing to meet the user's needs; that is, this method can improve the user experience. In summary, this method can improve video generation efficiency and enhance the user experience.

[0270] Below, in conjunction with Figure 16 This application introduces another method for recommending statements, as provided in its embodiments. Figure 16 The statement recommendation method described is for illustrative purposes only and does not constitute any limitation on the statement recommendation method provided in this application.

[0271] Figure 16 This is a schematic diagram of another statement recommendation method provided in an embodiment of this application. The resource allocation method provided in this embodiment can be derived from... Figure 1 The illustrated electronic device 100 performs this action, wherein the electronic device 100 may be, but is not limited to, a mobile phone. It is understood that the electronic device 100 may be implemented as software, or a combination of software and hardware. For example, as shown... Figure 16 As shown, the recommended methods for this statement include S1610 and S1620. Below, S1610 and S1620 will be described in detail.

[0272] S1610, the electronic device displays a first interface, wherein the first interface includes a first control.

[0273] The first interface includes a first control, which is used to trigger the electronic device to display the second interface. In other words, the first control provided by the first interface is the entry control for entering the second interface.

[0274] In the embodiments of this application, the first interface is not specifically limited. It should be understood that the first interface described below is only illustrative and does not constitute any limitation on the first interface applicable to the embodiments of this application.

[0275] In one example, the first interface is the desktop of an electronic device, which includes icons for one or more applications. For example, the first interface could be the desktop of an electronic device that includes at least one application icon, such as... Figure 5 The S5 desktop of the phone shown can have the first control as... Figure 5 The desktop shortcut 500 shows the video creation control 510.

[0276] In another example, the first interface is the interface of an application on the electronic device. For example, the first interface could be the interface of a gallery application on the electronic device, such as... Figure 12 The first control shown in the image gallery creation page S12 on the mobile phone can be... Figure 12 The intelligent image creation control 1200 is displayed on the creation page S12 shown. For example, the first interface can be the photo album interface of an electronic device, such as... Figure 13 The photo page S13 of the mobile phone is shown, and the photo page S13 displays the Smart Floating Ball 1300.

[0277] In yet another example, the first interface is the global search interface of the electronic device; for example, the first interface could be... Figure 11 The user interface S11 shown may have the following first control: Figure 11 The intelligent film control 1110 in the user interface S11 shown.

[0278] The method of displaying the first interface on the electronic device is not specifically limited. For example, if the first interface is the desktop of the electronic device, the electronic device displays the first interface in response to the user's screen unlocking operation. In another example, the first interface may be the interface of an application on the first electronic device. For instance, if the first interface is the interface of the photo gallery application, the electronic device displays the first interface in response to the user's triggering operation on the icon of the photo gallery application. Similarly, if the first interface is the interface of the photo gallery application, the electronic device displays the first interface in response to the user's voice wake-up operation on the photo gallery application.

[0279] S1620, in response to the triggering operation of the first control, the second interface is displayed. The second interface includes K recommendation cards and K recommendation statements that correspond one-to-one. Each recommendation card displays a corresponding recommendation statement. The K recommendation statements are determined based on the user's profile data and the user's photo data. Each recommendation card is used to trigger the electronic device to process the photo data into a video based on the recommendation statement corresponding to each recommendation card, so as to obtain the video associated with the recommendation statement corresponding to each recommendation card. K is a positive integer.

[0280] K is a preset value, and this preset value has an upper limit. The value of K can be predefined or dynamically adjusted. There is no specific limitation on the value of K; it can be set according to the actual scenario. For example, K can be set to 1, 2, or 3, or similar values, depending on the user's needs. Or, K can be set to 2 or 4, etc., depending on the performance of the electronic device.

[0281] The K recommended statements are determined based on the user's profile data and photo data. Specifically, each recommended statement is based on the user's profile data and photo data, where the photo data refers to photos stored on the electronic device. For example, the user's photo data can be, but is not limited to, photos stored in the electronic device's gallery.

[0282] In one example, before the electronic device displays the second interface, it can also obtain K recommendation statements by performing the following steps: The electronic device classifies the photo data to obtain K photo sets corresponding to K different event types, where each of the K photo sets corresponds one-to-one with a recommendation statement, and each recommendation statement is determined based on the corresponding photo set and the user's profile data; The electronic device analyzes each photo set to obtain memory information for each photo set, where the memory information includes information about the photos recorded in each photo set; The electronic device determines the recommendation statement corresponding to each photo set based on the memory information and profile data of each photo set, thus obtaining K recommendation statements.

[0283] Optionally, the memory information of each photo set in the above implementation may specifically include the time, location, people, and events recorded in each photo set, where the event is one of K different event types. Furthermore, based on the memory information and portrait data of each photo set, a recommendation statement corresponding to each photo set is determined to obtain K recommendation statements. This includes: the electronic device determining the people's information based on the portrait data and the memory information of each photo set, including the people recorded in the photos of each photo set; and the electronic device generating a recommendation statement corresponding to each photo set based on the people's information and the memory information of each photo set, to obtain K recommendation statements.

[0284] The character information can include the character, the character's relationships, and the character's role (e.g., child, daughter, son, father, or mother), without being specifically limited to these.

[0285] The method by which the electronic device generates a recommendation statement for each photo set based on the person's information and the memory information of each photo set is not specifically limited. In one example, the electronic device can generate a recommendation statement for each photo set according to a preset statement format, which includes the person, location, time, and event. For a detailed description of how the electronic device generates a recommendation statement for each photo set according to a preset statement format, please refer to the relevant description in step S1412-10 above; it will not be repeated here.

[0286] Optionally, in the above implementation, the electronic device classifies the photo data to obtain K photo sets corresponding to K different event types, including: the electronic device filters the photo data according to at least one preset time range to obtain at least one photo set that meets at least one preset time range; the electronic device classifies the at least one photo set that meets at least one preset time range according to event type to obtain K photo sets.

[0287] For example, the character information of the person in the above example can be as described above. Figure 15 The provided method includes information about the people (i), and the memory information for each photo set may include the above. Figure 15 The provided method generates an event with the i-th time range, location i, and the i-th time range corresponding to at least one event class; the at least one preset time range in the above example can be the one described above. Figure 15 In the provided method, the i-th time range, at least one set of photos within at least one preset time range in the above example can be the aforementioned... Figure 15 The i-th time range in the provided method corresponds to the aggregation result of at least one event class.

[0288] The second interface includes K recommendation cards and K recommendation statements, each corresponding to a specific card. The content of the recommendation statement displayed on each card is not specifically limited. For example, a recommendation statement on a card could include time, place, person, and event. Optionally, each recommendation card may also include a cover image.

[0289] For example, the second interface could be like this Figure 8A The intelligent video creation interface S8A shown includes a dialog box 800A displaying three recommendation cards (an example of the K recommendation cards mentioned earlier). Each recommendation card includes a recommendation statement and an associated image. The three recommendation statements are: "Create a video of the child playing with dad yesterday," "Generate a heartwarming video of the child and mom from last month," and "Generate a video of the child's growth from last year to this year." Similarly, the second interface could be... Figure 8B The intelligent video production interface S8B shown has a dialog box 800B displaying three recommendation cards (an example of the K recommendation cards mentioned earlier). Each recommendation card includes a recommendation statement and an image associated with that recommendation statement. The three recommendation statements corresponding to the three recommendation cards are, in order, "Make a video of your baby dancing", "Make a video of traveling in Nanjing", and "Generate a video of playing badminton yesterday".

[0290] In this embodiment of the application, in response to the triggering operation of the first control, the electronic device displays the second interface. The specific implementation process of the electronic device displaying the second interface after the user triggers the first control of the first interface is not limited.

[0291] In one implementation, in response to a triggering operation on the first control, the electronic device directly displays the second interface. It is understood that in this implementation, the switching process from the first interface to the second interface does not involve switching operations on other interfaces.

[0292] For example, taking the first interface as Figure 5 The S5 desktop of the phone shown can have the first control as... Figure 5 Taking the video creation control 510 in the desktop S5 as an example, when the user triggers... Figure 5 After using the video creation control 510 in the app, the phone can display... Figure 8A The intelligent integrated interface S8A shown is or Figure 8B The intelligent integrated interface S8B is shown.

[0293] In another implementation, in response to a triggering operation on the first control, the electronic device first displays other interfaces, and then, after triggering operations on controls on the other interfaces, the electronic device displays a second interface.

[0294] In one example, in response to a triggering operation on a first control, the electronic device displays a second interface, which may include the following steps: in response to a triggering operation on the first control, the electronic device displays a third interface, wherein the third interface includes multiple cards corresponding to multiple preset categories; in response to a triggering operation on one of the multiple cards, the electronic device displays the second interface.

[0295] There are no specific limitations on the various preset categories; they can be set according to user needs. For example, each preset category can be, but is not limited to, any of the following: My Daily Vlog, Family Photos, Daily Gatherings, Growth Theme, Travel Vlog, Food Collection, My Photo Album, Hobbies, or City Architecture, etc.

[0296] For example, the third interface could be like this Figure 7 The illustrated smartphone's Smart Video Interface S7 includes multiple preset categories, which may include, but are not limited to, daily vlogs, personal photo albums, family contracts, growth themes, travel vlogs, and food collections. In response to a triggering operation on a category within the Smart Video Interface S7, the smartphone displays the second interface described above.

[0297] In the above implementation, after the electronic device displays the first interface, and the user triggers a control on the first interface, the electronic device first displays the third interface. Then, after the user triggers a card of a preset category displayed on the third interface, the first electronic device displays the second interface.

[0298] In another example, in response to a triggering operation on a first control, the electronic device displays a second interface, including: in response to a triggering operation on the first control, displaying an interface including the second control and thumbnails corresponding to photo data; in response to a triggering operation on the second control, displaying a third interface, wherein the third interface includes multiple cards corresponding to multiple preset categories; and in response to a triggering operation on one of the multiple cards, the electronic device displays the second interface.

[0299] The thumbnails corresponding to the photo data can be thumbnails of all the photos in the photo data, or thumbnails of a portion of the photos in the photo data; there is no specific limitation on this.

[0300] For example, the interface described above, which includes the second control and the thumbnail corresponding to the photo data, could be as follows: Figure 6 The mobile phone's smart image processing interface S6 is shown. The second control can be control 600, and the thumbnail corresponding to the photo data can be the photo content displayed in the text box 610.

[0301] The third interface and multiple cards in multiple preset categories can be found in the description above, and will not be repeated here.

[0302] In the above implementation, after the electronic device displays the first interface, and the user performs a trigger operation on the first control of the first interface, the electronic device first displays an interface including the second control and the thumbnail corresponding to the photo data. Next, the user performs a trigger operation on the second control, and the electronic device displays the third interface. Then, after the user performs a trigger operation on a card of a preset category displayed on the third interface, the first electronic device displays the second interface.

[0303] As an example of this application, the electronic device includes a first application, a second application, and a media processing module. The first interface is the interface of the first application. The electronic device executes the above-described S1620, i.e., in response to a trigger operation on the first control, the electronic device displays the second interface, including: in response to a trigger operation on the first control, the first application sends a start command to the second application, wherein the start command carries the identifier of the first interface and the identifier of the first control; after receiving the start command, the second application sends a recommendation statement loading command to the media processing module, wherein the recommendation statement loading command is used to request the acquisition of recommendation cards for generating videos based on photo data; after the media processing module acquires the recommendation statement loading command, the media processing module generates K card information corresponding to K recommendation cards based on the portrait data and photo data; the media processing module sends the K card information to the second application; after the second application loads the K card information, it displays the second interface.

[0304] Optionally, the media processing module of the electronic device may also include a memory material processing module. In one example, after the media processing module obtains the recommendation statement loading instruction, the media processing module generates K card information corresponding to K recommendation cards based on the portrait data and photo data, including: after the memory material processing module obtains the recommendation statement loading instruction, the memory material processing module generates K card information corresponding to K recommendation cards based on the portrait data and photo data.

[0305] There is a one-to-one correspondence between K card information pieces and K recommended cards. Each card information piece is used to generate a corresponding recommended card. Each card information piece may include a recommendation statement from the recommended card. Optionally, each card information piece may also include a card cover image and a card URL. The card URL indicates the address of the resource (e.g., parameters) corresponding to each recommended card, and this resource is used to generate the structure of each recommended card (e.g., an oval or square card structure). Thus, the electronic device can obtain the resource corresponding to each recommended card based on the address indicated by the URL of each recommended card.

[0306] For example, one of the K recommendation cards could be... Figure 8A The intelligent image processing interface S8A shown displays recommendation card 801, recommendation card 802, or recommendation card 803.

[0307] Optionally, the electronic device also includes a media learning module, and after the second application receives the start command, the method further includes: the media processing module sending a query command to the media learning module; the media learning module sending query results including portrait data and photo data to the media processing module, so that the media processing module can obtain the portrait data and photo data.

[0308] Optionally, the first application mentioned above is a photo library, and the photo data includes photos stored in the photo library; the second application is a voice assistant.

[0309] For example, the first application described above could be Figure 14 The gallery shown can be used as a second application. Figure 14 The YOYO smart assistant is shown above. The first interface in the example above can be as described above. Figure 14 The creation page of the gallery shown can have its first control as a smart image creation control included on that page. The identifier of the first application in the example above can be the one mentioned above. Figure 14 The method provides the image gallery creation page identifier, and the identifier of the first control can be as described above. Figure 14 Provides the intelligent image identification in the method. The second interface in the above example can be as described above. Figure 14 The example shown is a recommendation interface for K recommended cards. The information for the K cards in the example above could be as described above. Figure 15 The recommended information is shown.

[0310] Optionally, after the electronic device executes S1620 above, it may also perform the following operations: In response to a trigger operation on the first recommended card among the K recommended cards, the electronic device displays a fourth interface, wherein the fourth interface includes a thumbnail of the first video. The first video is a video associated with the first recommended statement, generated by the electronic device after processing the photo data into a single image based on the first recommended statement. Then, in response to a trigger operation on the thumbnail of the first video, the electronic device displays a browsing interface for the first video. The electronic device displays the browsing interface for the first video, at which point the first video is in playback mode.

[0311] The fourth interface includes a thumbnail of the first video, but there are no specific limitations on whether the fourth interface includes other information. For example, the fourth interface may also include the first recommendation card corresponding to the first recommendation statement, and the first recommendation statement displayed after the user triggers the first recommendation card.

[0312] For example, the fourth interface could be Figure 9B The mobile phone's smart chat interface S9B is shown. The interface S9B displays text 920 saying, "I think I've generated a video of your child playing with dad yesterday, come and take a look~", along with the generated video 930. When the user needs to view video 930, the user triggers the open video control 940 within video 930 to view its content.

[0313] It should be understood that the above Figure 16 The sentence recommendation method shown is for illustrative purposes only and does not constitute any limitation on the sentence recommendation method provided in this application.

[0314] In this embodiment, after receiving a trigger operation on the first control of the first interface, the electronic device can directly display a second interface including K recommendation cards. Each recommendation card is used to generate video data based on photos in photo data associated with the recommendation statement corresponding to each recommendation card. This method avoids the problem of low video generation efficiency in videos generated through frequent dialogue between the user and the electronic device, thus improving the convenience and efficiency of video generation. Since the recommendation statement displayed on each recommendation card is determined based on the user's profile data and photo data, it is ensured that the recommendation statement displayed on each recommendation card is content that the user is interested in. This allows the video generated based on each recommendation card to better meet the user's needs. This method avoids the problem that videos cannot be generated based on photo data processing using fixed template recommendation statements, and that the generated videos cannot meet the user's needs. In other words, this method improves the user experience. In summary, this method can improve the efficiency of video generation and enhance the user experience.

[0315] The above text combined Figures 1 to 16 This document describes in detail the electronic devices, software architectures, system architectures, and statement recommendation methods applicable to the statement recommendation methods of the embodiments of this application. The following will combine... Figure 17 This application describes an embodiment of the apparatus. It should be understood that the statement recommendation apparatus in this application can execute the various statement recommendation methods described in the foregoing embodiments of this application; that is, the specific working processes of the various products described below can be referred to the corresponding processes in the foregoing method embodiments.

[0316] Figure 17 This is a schematic diagram of a statement recommendation device provided in an embodiment of this application. Exemplary, Figure 17 The illustrated statement recommendation device 1700 is used in an electronic device, and the statement recommendation device 1700 includes a processing unit 1710. The function of the processing unit 1710 will be described below.

[0317] The processing unit 1710 is configured to: display a first interface, wherein the first interface includes a first control; and, in response to a trigger operation on the first control, display a second interface, wherein the second interface includes K recommendation cards and K recommendation statements that correspond one-to-one, each recommendation card displaying a corresponding recommendation statement, the K recommendation statements being determined based on the user's profile data and the user's photo data, each recommendation card being used to trigger the electronic device to process the photo data into a video based on the recommendation statement corresponding to each recommendation card, so as to obtain a video associated with the recommendation statement corresponding to each recommendation card, where K is a positive integer.

[0318] In one possible implementation, the processing unit 1710 is further configured to: display a third interface in response to a trigger operation on the first control, wherein the third interface includes a plurality of cards corresponding to a plurality of preset categories; and display the second interface in response to a trigger operation on one of the plurality of cards.

[0319] In another possible implementation, the processing unit 1710 is further configured to: display an interface including a second control and a thumbnail corresponding to the photo data in response to a trigger operation on the first control; and display the third interface in response to a trigger operation on the second control.

[0320] In another possible implementation, the processing unit 1710 is further configured to: after displaying the second interface in response to the triggering operation of the first control, perform the following operation: in response to the triggering operation of the first recommendation card among the K recommendation cards, display a fourth interface, wherein the fourth interface includes a thumbnail of a first video, the first video being a video associated with the first recommendation statement generated by the electronic device after processing the photo data into a single image according to the first recommendation statement.

[0321] In another possible implementation, the processing unit 1710 is further configured to: classify the photo data to obtain K photo sets corresponding to K different event types, wherein the K photo sets correspond one-to-one with the K recommendation statements, and each recommendation statement is determined based on the corresponding photo set and the user's profile data; analyze each photo set to obtain memory information for each photo set, wherein the memory information includes information about the photos recorded in each photo set; and determine the recommendation statement corresponding to each photo set based on the memory information of each photo set and the profile data to obtain the K recommendation statements.

[0322] In another possible implementation, the memory information of each photo set specifically includes the time, location, people, and events recorded in the photos of each photo set, wherein the event is one of the K different event types, and the processing unit 1710 is further configured to: determine the person information of the person based on the portrait data and the memory information of each photo set, including the people recorded in the photos of each photo set; and generate a recommendation statement corresponding to each photo set based on the person information of the person and the memory information of each photo set, so as to obtain the K recommendation statements.

[0323] In another possible implementation, the processing unit 1710 is further configured to: filter the photo data according to at least one preset time range to obtain at least one set of photos that satisfy the at least one preset time range; and classify the at least one set of photos that satisfy the at least one preset time range according to event type to obtain the K sets of photos.

[0324] In another possible implementation, the first interface is the desktop of the electronic device, wherein the desktop of the electronic device includes icons of one or more applications, or the first interface is the interface of an application of the electronic device.

[0325] In another possible implementation, K is a preset value.

[0326] It should be noted that the device 1700 mentioned above is embodied in the form of a functional unit. The term "unit" here can be implemented in software and / or hardware, and there is no specific limitation on this.

[0327] For example, a "unit" can be a software program, a hardware circuit, or a combination of both that implements the above functions. The hardware circuit may include an application-specific integrated circuit (ASIC), electronic circuitry, a processor (e.g., a shared processor, a proprietary processor, or a group processor) and memory for executing one or more software or firmware programs, integrated logic circuitry, and / or other suitable components that support the described functions.

[0328] Therefore, the units of the various examples described in the embodiments of this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0329] This application also provides a computer program product that, when executed by a processor, implements the statement recommendation method described in any of the method embodiments of this application.

[0330] The computer program product can be stored in memory, for example, it is a program. The program is eventually converted into an executable object file that can be executed by the processor after processes such as preprocessing, compilation, assembly and linking.

[0331] This application also provides a chip including a processor, which, when executing instructions, implements the statement recommendation method described in any method embodiment of this application.

[0332] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the statement recommendation method described in any of the method embodiments of this application. The computer program may be a high-level language program or an executable object program.

[0333] In this application, "at least one" means one or more, and "more than one" means two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or multiple items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.

[0334] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0335] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0336] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0337] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for example, the division of units is merely a logical functional division, and other division methods may exist in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0338] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0339] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0340] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.< / videoview> < / imgview> < / textview>

Claims

1. A statement recommendation method, characterized in that, When applied to electronic devices, the method includes: Display a first interface, wherein the first interface includes a first control; In response to the triggering operation of the first control, a second interface is displayed, wherein the second interface includes K recommendation cards and K recommendation statements that correspond one-to-one. Each recommendation card displays a corresponding recommendation statement. The K recommendation statements are determined based on the user's profile data and the user's photo data. Each recommendation card is used to trigger the electronic device to process the photo data into a video based on the recommendation statement corresponding to each recommendation card, so as to obtain the video associated with the recommendation statement corresponding to each recommendation card. K is a positive integer. The electronic device includes a first application, a second application, and a media processing module. The first application is a gallery, and the photo data includes photos stored in the gallery. The second application is a voice assistant. The step of displaying a second interface in response to a trigger operation on the first control includes: In response to a triggering operation on the first control, the first application sends a launch command to the second application, wherein the launch command carries the identifier of the first interface and the identifier of the first control; After the second application receives the launch command, the second application sends a recommendation statement loading command to the media processing module, wherein the recommendation statement loading command is used to request the acquisition of recommendation cards for generating videos based on the photo data; After the media processing module obtains the recommendation statement loading instruction, the media processing module generates K card information corresponding to the K recommendation cards based on the portrait data and the photo data; The media processing module sends the K card information to the second application; After the second application loads the K card information, it displays the second interface; Wherein, after displaying the second interface in response to the triggering operation of the first control, the method further includes: In response to a trigger operation on the first recommendation card among the K recommendation cards, a fourth interface is displayed, wherein the fourth interface includes a thumbnail of a first video, which is a video associated with the first recommendation statement generated by the electronic device after processing the photo data into a block according to the first recommendation statement; Wherein, the first interface is the interface of the first application, or the first interface is the desktop of the electronic device, and the desktop of the electronic device includes icons of one or more applications.

2. The method according to claim 1, characterized in that, The step of displaying a second interface in response to a trigger operation on the first control includes: In response to a trigger operation on the first control, a third interface is displayed, wherein the third interface includes multiple cards corresponding to multiple preset categories; In response to a trigger operation on one of the plurality of cards, the second interface is displayed.

3. The method according to claim 1 or 2, characterized in that, The method further includes: The photo data is classified to obtain K photo sets corresponding to K different event types, wherein the K photo sets correspond one-to-one with the K recommendation statements, and each recommendation statement is determined based on the corresponding photo set and the profile data; Each photo set is analyzed and processed to obtain memory information for each photo set, wherein the memory information includes information about the photos recorded in each photo set; Based on the memory information of each photo set and the portrait data, the recommended statement corresponding to each photo set is determined to obtain the K recommended statements.

4. The method according to claim 3, characterized in that, The memory information of each photo set specifically includes the time, location, people, and event recorded in each photo set, where the event is one of the K different event types. Furthermore, the step of determining the recommended statement corresponding to each photo set based on the memory information and the portrait data to obtain the K recommended statements includes: Based on the portrait data and the memory information of each photo set, including the people recorded in the photos of each photo set, the person's information is determined; Based on the person's information and the memory information of each photo set, a recommendation statement is generated for each photo set to obtain the K recommendation statements.

5. The method according to claim 3, characterized in that, The process of classifying the photo data to obtain K photo sets corresponding to K different event types includes: The photo data is filtered according to at least one preset time range to obtain at least one set of photos that meets the at least one preset time range; The at least one set of photos that meets the at least one preset time range is classified according to the event type to obtain the K sets of photos.

6. The method according to claim 1 or 2, characterized in that, The electronic device further includes a media learning module, and, after the second application receives the launch command, the method further includes: The media processing module sends a query command to the media learning module; The media learning module sends query results, including the portrait data and the photo data, to the media processing module so that the media processing module can obtain the portrait data and the photo data.

7. The method according to claim 1 or 2, characterized in that, K is a preset value.

8. An electronic device, characterized in that, The electronic device includes: one or more processors, and a memory; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the statement recommendation method as described in any one of claims 1 to 7.

9. A chip system, characterized in that, The chip system is applied to an electronic device, the chip system including one or more processors, the one or more processors being used to invoke computer instructions to cause the electronic device to perform the statement recommendation method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the statement recommendation method as described in any one of claims 1 to 7.

Images