Image display method and electronic device
By cyclically displaying selected images and adding time-lapse photos in the desktop display card on electronic devices, the problem of users having difficulty browsing photos is solved, enhancing user memory and experience.
Patent Information
- Application Number
- CN202310664566.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-14
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2042-01-14
AI Technical Summary
Users often don't have time to browse their photo library after taking pictures, which means that photos that evoke fond memories cannot be used to their advantage and cannot help users recall those precious moments.
By displaying selected images in a loop on the desktop display card of electronic devices, and adding time-lapse images within specific time periods, the system enhances the user's sense of nostalgia and surprise.
It enhances the user experience of recalling the past through pictures, increases user attention to photos and allows them to relive fond memories, thus improving the user experience.
Smart Images

Figure CN116861019B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a picture display method and an electronic device. Background Art
[0002] With the continuous development of computer technology, electronic devices with camera functions are becoming more and more common in people's daily lives. People discover the beauty of life through taking photos, and every photo taken is a visual record of personal history.
[0003] Currently, after users take photos through electronic devices, it is difficult to find time to browse photos in the gallery application. Therefore, many photos with good memories cannot play their own value and cannot help users recall the good memories of the past. However, in this fast-paced era, the memories evoked by a certain picture can soothe the busy heart and are often the warmest comfort to the soul. Summary of the invention
[0004] The present application provides a picture display method and an electronic device. Through some embodiments of the present application, it can help users recall the past through pictures and improve user experience.
[0005] In a first aspect, an embodiment of the present application provides a method for displaying an image, the method comprising:
[0006] In response to the first operation, a first card is displayed on the desktop of the electronic device, and in each sub-time period of a first time period, a first-category picture is displayed in the first card, the first time period includes at least two sub-time periods, and the first-category pictures are pictures determined from the photo album of the electronic device according to the attributes of the first-category pictures;
[0007] The first picture is displayed in the first card, and a recommended second-category picture is detected. In response to the recommendation, after the first picture is displayed, the second-category picture and the category identifier of the second-category picture are displayed in the first card; wherein the second-category picture is a picture determined from the photo album of the electronic device according to the attributes of the second-category picture, and the first picture is a picture in the first-category picture;
[0008] After displaying the last picture in the second category of pictures, continue to display the pictures after the first picture in the first category of pictures.
[0009] In the embodiment of the present application, the first operation can be understood as a user operation that triggers the electronic device to display the first card on the desktop. For example, the first operation can be understood as Fig.18 The first user operation in the corresponding embodiment, that is, Figure 4 The operation of enabling the electronic device to turn on the "Smart Selection" mode.
[0010] In the embodiment of the present application, the first card can be understood as a display frame, or a desktop card, for example Fig.18 The first display frame in the corresponding embodiment. It can be understood that the electronic device displays the picture in the above-mentioned first card, for example, the electronic device displays the picture in the above-mentioned first category of pictures in the above-mentioned first card, or the electronic device displays the picture in the above-mentioned second category of pictures in the above-mentioned first card, etc. It should be understood that a desktop of an electronic device may include multiple above-mentioned first cards, and the electronic device may display pictures on multiple above-mentioned first cards through the above-mentioned picture display method. It should also be understood that the desktop where the first card is located may be the main desktop or other desktops, and this application does not limit this.
[0011] In the embodiment of the present application, the pictures in the first category of pictures can be understood as selected pictures. In some embodiments, the first category of pictures can be understood as Figure 5 Any round of selected pictures in the corresponding description, for example, the first category of pictures mentioned above can be understood as the first round of selected pictures, or the second round of selected pictures, or the third round of selected pictures, etc. In some other embodiments, the first category of pictures mentioned above can also be understood as Fig.18 The first selected picture set in the corresponding embodiment.
[0012] In an embodiment of the present application, the electronic device displays a first category of pictures in a first time period. In the embodiment of the present application, the first time period includes at least two sub-time periods, and the first category of pictures are displayed sequentially in each sub-time period.
[0013] It should be understood that the refresh of the image by the electronic device is determined according to the screen light duration of the electronic device on the desktop where the first card is located. For specific refresh methods, please refer to Figure 6 and Figure 7 Therefore, the time taken by the electronic device to display the first category of pictures in the above-mentioned first card may be different. For example, the above-mentioned first time period is 3 days, that is, the electronic device can repeatedly display the above-mentioned first category of pictures twice within 3 days, or can repeatedly display the above-mentioned first category of pictures three times. Therefore, in an embodiment of the present application, the duration of each sub-time period in the above-mentioned first time period may be the same or different. Exemplarily, the above-mentioned first category of pictures is displayed twice within 3 days: the first display of the first category of pictures is completed on the first day, and the second display of the first category of pictures is completed on the second and third days. Among them, the first day can be understood as a sub-time period, and the second and third days can be understood as another sub-time period.
[0014] In the embodiment of the present application, the pictures in the second category of pictures can be understood as moment pictures, or moment picture sets. For example, the electronic device can regard pictures in a single day or multiple days as the same event, and then select moment pictures from pictures corresponding to the same event. The specific method for determining the moment pictures can be referred to in Fig.12 The relevant description will not be repeated here.
[0015] In the embodiment of the present application, the electronic device displays the second category of pictures on the first card while the first card displays the second category of pictures. The category identifier can be understood as the name of the second category of pictures. In some embodiments, the category identifier can be used to distinguish the second category of pictures from the first category of pictures. For example, the electronic device can automatically set the category identifier of the second category of pictures, which can be "Weekend Memories", "Looking Back", "Brilliant Times", etc.
[0016] In the embodiment of the present application, the moment when the electronic device displays the first picture in the first category of pictures may belong to any sub-time period within the first time period. When the first picture is displayed, it is detected that there is a recommended second category of pictures. After the first picture is displayed, the electronic device jumps to display the second category of pictures. After the second category of pictures is displayed, the pictures after the first picture in the first category of pictures are displayed. In the case where the first category of pictures is understood as the first round of selected pictures and the second category of pictures is understood as the moment pictures, the display process of jumping from the first round of selected pictures to the moment pictures can also be referred to. Fig.13 Related description.
[0017] In the embodiment of the present application, the electronic device repeatedly displays the first category of pictures in the first time period, which can increase the frequency of the user seeing the same picture in the first time period, strengthen the recollection of the same picture, and enhance the user experience. In addition, the first category of pictures is determined according to the attributes of the first category of pictures, and the second category of pictures is determined according to the attributes of the second category of pictures. Adding the second category of pictures to the display process of the first category of pictures can enhance the sense of surprise and enhance the user experience.
[0018] In a possible implementation, the first category of image attributes includes any one or more of the following: image pixels, image clarity, image color saturation, image composition, image subject recognition, and image subject category recognition; the second category of image attributes includes image time information and / or location information.
[0019] In the embodiment of the present application, the above-mentioned first type of image attributes can be understood as indicators in the quality assessment and aesthetic assessment dimensions of the image, and specific reference can be made to the description of "Image Assessment Dimensions" in Part 2 of the terminology. It should be understood that the electronic device can use computer vision algorithms to automatically score images based on the pixels of the image, the clarity of the image, the color saturation of the image, the composition of the image, the recognition of the image subject, the recognition of the category of the image subject, etc., and images with high scores can be considered to be better images.
[0020] In the embodiment of the present application, the time information of the picture may be the creation time, update time, and addition time of the picture, etc. For details, please refer to the first part of the term "time information of the picture". The location information of the picture can be understood as the location when the electronic device obtains the picture, such as the geographical location when the electronic device takes the picture, that is, the shooting location of the picture.
[0021] In a possible implementation, the above method further includes:
[0022] In each sub-time period of the second time period, the third category of pictures is displayed in the first card, the second time period includes at least two sub-time periods, the third category of pictures is determined from the photo album of the electronic device according to the attributes of the first category of pictures, and the pictures in the third category of pictures are different from the pictures in the first category of pictures.
[0023] In the embodiment of the present application, the second time period may be understood as another time period different from the first time period. Similar to the first time period, the second time period includes at least two sub-time periods, wherein the duration of each time period may be the same or different.
[0024] In the embodiment of the present application, the third category of pictures is determined in the same manner as the first category of pictures, that is, the first category of pictures and the second category of pictures are determined according to the attributes of the first category of pictures. In other words, the third category of pictures can also be understood as selected pictures, except that each picture in the first category of pictures is different from each picture in the third category of pictures. For example, Figure 5 In the example, the electronic device can select selected pictures from the photo pool. In the above first category of pictures, it is understood that Figure 5 In the case of the first round of selected pictures, the second category of pictures can be understood as Figure 5The second round of selected pictures in the above. Accordingly, the above first time period can be understood as the time period for displaying the above first round of selected pictures, and the above second time period can be understood as the time period for displaying the above second round of selected pictures. For details, please refer to Figure 10 (A). In Figure 10 (A), the first round of selected pictures are displayed from March 15th to March 17th, so the above March 15th to March 17th can be understood as the above first time period. In Figure 10 (B), the second round of selected pictures are displayed from March 18th to March 20th, so the above March 18th to March 20th can be understood as the above second time period. In addition, as shown in Figure 10 (A), the first round of selected pictures are displayed for the first time from 10:08:20 on March 15th to 13:05:24 on March 15th, and the above March 15th from 10:08:20 to 13:05:24 on March 15th can be understood as a sub-time period in the above first time period.
[0025] It should be understood that the above first category of pictures is understood as Figure 5 In the case of the first round of selected pictures, the above second category of pictures can also be understood as Figure 5 Alternatively, the first category of images can be understood as Figure 5 The second round of selected pictures in the above second category can be understood as Figure 5 The specific situation is similar to the above and will not be repeated here.
[0026] In an embodiment of the present application, the electronic device cyclically displays different pictures in different time periods, namely the first time period and the second time period. On the one hand, the user can see the same picture repeatedly in each time period, thereby enhancing the user experience of recalling the past through the picture; on the other hand, displaying different pictures in different time periods can increase the sense of surprise and enhance the user experience.
[0027] In a possible implementation manner, before detecting that there is a recommended second-category picture, the method further includes:
[0028] The above-mentioned second category pictures are determined according to the attributes of the above-mentioned second category pictures; the above-mentioned second category pictures include any one of the first subcategory pictures that meet the first condition, the second subcategory pictures that meet the second condition, and the third subcategory pictures that meet the third condition; the above-mentioned first condition is that the time difference between the creation time of the picture and the current time is less than or equal to the first threshold; the above-mentioned second condition is that the time difference between the creation time of the picture and the first time is less than or equal to the second threshold, and the above-mentioned first time and the current time belong to the same day in different years; the above-mentioned third condition is that the shooting location of the picture is the same as the current location of the above-mentioned electronic device.
[0029] In the embodiment of the present application, the above-mentioned second category pictures can be understood as moment pictures, the above-mentioned first subcategory pictures can be understood as today's moment pictures, the above-mentioned second subcategory pictures can be understood as today's moment pictures in previous years, and the above-mentioned third subcategory pictures can be understood as revisiting moment pictures. In other words, the above-mentioned first subcategory pictures, the above-mentioned second subcategory pictures, and the above-mentioned third subcategory pictures can all be understood as second category pictures, but the conditions for the electronic device to select each category of moment pictures are different.
[0030] For descriptions of today's time pictures, previous years' time pictures, and old places revisited time pictures, please refer to Fig.12 The first threshold can be understood as Fig.12 The first time threshold in the relevant description of the above second threshold can be understood as Fig.12 The second time threshold in the relevant description.
[0031] It should be understood that in the embodiments of the present application, there may be multiple ways to trigger the electronic device to select a moment picture from the album pictures. For example, the electronic device may periodically screen the pictures in the album and select pictures that meet the conditions (i.e., the first condition, the second condition, or the third condition) as the moment pictures; the electronic device may select the moment picture from the album pictures when the screen is turned off while charging; it may also obtain its own geographic location in real time and select the moment picture from the album pictures when the location changes. Therefore, the above current time may be understood as the moment when the electronic device is triggered to select the moment picture from the album pictures. For example, after the electronic device is triggered to select the moment picture from the album pictures, the electronic device may first obtain a timestamp and then use the timestamp as the current time to select the moment picture. In addition, the above current position may be understood as the position of the electronic device when it is triggered to select the moment picture from the album pictures.
[0032] In an embodiment of the present application, when the second category of pictures is displayed in the first card, the category identification of the second category of pictures is also displayed in the first card. That is to say, when the electronic device displays the first subcategory pictures, the second subcategory pictures and the third subcategory pictures, it will display the category identification in the first card, for example, it may be "Weekend Memories", "Looking Back", "Brilliant Time" and so on.
[0033] In a possible implementation, when the second category of pictures is the second subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes:
[0034] When displaying the second picture in the second subcategory of pictures, it is detected that there is a recommended picture in the first subcategory, and in response to the recommendation, after displaying the second picture, the picture in the first subcategory and the category identifier of the picture in the first subcategory are displayed in the first card;
[0035] After displaying the last picture in the first subcategory of pictures, continue to display pictures after the second picture in the second subcategory of pictures and the category identifiers of the pictures;
[0036] After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes:
[0037] After displaying the last picture in the second subcategory of pictures, continue to display the pictures after the first picture in the first category of pictures.
[0038] In this embodiment, the second subcategory picture can be understood as the pictures of today's time in previous years, and the first subcategory picture can be understood as the pictures of today's time. For ease of understanding, the pictures of today's time in previous years and the pictures of today's time are explained below. The second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended picture of today's time, that is, the pictures of today's time in previous years being displayed.
[0039] In an embodiment of the present application, when a recommended picture of today's time is detected during the process of displaying pictures of today's time in previous years, the electronic device first jumps to display the picture of today's time, and after the picture of today's time is displayed, it continues to display pictures of today's time in previous years, and after the pictures of today's time in previous years are displayed, it continues to display the selected pictures.
[0040] In the embodiment of the present application, after the selected pictures are displayed, in the next round of display, the electronic device will display the selected pictures in the previous round, the pictures of today's time, and the pictures of today's time in previous years in the order of display. Fig.15 Related description.
[0041] In a possible implementation, when the second category of pictures is the third subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes:
[0042] When displaying the second picture in the third subcategory of pictures, it is detected that there is a recommended picture in the first subcategory, and in response to the recommendation, after displaying the second picture, the picture in the first subcategory and the category identifier of the picture in the first subcategory are displayed in the first card;
[0043] After displaying the last picture in the first subcategory of pictures, continue to display pictures after the second picture in the third subcategory of pictures and the category identifiers of the pictures;
[0044] After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes:
[0045] After displaying the last picture in the third subcategory of pictures, continue to display the pictures after the first picture in the first category of pictures.
[0046] In the embodiment of the present application, the third subcategory picture can be understood as a revisiting time picture, and the first subcategory picture can be understood as a today's time picture. For ease of understanding, the following description is based on the revisiting time picture and the today's time picture. The second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended today's time picture, that is, the revisiting time picture being displayed.
[0047] In an embodiment of the present application, when a recommended picture of today's time is detected during the process of displaying a picture of the time of revisiting an old place, the electronic device first jumps to display the picture of today's time, and after the picture of today's time is displayed, it continues to display the pictures of today's time in previous years, and after the picture of the time of revisiting the old place is displayed, it continues to display the selected pictures.
[0048] In an embodiment of the present application, after the selected pictures are displayed, in the next round of display, the electronic device will display them in the order of the selected pictures, today's time pictures and revisited time pictures in the previous round.
[0049] In a possible implementation, when the second category of pictures is the second subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes:
[0050] When displaying the second picture in the second subcategory, the recommended third subcategory picture is detected, and after the last picture of the second subcategory is displayed, the third subcategory picture and the category identifier of the third subcategory picture are displayed in the first card;
[0051] After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes:
[0052] After displaying the last picture in the third subcategory of pictures, continue to display the pictures after the first picture in the first category of pictures.
[0053] In the embodiment of the present application, the second subcategory picture can be understood as the pictures of today's time in previous years, and the third subcategory picture can be understood as the pictures of the time of revisiting the old place. For ease of understanding, the pictures of today's time in previous years, the pictures of the time of revisiting the old place and the pictures of today's time are explained below. The second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended picture of the time of revisiting the old place. That is, the pictures of today's time in previous years that are being displayed.
[0054] In the embodiment of the present application, when a recommended revisiting time picture is detected during the process of displaying the pictures of today's time in previous years, the electronic device first displays the pictures of today's time in previous years and then displays the pictures of revisiting time in previous years, and then displays the selected pictures after the pictures of revisiting time in previous years are displayed. In the embodiment of the present application, after the selected pictures are displayed, in the next round of display, the electronic device will display the selected pictures, the pictures of today's time in previous years and the pictures of revisiting time in previous years in the order of display. For details, please refer to Fig.14 Related description.
[0055] In a possible implementation, when the second category of pictures is the third subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes:
[0056] When displaying the second picture in the third subcategory, the recommended second subcategory picture is detected, and after the last picture of the third subcategory is displayed, the second subcategory picture and the category identifier of the second subcategory picture are displayed in the first card;
[0057] After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes:
[0058] After displaying the last picture in the second subcategory of pictures, continue to display the pictures after the first picture in the first category of pictures.
[0059] In the embodiment of the present application, the second subcategory picture can be understood as the pictures of the time of today in previous years, and the third subcategory picture can be understood as the pictures of the time of revisiting the old place. For ease of understanding, the pictures of the time of today in previous years, the pictures of the time of revisiting the old place and the pictures of the time of today are explained below. The second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended picture of the time of today in previous years. That is, the picture of the time of revisiting the old place being displayed.
[0060] In the embodiment of the present application, when a recommended picture of today's time in previous years is detected during the process of displaying the picture of the time of revisiting an old place, the electronic device first displays the picture of the time of revisiting an old place and then displays the picture of today's time in previous years, and then displays the selected picture after the picture of today's time in previous years is displayed. In the embodiment of the present application, after the selected picture is displayed, in the next round of display, the electronic device will display the selected picture, the picture of today's time in previous years, and the picture of the time of revisiting an old place in the order of display in the previous round.
[0061] In a possible implementation, the detecting of the recommended second-category picture, in response to the recommendation, after displaying the first picture, displaying the second-category picture and the category identifier of the second-category picture in the first card includes:
[0062] When recommended second-subcategory pictures and third-subcategory pictures are detected at the same time, in response to the recommendation, the second-subcategory pictures and the category identification of the pictures are displayed in the first card, and after the last picture of the second-subcategory pictures is displayed, the third-subcategory pictures and the category identification of the pictures are displayed.
[0063] In the embodiment of the present application, the second subcategory picture can be understood as the pictures of today's time in previous years, and the third subcategory picture can be understood as the pictures of the time of revisiting the old place. When the recommended pictures of today's time in previous years and the pictures of the time of revisiting the old place are detected at the same time, the electronic device first displays the pictures of today's time in previous years, and then displays the pictures of the time of revisiting the old place. It should be understood that after the pictures of the time of revisiting the old place are displayed, the electronic device continues to display the selected pictures.
[0064] In a possible implementation, the display duration of the second category pictures in the first card is determined according to the time information of each picture in the second category pictures.
[0065] It should be understood that in the embodiment of the present application, the above-mentioned second type of pictures can be understood as moment pictures, and the moment pictures can be pictures in a single day or multiple days as the same event, and then selected from the pictures corresponding to the same event. In the case where the moment pictures are composed of pictures from multiple days, the number of days occupied by the moment pictures can be called the moment days. For example, the moment days of the moment pictures composed of pictures created between May 3rd and May 5th are 3 days, and the moment days of the moment pictures composed of pictures created on April 20th are 1 day.
[0066] Exemplarily, when a moment picture is composed of pictures with creation time on the same day, after the electronic device detects the moment picture, it will display the moment picture in a loop in the first card for 1 day. Also exemplarily, when a moment picture is composed of pictures with creation time on 3 consecutive days, after the electronic device detects the moment picture, it will repeatedly display the moment picture in the first card for 3 days. It should be understood that when the electronic device repeatedly displays the moment picture in the above-mentioned first card according to the time information of the moment picture, the moment picture is displayed in a loop together with the selected picture, as shown in the following example. Fig.17 In the display process of the picture A of today's time in previous years, the picture A of today's time in previous years is composed of pictures from October 2 to October 4, a total of 3 days, and the display duration of the picture A of today's time in previous years is 3 days. Among them, on October 2, the picture A of today's time in previous years is displayed together with the first round of selected pictures; on October 3, the picture A of today's time in previous years is displayed together with the first round of selected pictures; on October 4, the picture A of today's time in previous years is displayed together with the third round of selected pictures.
[0067] In a possible implementation, when the second category picture is the third subcategory picture and the current position of the electronic device is different from the shooting position of the picture in the third subcategory picture, stop displaying the third category picture in the first card.
[0068] In an embodiment of the present application, the third subcategory of pictures can be understood as revisiting pictures. Since the revisiting pictures are related to the current position of the electronic device, when the position of the electronic device is the shooting position of the revisiting pictures, the electronic device recommends the revisiting pictures to better help the user recall the past through pictures. When the position of the electronic device is different from the shooting position of the revisiting pictures, the electronic device stops displaying the revisiting pictures, so that the display time of the revisiting pictures can be aligned with the time when the user is at the shooting position of the revisiting pictures, so as to enhance the user experience.
[0069] In a possible implementation, when the second category of pictures includes at least two groups of pictures formed by different time nodes, a group of pictures closest to the current time is preferentially displayed in chronological order.
[0070] In an embodiment of the present application, the above-mentioned second category of pictures can be understood as moment pictures. When the electronic device determines the moment picture according to the conditions of each category of moment pictures, each category of moment pictures may include multiple groups of pictures with different time information, that is, the second category of pictures includes at least two groups of pictures composed of different time nodes. For example, for the moment pictures of today in previous years, assuming that this year is October 1, 2021, then the picture of October 1, 2020 can be used as the moment picture of today in previous years, and the picture of October 1, 2015 can also be used as the moment picture of today in previous years. In the above case, October 1, 2020 and October 1, 2015 can be understood as different time nodes.
[0071] For another example, for pictures of revisiting a place, assuming that this year is 2021, the user may have been to place A in 2018, 2015, and 2013. Then, in 2021, after the user arrives at place A, pictures from 2018, 2015, and 2013 can all be used as pictures of revisiting a place. In the above case, 2018, 2015, and 2013 can also be understood as different time nodes.
[0072] For example, this year is 2021, and when the recommended today's time in previous years includes two sets of pictures, namely, today's time pictures in previous years in 2020 and 2015, the electronic device first displays today's time pictures in previous years in 2020, and then displays today's time pictures in previous years in 2015. Exemplarily, the electronic device may also first display today's time pictures in previous years in 2015, and then display today's time pictures in previous years in 2020. For this embodiment, please refer to Fig.16 Related description.
[0073] In some embodiments, when the second type of pictures includes at least two groups of pictures composed of different time nodes, the electronic device can reduce the number of pictures in each group. For example, when the recommended moment pictures are a group of pictures, the number of moment pictures is 10, and when the recommended moment pictures have multiple groups of pictures, the number of moment pictures in each group can be reduced to 5, so as to display as many asynchronous moment pictures as possible to the user, thereby enhancing the user experience.
[0074] In a possible implementation, the above method further includes:
[0075] During the process of displaying the first picture, a second operation performed on the first card is detected, and in response to the second operation, a picture next to the first picture in the first category of pictures is displayed in the first card;
[0076] Alternatively, in response to the second operation, a previous picture of the first picture in the first category of pictures is displayed in the first card.
[0077] In the embodiment of the present application, the second operation can be understood as Figure 8 The second operation in the corresponding embodiment is performed inside the first card to trigger the electronic device to switch the picture displayed in the first card. For example, the second operation can be a long press + swipe up / down operation, or a long press + swipe left / right operation in the desktop card, or a swipe up / down operation, as long as it does not conflict with other gestures on the desktop of the electronic device.
[0078] In the embodiment of the present application, when the electronic device switches pictures in response to the second operation, it switches between the first category of pictures selected for display in the first card, that is, when the electronic device detects the second operation when displaying the first picture, the electronic device switches to the previous picture of the first picture in the first category or the next picture of the first picture in the first category. Exemplarily, when the second operation is long press + swipe up, the electronic device switches to the next picture of the first picture in the first category; when the second operation is long press + swipe down, the electronic device switches to the previous picture of the first picture in the first category.
[0079] In an embodiment of the present application, the second operation can be used to quickly switch the images in the first card, allowing the user to view other images in the first card at will, thereby improving the user experience.
[0080] In a second aspect, an embodiment of the present application provides an electronic device, the electronic device comprising: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store a computer program code, the computer program code includes a computer instruction, the one or more processors call the computer instruction to make the electronic device cooperate with a display to perform the method in the first aspect or any possible implementation manner of the first aspect;
[0081] In a third aspect, an embodiment of the present application provides a chip, which is applied to an electronic device, and the chip includes one or more processors, which are used to call computer instructions so that the electronic device cooperates with a display to execute the method described in the first aspect and any possible implementation method of the first aspect.
[0082] In a fourth aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on an electronic device, enables the electronic device to execute the method described in the first aspect and any possible implementation manner of the first aspect.
[0083] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions. When the instructions are executed on an electronic device, the electronic device executes the method described in the first aspect and any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0084] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0085] Figure 1 It is a schematic diagram of a user interface for displaying a "wonderful moment" picture on a negative one screen provided by an embodiment of the present application;
[0086] Figure 2 This is a user interface diagram for setting a desktop and adding a display frame to the desktop to display gallery photos, provided in an embodiment of the present application;
[0087] Figure 3 It is a user interface diagram of setting a service card on a gallery application to display pictures provided by an embodiment of the present application;
[0088] Figure 4 A schematic diagram of a user interface for enabling the "smart selection" mode provided in an embodiment of the present application;
[0089] Figure 5 is a schematic diagram of an electronic device selecting a selected picture from a photo pool provided by an embodiment of the present application;
[0090] Figure 6 It is a schematic diagram of a user interface for refreshing a selected image displayed in a desktop card while keeping the interface unchanged, provided by an embodiment of the present application;
[0091] Figure 7 It is a user interface schematic diagram for refreshing the selected pictures displayed in the desktop card when the interface changes, provided by an embodiment of the present application;
[0092] Figure 8 is a schematic diagram of a user interface for refreshing selected images in response to a user operation on a desktop card provided by an embodiment of the present application;
[0093] Fig. 9 is a schematic diagram of a user interface for viewing selected pictures in response to a user operation provided by an embodiment of the present application;
[0094] FIG. 10(A) is a schematic diagram of a user interface for repeatedly displaying selected images in a desktop card according to an embodiment of the present application;
[0095] FIG. 10(B) is a schematic diagram of another user interface for repeatedly displaying selected images in a desktop card provided by an embodiment of the present application;
[0096] Fig.11 It is a schematic diagram of displaying selected pictures after the album pictures change, provided by an embodiment of the present application;
[0097] Fig.12 It is a schematic diagram of a type of moment picture provided by an embodiment of the present application;
[0098] Fig.13 This is a schematic diagram of adding a moment picture to display in the process of displaying a selected picture provided by an embodiment of the present application;
[0099] Fig.14 This is a schematic diagram of adding a revisiting time picture to display the pictures of today's time in previous years in an embodiment of the present application;
[0100] Fig.15 This is a schematic diagram of adding today's time picture to the process of displaying today's time pictures in previous years provided by an embodiment of the present application;
[0101] Fig.16 This is a schematic diagram of recommending two groups of pictures of today's time in previous years for display while displaying selected pictures provided by an embodiment of the present application;
[0102] Fig.17 This is a schematic diagram of displaying selected pictures and pictures of today's time in previous years with a time number of 3 days provided in an embodiment of the present application;
[0103] Fig.18 This is a flow chart of a display method for displaying selected pictures provided in an embodiment of the present application;
[0104] Fig.19 It is a flow chart of a display method for adding a moment picture to a selected picture for display provided in an embodiment of the present application;
[0105] Fig. 20 is a structural diagram of an electronic device 100 provided in an embodiment of the present application;
[0106] Fig.21 It is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application. DETAILED DESCRIPTION
[0107] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.
[0108] In order to more clearly describe the solution provided by the present application, the terms involved in the embodiments of the present application are first introduced below.
[0109] 1. Time information of the picture
[0110] It is understandable that multiple pictures can be stored inside the electronic device, and the electronic device can respond to user operations to add, delete, modify, etc. pictures. Therefore, in the embodiment of the present application, the picture attributes include time information.
[0111] In the embodiment of the present application, a picture may correspond to three different time information, namely, the creation time of the picture, the update time of the picture, and the addition time of the picture.
[0112] 1.1. Image creation time
[0113] The creation time of a picture can be understood as the time when the electronic device obtains the picture. For example, the moment when the electronic device takes the picture (also called the shooting time), the moment when the picture is obtained by screenshot (also called the screenshot moment), the moment when the picture is saved from the software (such as WeChat, Weibo), and the moment when the picture is obtained through the communication connection with other electronic devices. Exemplarily, the electronic device can determine the creation time of the picture from the exchangeable image file (EXIF) information.
[0114] 1.2. Image update time
[0115] The update time of a picture can be understood as the time when the picture is updated after the creation time of the picture. Exemplarily, updating a picture can be understood as editing the picture. For example, the electronic device can respond to the user's editing operation and modify the size and color of the picture. When the electronic device edits picture A and saves the edited picture A as picture B, the creation time of picture B is the creation time of picture A. At the same time, picture B also corresponds to the update time, that is, the time when the electronic device stores picture B.
[0116] In another exemplary embodiment, picture C is taken by electronic device B, so the time information of picture C includes the creation time in electronic device B. After electronic device B shares picture C to electronic device A through social software, the time information of picture C in electronic device A includes the creation time and the update time, and the update time is the time when electronic device A receives picture C.
[0117] 1.3. Time of adding pictures
[0118] The time when a picture is added can be understood as the time when the picture is added to the album. For example, the electronic device can add a picture to the album in response to a share operation, a move operation, a copy operation / paste operation, an edit save operation, and the like.
[0119] It should be understood that electronic device A can establish a wireless connection with electronic device B, such as a Bluetooth connection, a wifi connection, etc., and then share pictures through the wireless connection. For example, when electronic device B shares picture C with electronic device A via a Bluetooth connection, electronic device A will automatically create a shared album, such as a "Bluetooth Share" album, and automatically add picture C received via the Bluetooth connection to the "Bluetooth Share" album. Therefore, in electronic device A, the time of adding picture C is the time when electronic device A receives picture C via the Bluetooth connection and adds it to the "Bluetooth Share" album.
[0120] It should be understood that when moving picture C from album A to album B, the creation time of picture C will not change, and the adding time is the time when it is moved to album B.
[0121] It should be understood that when copying and pasting picture C to add it to the album, the electronic device will create a copy based on picture C (which can be called picture C_1), the creation time of picture C_1 is the creation time of picture C, and the addition time of picture C_1 is the time when it was added to the album.
[0122] When picture C in album A is edited and then saved as picture D in album B, the creation time of picture D in album B is the creation time of picture C, and the addition time of picture D is the time when it is saved to album B.
[0123] In the embodiment of the present application, the gallery can be understood as software for the electronic device to display stored pictures. It can be understood that the gallery can include multiple albums, and each album can include at least one picture. Exemplarily, the electronic device can generate albums by customizing them, or generate albums in response to user operations. For example, the electronic device can create albums such as "garden", "pets", "clothing", etc. according to user operations.
[0124] In the embodiment of the present application, the electronic device can determine the arrangement order of the pictures in the album in response to the user operation. For example, the electronic device can sort the pictures in the album from the latest to the earliest according to the creation time of the pictures, or from the latest to the earliest according to the update time of the pictures, or from the latest to the earliest according to the addition time of the pictures, according to the user operation.
[0125] Generally speaking, the "Camera Album" includes pictures taken by the electronic device through the camera, and the pictures are sorted from latest to earliest according to the creation time of the pictures; the "All Photos Album" includes all pictures stored in the electronic device, and the pictures are sorted from latest to earliest according to the update time of the pictures.
[0126] It is understandable that, when an electronic device edits picture A and stores the edited picture A as picture B, picture A and picture B will exist in the album at the same time, wherein picture A can be understood as the original picture and picture B can be understood as the saved picture. Generally, the saved picture is named "IMG_update date_time", so when the creation time of the two pictures is the same, the update time of the picture can be further determined by the name of the picture.
[0127] It is understandable that when the pictures in the album are sorted from late to early according to the update time of the pictures, and the album includes original pictures and saved pictures, the saved pictures can be displayed in front of the original pictures or behind the original pictures. For example, when the original picture is taken by a camera, the original picture can be named "IMG_20211204_175901", and the saved picture edited by the original picture can be named "IMG_20211207_110101". In the above case, the saved picture is displayed in front of the original picture. When the original picture is downloaded from software (such as Weibo, etc.), the original picture can be named "img-134XXXX", and the saved picture edited by the original picture can be named "IMG_20211207_110101". In the above case, the saved picture is displayed behind the original picture.
[0128] 2. Image evaluation dimensions
[0129] In the embodiment of the present application, the electronic device can evaluate the image from two aspects: quality and aesthetics. Among them, the indicators for evaluating the image from the quality perspective can be the pixels of the image, the clarity of the image, and whether the image has noise, etc.; the indicators for evaluating the image from the aesthetic perspective can be the composition, color, content, etc. Exemplarily, the electronic device can evaluate whether the color of the image is moderate, whether it is overexposed or too dark; whether the subject in the image is complete and can be identified; whether the category of the subject in the image can be identified; whether the subject and background in the image can be distinguished, etc.
[0130] It is understandable that the quality assessment and aesthetic assessment of images are hot research issues in the field of computer vision. Through computer vision algorithms, electronic devices can automatically score images, and images with high scores can be considered to be better images. Therefore, in the embodiments of the present application, the score value of the image can be understood as the score value obtained by performing quality assessment and aesthetic assessment on the image through a computer vision algorithm. It is understandable that the score calculated by the computer vision algorithm can be a negative number, a positive number, or 0.
[0131] With the development of digital photography technology, taking photos has become an increasingly simple thing in people's daily lives. Photos taken or obtained through other means are visual records of personal history. For example, photos taken on birthdays every year, photos taken during holidays, and photos downloaded through social software are all beautiful records of life.
[0132] In this fast-paced era, memories evoked by a picture can soothe a busy heart and are often the warmest comfort to the soul. Currently, electronic devices can help users evoke memories of historical life in many ways.
[0133] For example, see Figure 1 , Figure 1 This is a user interface schematic diagram of displaying a "wonderful moment" picture on the negative one screen provided in an embodiment of the present application. In the embodiment of the present application, the negative one screen can be understood as a user interface that appears after sliding the main desktop of the electronic device to the right, which can provide users with functions such as search, application suggestions, and quick services.
[0134] If the electronic device supports the "scenario intelligence" function, the user can enter "settings" and select "highlight moments" to display pictures or videos on the negative one screen. In the embodiment of the present application, the scenario intelligence mode can be understood as obtaining the user's dynamics through multiple dimensions such as travel, shopping, preferences, and attention, and then constructing an intelligent display reminder method based on multiple dimensions such as time, place, location, and environment.
[0135] For example, Figure 1 The user interface 10 in the figure can be understood as a setting interface of "scenario intelligence". In response to a click operation on the "wonderful moment" button, the electronic device adds a display frame on the negative first screen, such as Figure 1 The user interface 11 in the figure can be understood as a negative one-screen interface, in which the display frame 110 is used to display recommended pictures. Exemplarily, the display frame 110 is used to display the cover picture of the recommended video, and the name of the video "Happy Holidays" is displayed in the display frame 110.
[0136] In the embodiment of the present application, the display frame can be understood as an area in the screen area of the electronic device, and the display frame is used to display pictures, texts, or to play videos, etc. It can be understood that the embodiment of the present application does not limit the shape of the display frame, and the display frame can be rectangular, trapezoidal, circular, etc. In some embodiments, the display frame can also be called a card, a widget, or a component, etc.
[0137] In response to a click operation on the play button in the user interface 11, the electronic device displays a user interface 12, which is used to display the details of the "wonderful moments" recommended in the display frame 110. For example, the name of the recommended "wonderful moments" is "Happy Holidays", the creation date is "January 13, 2021", and the video 120 ( Figure 1 Only the cover picture of the video is displayed), picture 121, picture 122 and picture 123, etc.
[0138] In addition, in the user interface 11, in response to a click operation on the play button 111, the electronic device displays a user interface 13, and the user interface 13 can be understood as a playback interface for the video in the "wonderful moments".
[0139] In the user interface 12 , in response to a click operation on the “return” button 124 , the electronic device returns to the negative one screen interface, that is, the electronic device displays the user interface 11 .
[0140] In addition to adding a display frame to the negative one screen to display pictures, you can also add a display frame to the desktop to display pictures.
[0141] For example, see Figure 2 , Figure 2 This is a user interface diagram for setting up a desktop and adding a display box to the desktop to display gallery photos, provided in an embodiment of the present application.
[0142] In the embodiment of the present application, the desktop can be understood as the screen area displayed by the electronic device after the electronic device is turned on for the first time and the system of the electronic device is successfully logged in. It should be understood that the electronic device can have multiple desktops. In this case, the leftmost desktop can be called the main desktop, or the home page. Figure 2 The user interface 20 shown can be understood as the main desktop of the electronic device. The navigation bar 201 shows that the electronic device has a total of 5 desktops, where a black circle indicates that the electronic device is in the current interface. In response to a right swipe operation on the user interface 20, the electronic device can display other desktops. In addition, the navigation bar 201 also shows that the electronic device includes a negative screen. In response to being in the main desktop (i.e., the current user interface 20), the electronic device can display the negative screen.
[0143] like Figure 2As shown, in the user interface 20 , in response to a user operation on the desktop, such as a long press operation, a two-finger pinch operation, etc., the electronic device displays a user interface 21 , and the user can set the desktop in the user interface 21 .
[0144] In response to a click operation on the "Gallery" tool button in the user interface 21, the electronic device displays the user interface 22, and a display frame for displaying pictures is added to the desktop in the user interface 22, such as the display frame 220 in the user interface 22. In the embodiment of the present application, the display frame on the desktop can also be called a desktop card.
[0145] In response to a click operation on the display frame 220, the electronic device displays a user interface 23, which includes a selection bar 230. The selection bar 230 includes a "select album" button and a "select picture" button. In response to a click operation on the "select picture" button, the electronic device can display pictures stored in the gallery to the user, and then display the pictures selected by the user on the display frame on the desktop, such as Figure 2 In the user interface 24, the electronic device displays the picture selected by the user in the display frame 240 and displays the name of the picture "Little Girl".
[0146] Optionally, in the user interface 24, in response to a click operation on the display frame 240, the electronic device displays a user interface 25, and the user interface 25 includes a selection bar 250. The selection bar 250 includes a "browse picture" button, a "select album" button, and a "select picture" button. After clicking the "browse picture" button, the user can enter the gallery to browse pictures. After clicking the "select album" button, the user can specify that the pictures of a certain album are displayed in sequence in the display frame of the desktop, and the pictures in the selected album can be switched every 15 seconds, every 10 seconds, or every 5 seconds. After clicking the "select picture" button, other pictures can be reselected to be displayed in the display frame of the desktop. It can be understood that after selecting a certain picture, the selected picture will always be displayed in the display frame.
[0147] exist Figure 2 In the corresponding user scenario, the user adds a display frame to the desktop to display the picture through the relevant settings of the desktop. Optionally, the user can also set the gallery application to display the picture on the desktop. For example, see Figure 3 , Figure 3 It is a user interface diagram for setting a service card on a gallery application to display pictures, provided in an embodiment of the present application.
[0148] like Figure 3 As shown, electronic devices that support the "Service Card" function will display a horizontal line below the gallery application, such as Figure 3In 301 of the user interface 30, a horizontal line is displayed below the gallery application, indicating that the gallery application supports displaying pictures after the user swipes up.
[0149] In response to a long press operation on the gallery application icon in user interface 30, the electronic device displays user interface 31, which includes a selection bar 311, and the selection bar 311 includes a "service card" button, a "latest photo" button, and a "search" button. In response to a click operation on the "service card" button in user interface 31, the electronic device displays user interface 32.
[0150] Since the electronic device displays the pictures in the "Camera" album in the cards by default, the electronic device previews the pictures in the "Camera" album in the user interface 32. It can be understood that in response to the sliding operation, the size of the display frame (i.e., the card) can be modified. For example, the size of picture 323 is 2×2, the size of picture 322 is 4×2, and the size of picture 321 is 4×4. The electronic device can display them in the 2×2 specification by default.
[0151] The user interface 32 also includes a "set as slide-up card" button and an "add to desktop" button. In response to a click operation on the "set as slide-up card", the electronic device displays a user interface 33.
[0152] In response to the upward sliding operation on the gallery application in the user interface 33, the electronic device displays the user interface 34. The user interface 34 includes a display frame 341, and the specification of the display frame 341 is 2×2. The electronic device displays the picture 323 selected in the user interface 32 in the display frame 341. The display frame 341 also displays the name of the album where the picture 323 is located, that is, "Camera".
[0153] It can be understood that, when the "Camera" album includes multiple pictures, the multiple pictures are displayed in sequence in the display frame, and the interval between displaying two adjacent pictures can be 5 seconds, 10 seconds, 15 seconds, etc.
[0154] The embodiment of the present application provides a method for displaying pictures, whereby an electronic device can automatically select multiple selected pictures from an album as a selected picture set; then display different selected picture sets in desktop cards in different time periods; and in the process of displaying the selected pictures, add the moment pictures for display according to preset rules. Through the above method, not only can the desktop be personalized, but also pictures can be used to help users recall the past and enhance the user experience.
[0155] Next, the user interface involved in the embodiments of the present application is introduced.
[0156] 1. Turn on the "Smart Selection" mode
[0157] First, the process of users turning on the "smart selection" mode is introduced. In the embodiment of the present application, "smart selection" can be understood as a service or function provided by an electronic device to support the picture display method provided in the embodiment of the present application. It can be understood that "smart selection" is just a term used in this embodiment, and its meaning has been recorded in this embodiment, and its name does not constitute any limitation to this embodiment. In addition, in some other embodiments of the present application, "smart selection" may also be referred to as other terms such as "smart recommendation" and "default mode".
[0158] For example, see Figure 4 , Figure 4 A user interface diagram of opening the "Smart Selection" mode provided in an embodiment of the present application. Figure 4 As shown, the user interface 40 displayed by the electronic device can be understood as a main desktop interface, which includes a gallery application icon. In response to a long press operation on the gallery application icon, the electronic device displays a user interface 41.
[0159] The user interface 41 includes a prompt message "Revisit the wonderful intelligently selected photo moments to help you evoke memories, and you can also customize the displayed pictures or albums", as well as a "Set as a slide-up card" button, an "Add to negative one screen" button, and an "Add to desktop" button. It can be understood that the above three buttons can determine the position of the display frame for displaying the picture, that is, it can be a slide-up card, it can be on the negative one screen, or it can be on the desktop. Among them:
[0160] Exemplarily, in response to a click operation on the "Set as Slide-up Card" button, the electronic device displays a slide-up card, i.e., a display frame, overlaid on the gallery application icon, and displays the selected picture in the user interface 41 in the slide-up card. In response to a click operation on an area outside the slide-up card, the electronic device turns off the display of the slide-up card, and then, in response to a slide-up operation on the gallery application, the electronic device redisplays the slide-up card.
[0161] Exemplarily, in response to a click operation on the “add to negative one screen” button, the electronic device adds a display frame to the negative one screen, and displays the selected picture in the user interface 41 in the display frame.
[0162] Exemplarily, in response to a click operation on the "Add to Desktop" button, the electronic device displays a user interface 42. The user interface 42 can also be understood as the main desktop interface. The difference from the user interface 40 is that a display box 420 is added to the user interface 42. The display box 420 is used to display the picture selected by the user in the user interface 41, and displays it.
[0163] In response to a click operation on the display frame 420 in the user interface 42, the electronic device displays the user interface 43. The user interface 43 includes a display frame 431 and a function frame 430, which includes an "edit" button, a "service card" button, and a "remove" button.
[0164] Exemplarily, in response to a click operation on a “service card” button, the electronic device may display more service card types in a jump interface, and the user may change the size of the display frame 431 and may also change the picture displayed in the display frame 431 .
[0165] Exemplarily, in response to a click operation on the “remove” button, the electronic device deletes the display frame 431 in the user interface 43 .
[0166] Exemplarily, in response to a click operation on the "Edit" button, the electronic device displays a user interface 44. The user interface 44 includes a selection box 440, which includes a "Smart Selection" icon, a "Specify Album" icon, a "Specify Photo" icon, and respective corresponding buttons. Among them:
[0167] Exemplarily, in response to a click operation on the "specify album" button, the electronic device jumps to a page to display the details of the album in the gallery. After the user selects one of the albums, the electronic device will sequentially display all the pictures in the album selected by the user in the display frame. Exemplarily, the time interval between displaying two pictures sequentially can be 5 seconds, 10 seconds, 15 seconds, etc.
[0168] Exemplarily, in response to a click operation on the "specify picture" button, the electronic device jumps to a page to display all picture details in the gallery. After the user selects one of the pictures, the electronic device will display the selected picture in a display frame.
[0169] Exemplarily, in response to a click operation on a "Smart Selection" button, the electronic device displays the selected pictures selected by the electronic device in a desktop display frame.
[0170] It is understandable that through Figure 4 As shown in the user interface diagram, the electronic device can turn on the "Smart Selection" mode. Next, after turning on the "Smart Selection" mode, the electronic device displays the selected pictures in the display frame on the desktop. It should be understood that the following embodiments are introduced by adding a display frame to the desktop as an example. The display frame is set as a slide-up card or added to a position such as the negative one screen, and the following display method is still applicable. In addition, in order to facilitate the understanding of the image, the display frame added to the desktop is referred to as a desktop card for introduction.
[0171] 2. Select the selected pictures from the album to be displayed in the desktop card
[0172] In the embodiment of the present application, the selected pictures can be understood as pictures determined by the electronic device according to the picture attributes and the total number of pictures in the album. For example, the electronic device can calculate the score value of each picture using a computer vision algorithm according to the above-mentioned "picture evaluation dimension", and then determine the selected pictures according to the score value of each picture and the total number of pictures in the album.
[0173] In the embodiment of the present application, the multiple selected pictures selected by the electronic device from the album pictures to be displayed on the desktop card can be called a photo pool, that is, the pictures in the photo pool are the selected pictures to be displayed in the desktop card. The pictures selected in the photo pool are a balance between quality and quantity. Quality is the premise of intelligent selection, and quantity can continuously bring a sense of surprise.
[0174] For example, when the album pictures are sorted from high to low according to the score values of the pictures, and the number of the top 20% of the pictures is greater than 100, the selected pictures in the photo pool are the pictures that are sorted from high to low according to the score values of the pictures. That is, the number of selected pictures in the photo pool is 20% of the total number of pictures in the album.
[0175] When the album pictures are sorted from high to low according to the score values, the number of pictures in the top 20% is less than 100, and the total number of pictures in the album is greater than 100, the selected pictures in the photo pool are the pictures in the top 100 when the album pictures are sorted from high to low according to the score values. That is, the number of selected pictures in the photo pool is 100.
[0176] When the total number of album pictures is less than 100, the selected pictures in the photo pool are all the album pictures. In other words, the number of selected pictures in the photo pool is equal to the number of album pictures.
[0177] 3. Display featured images in desktop cards
[0178] 3.1. Select selected pictures from the photo pool to be displayed in the desktop card
[0179] In the embodiment of the present application, the selected pictures displayed in the desktop card of the electronic device can be selected from the photo pool. Figure 5 , Figure 5 It is a schematic diagram of an electronic device selecting a selected picture from a photo pool provided by an embodiment of the present application.
[0180] For example, assuming that the number of pictures in the photo pool is 158, when the electronic device selects a selected picture from the photo pool to be displayed on the desktop card, Figure 5 As shown, in the first round, 10 selected pictures are randomly selected from the photo pool, e.g. Figure 5 In the first round, 10 selected pictures are randomly selected from the photo pool, that is, selected pictures 11 to 20; in the second round, 10 selected pictures are randomly selected from the photo pool, that is, selected pictures 31 to 40. It should be understood that the pictures selected in each subsequent round are similar, that is, 10 pictures that have not been displayed are randomly selected from the photo pool each time until all the pictures in the photo pool are displayed, which will not be repeated here.
[0181] It should be understood that the number of pictures selected by the electronic device in each round can be determined according to actual conditions, and 12, 15 or 20 pictures can be selected in each round, etc., and this application does not limit this. In addition, it should also be understood that when the number of pictures in the photo pool is 158, the number of pictures selected in the last round is 8, that is, less than 10. The electronic device can display the 8 pictures in the same way as the previous 10 pictures; it can also skip the last 8 pictures and re-select selected pictures from all album pictures to the photo pool. In the above case, the pictures that have been displayed can also be re-selected.
[0182] In an embodiment of the present application, when the electronic device displays each round of pictures, it repeatedly displays each round of pictures in sequence within a certain period of time. After the pictures of the previous round are repeatedly displayed, the selected pictures of the next round are repeatedly displayed within the next certain period of time, and so on.
[0183] 3.2. Refresh and display the selected images on the desktop card
[0184] In order to more clearly understand the method of refreshing and displaying the selected pictures in the embodiment of the present application, the refreshing method of the pictures in the embodiment of the present application will be introduced by taking the selected pictures in the same round as an example.
[0185] Scenario 1: Automatically refresh the selected images
[0186] (1) Refresh the featured images displayed in the desktop card while keeping the interface unchanged
[0187] For ease of understanding, the electronic device is used as a desktop card. Figure 5 For example, the electronic device may display the first round of selected pictures (i.e., selected pictures 1 to selected pictures 10) in the first round of selected pictures. Exemplarily, when the electronic device displays the first round of selected pictures, the order of displaying the pictures may be determined according to the scores of the pictures. For example, the order of displaying the first round of selected pictures from high to low scores is selected pictures 1 to selected pictures 10.
[0188] For example, see Figure 6 , Figure 6This is a user interface diagram provided in an embodiment of the present application for refreshing the selected images displayed in the desktop card while keeping the interface unchanged.
[0189] Exemplarily, in response to a click operation on the “Smart Selection” button in the user interface 44, the electronic device turns on the “Smart Selection” mode and jumps to the user interface 600. Figure 6 As shown, the user interface 600 includes a desktop card 6001, and the desktop card 6001 displays a selected picture 1. Exemplarily, the electronic device starts to display the selected picture 1 at 10:08:20, and after the electronic device keeps the screen on for 10 seconds in the user interface 600, that is, at 10:08:30, the electronic device automatically refreshes the selected picture in the desktop card 6001 and displays the user interface 601.
[0190] The user interface 601 includes a desktop card 6011, which displays a selected picture 2. After the electronic device keeps the screen of the user interface 601 on for 10 seconds, that is, at 10:08:40, the electronic device automatically refreshes the selected picture in the desktop card 6011 and displays the user interface 602.
[0191] The user interface 602 includes a desktop card 6021, which displays the selected picture 3. After the electronic device keeps the screen of the user interface 602 on for 10 seconds, that is, at 10:08:50, the electronic device automatically refreshes the selected pictures in the desktop card 6021 and continues to display the selected picture 4, etc. The subsequent display is similar to the above and will not be repeated here.
[0192] It should be understood that the time interval for the electronic device to refresh the selected picture 1, selected picture 2 and selected picture 3 in the desktop card can also be other time lengths, such as 5 seconds, 15 seconds, 20 seconds, etc., and this application is not limited to this.
[0193] (2) When the interface changes, refresh the featured images displayed in the desktop card
[0194] In some embodiments, within 10 seconds of the time interval between the electronic device refreshing two selected pictures, the interface of the electronic device may be switched. In the above case, the electronic device refreshes the selected pictures in the desktop card in the following manner: Figure 7 As shown, Figure 7 It is a user interface schematic diagram provided in an embodiment of the present application for refreshing the selected pictures displayed in the desktop card when the interface changes.
[0195] For ease of understanding, this embodiment is described using the above-mentioned selected picture 1, selected picture 2, and selected picture 3 as examples.
[0196] Exemplarily, in response to a click operation on “Smart Selection” in the user interface 44, the electronic device turns on the “Smart Selection” mode and jumps to the user interface 700. Figure 7 As shown, the user interface 700 includes a desktop card 7001, and the desktop card 7001 displays the selected picture 1. Exemplarily, the time when the electronic device starts to display the selected picture B is 10:08:20. After the electronic device keeps the screen on for 8 seconds on the user interface 700, that is, at 10:08:28, in response to a right swipe operation on a blank area of the user interface 700, the electronic device enters the negative one screen, that is, the electronic device displays the user interface 701.
[0197] 57 seconds later, at 10:09:25, in response to a left swipe operation on a blank portion of user interface 701, the electronic device displays user interface 702. It should be understood that Figure 7 As shown, when the electronic device jumps back to the user interface displaying the selected picture 1, the desktop card still displays the selected picture 1, that is, the display box 7021 in the user interface 702 still displays the selected picture 1.
[0198] For the selected picture 1, since it has been displayed in the user interface 700 for 8 seconds, after the user interface 702 has been on for 2 seconds, that is, at 10:09:27, the electronic device automatically refreshes the selected pictures in the desktop card 7021 and displays the user interface 703. The user interface 703 includes a desktop card 7031, and the desktop card 7031 displays the selected picture 2.
[0199] It should be understood that when the electronic device keeps the screen on for 10 seconds in the user interface 703, the electronic device will refresh the selected image in the desktop card 7031 at 10:09:37 and display the selected image 3. Figure 6 Corresponding embodiment: When the electronic device keeps the screen on in user interface 703 for less than 10 seconds and switches to other interfaces, the electronic device refreshes the selected pictures in desktop card 7031 in a similar manner to the above-mentioned user interface 700-user interface 702, which will not be described in detail here.
[0200] Scenario 2: Refresh the featured image in response to user actions on the desktop card
[0201] For ease of understanding, let's take an electronic device as an example. Figure 5 For example, see Figure 8 , Figure 8 It is a schematic diagram of a user interface for refreshing selected pictures in response to user operations on a desktop card, provided in an embodiment of the present application.
[0202] like Figure 8As shown, the electronic device displays the selected picture 2 in the desktop card 8011 in the user interface 801. In the desktop card 8011, in response to the user's long press and swipe up operation, the electronic device displays the user interface 802. In the user interface 802, the electronic device displays the previous picture of the selected picture 2, that is, the selected picture 1, in the desktop card 8021.
[0203] In the desktop card 8021 , in response to the user's long press and swipe operation, the electronic device displays the user interface 803 . In the user interface 803 , the electronic device displays the next picture of the selected picture 1 , namely the selected picture 2 , in the desktop card 8031 .
[0204] It is understandable that in addition to the long press + swipe up / down operation described above, the electronic device can also refresh the image in response to other user operations, as long as it does not conflict with other gestures on the electronic device desktop. For example, it can also be a long press + swipe left / right operation, or swipe up / down operation in the desktop card.
[0205] It is understandable that in the user interface 803, after the user stops refreshing the image through user operation, the electronic device can continue to refresh the image according to the above embodiment. Figure 6 and Figure 7 The corresponding method automatically refreshes the pictures starting from the selected picture 1, which will not be described here.
[0206] In an embodiment of the present application, when the picture in the desktop card is refreshed through user operation, the switched picture is the picture selected by the electronic device to be displayed in the desktop card. For example, the electronic device can switch from selected picture 1 to selected picture 2, and then switch from selected picture 2 to selected picture 3. In response to the user's click operation in the desktop card, the electronic device will enter the gallery, and the user can view the pictures before and after the picture in the original album by sliding left and right.
[0207] For example, see Fig. 9 , Fig. 9 is a schematic diagram of a user interface for viewing selected pictures in response to a user operation provided by an embodiment of the present application. Fig. 9 As shown, the electronic device displays the selected picture 2 in the desktop card 9011 in the user interface 901. In the desktop card 9011, in response to the user's click operation, the electronic device enters the gallery and displays the user interface 902. Exemplarily, the selected picture 2 comes from the album "Happy Time". In the user interface 902, the electronic device displays the name of the original album of the selected picture, that is, "Happy Time", and also displays the selected picture 2.
[0208] In response to the left swipe operation in user interface 902, the electronic device displays user interface 903. In user interface 903, the electronic device displays the next picture after selected picture 2 in the album "Happy Time", that is, picture A. It should be understood that in the first round of selected pictures, the next picture after selected picture 2 is selected picture 3. Figure 3 The featured image 3 shown in Fig. 9 The picture A shown in is a different picture. That is, the user's switching operation in the desktop card will cause the electronic device to switch in the picture selected to be displayed in the desktop card, but after entering the gallery, the user's switching operation will cause the electronic device to switch in the picture in the original album.
[0209] 3.3. Within a certain period of time, each round of selected pictures will be repeatedly displayed in the desktop card
[0210] The above uses the selected pictures in the same round as an example to introduce the way electronic devices refresh pictures. Figure 5 The first round of featured pictures, the second round of featured pictures, and the third round of featured pictures are used as examples to introduce how to display each round of featured pictures on the desktop cards.
[0211] Scenario 1: When the album pictures have not changed, the electronic device repeatedly displays each round of selected pictures in the desktop card within a certain period of time
[0212] For ease of understanding, the example of each round of selected pictures being displayed in a desktop card in a cycle for 3 days is used for introduction. For example, please refer to Figure 10(A). Figure 10(A) is a user interface diagram for repeatedly displaying selected pictures in a desktop card provided in an embodiment of the present application.
[0213] Exemplarily, in response to a click operation on "Smart Selection" in the user interface 44, the electronic device turns on the "Smart Selection" mode and jumps to the user interface 1000. As shown in FIG10(A), the user interface 1000 includes a desktop card 10001, in which a selected picture 1 is displayed; and the time when the electronic device starts to display the selected picture 1 in the desktop card 10001 is 10:08:20 on March 15. After the electronic device keeps the screen on for 10 seconds in the user interface 1000, that is, at 10:08:30, the electronic device automatically refreshes the selected pictures in the desktop card 10001 and displays the user interface 1001.
[0214] The user interface 1001 includes a desktop card 10011, in which the selected image 2 is displayed. Figure 6 and Figure 7Corresponding embodiment) refreshes and displays the first round of selected pictures. For example, at 11:25:40 on March 15, the electronic device starts to display the selected picture 10. As shown in the user interface 1002 in FIG. 10(A), the electronic device displays the selected picture 10 in the desktop card 10021. For example, after the first display of the first round of selected pictures is completed, that is, at 11:25:50, the electronic device automatically refreshes the selected pictures in the desktop card 10021 and re-displays the first round of selected pictures.
[0215] For example, at 11:25:50, the electronic device displays user interface 1003. User interface 1003 includes desktop card 10031, and desktop card 10031 displays selected image 1. After the electronic device displays user interface 1003 for 10 seconds, that is, at 11:26:00, the electronic device automatically refreshes the selected images in desktop card 10031 and displays user interface 1004. User interface 1004 includes desktop card 10041, and desktop card 10041 displays selected image 2. After that, the electronic device refreshes the image again according to the image refresh method (i.e., Figure 6 or Figure 7 Corresponding embodiment) refreshes and displays the first round of selected pictures. For example, at 13:05:14 on March 15, the electronic device begins to display the selected picture 10, as shown in the user interface 1005 in Figure 10 (A), and the selected picture 10 is displayed in the desktop card 10051. At 13:05:24, the electronic device completes the second display of the first round of selected pictures.
[0216] It is understandable that during the three days from March 15 to March 17, the electronic device will display the first round of selected pictures in a loop in the manner shown in FIG10(A). After the first round of selected pictures are displayed in a loop, the electronic device will display the second round of selected pictures in a loop.
[0217] For example, please refer to FIG. 10(B), which is another user interface schematic diagram for repeatedly displaying selected images in a desktop card provided by an embodiment of the present application. As shown in FIG. 10(B), the electronic device displays selected image 1 in desktop card 10061 at 23:59:50 on March 17. After the electronic device keeps the screen on in user interface 1006 for 10 seconds, that is, at 00:00:00 on March 18, the electronic device automatically refreshes the selected images in desktop card 10061 and starts to display the second round of selected images, that is, the electronic device displays user interface 1007, which includes desktop card 10071, and desktop card 10071 displays the first image in the second round of selected images, that is, selected image 11.
[0218] Exemplarily, after displaying selected image 11, the electronic device turns off the screen, and then starts to display selected image 12 at 07:00:20 on March 18, as shown in user interface 1008 in FIG. 10(B), wherein user interface 1008 includes desktop card 10081, and selected image 12 is displayed in desktop card 10081. After the electronic device displays user interface 1008 for 10 seconds, that is, at 107:00:30, the electronic device automatically refreshes the selected images in desktop card 10081 and displays user interface 1009. User interface 1009 includes desktop card 10091, and selected image 13 is displayed in desktop card 10091. After that, the electronic device refreshes the selected images according to the image refresh method (i.e., Figure 6 and Figure 7 Corresponding embodiment) refreshes and displays the second round of selected pictures.
[0219] It is understandable that during the period from March 18 to March 20, the electronic device repeatedly displays the second round of selected pictures on the desktop card. Starting from March 21, the electronic device will repeatedly display the third round of selected pictures. Exemplarily, the transition from the second round of selected pictures to the third round of selected pictures can be similar to the method shown in user interface 1006 and user interface 1007, that is, although the first round of selected pictures displays selected picture 1, after midnight, the first picture of the second round of selected pictures, that is, selected picture 11, begins to be displayed; in some embodiments, the electronic device may be in a screen-off state at the time point when the second round of selection and the third round of selected pictures are switched. Then on March 21, after the electronic device is turned on, it directly starts displaying the first picture of the third round of selected pictures. Exemplarily, as shown in user interface 1010 in Figure 10 (B), the electronic device starts displaying user interface 1010 at 10:35:30. Within 10 seconds starting from 10:35:30, the electronic device displays selected picture 31 on desktop card 10101. It should be understood that the subsequent display method of the third round of selected pictures is similar to the display method of the first and second rounds of selected pictures in the previous text, and the subsequent switching of other rounds of selected pictures is also similar to the previous text, which will not be repeated here.
[0220] It should be understood that the above embodiment uses the electronic device to use the early morning as the time point for switching between different rounds of selected pictures. The electronic device can also use other time points as the time points for switching, such as the time point when the user first turns on the electronic device every morning, or 8:00, 9:00, etc. every day. The time point when the user turns on "Smart Selection" can also be used as the time point for switching, and this application does not limit this. It should also be understood that the above embodiment uses a 3-day cycle to display each round of selected pictures in a loop as an example. The electronic device can also use 2 days, 5 days or 7 days as a cycle, and this application does not limit this.
[0221] 3.4. Album pictures changed
[0222] It should be understood that the user can add, delete, modify, and other operations on the pictures in the electronic device, so that the album pictures change dynamically according to the user operations. In the embodiment of the present application, after the album pictures change, the electronic device will reselect the selected pictures displayed in the desktop card in accordance with the method of the second part mentioned above, that is, the electronic device will update the photo pool.
[0223] It should be understood that in the embodiments of the present application, changes in album pictures may be caused by the user adding pictures to the gallery through operations such as taking photos, sharing with others, saving pictures from applications such as social software, etc., or by deleting pictures in the gallery.
[0224] For example, see Fig.11 , Fig.11 This is a schematic diagram of displaying selected pictures after the album pictures change, provided by the embodiment of the present application. For ease of understanding, Fig.11 The examples in the above Figure 5 The data in the corresponding embodiment is taken as an example that the electronic device selects 158 selected pictures in the photo pool before the album pictures change. In order to distinguish the photo pools before and after the change, in this embodiment, the photo pool determined after the album pictures change is called photo pool B, and the photo pool before is called photo pool A.
[0225] For example, Fig.11 As shown, selected pictures 1 to 40 in photo pool A have been selected to be displayed on the desktop card (such as the selected pictures in the dotted box in photo pool A), among which selected pictures 1 to 30 have been displayed, and selected pictures 31 to 40 are being displayed on the desktop card; the remaining selected pictures 41 to 158 have not yet been selected to be displayed on the desktop card.
[0226] It should be understood that if the album pictures have not changed, the electronic device will select 10 pictures from the selected pictures 41-selected pictures 158 in the photo pool A as the fourth round of selected pictures. Exemplarily, the album pictures change during the display of the third round of selected pictures by the electronic device. The electronic device updates the photo pool to obtain photo pool B, where the number of selected pictures in photo pool B is 191. Of these 191 pictures, 27 pictures have been displayed, and the remaining 164 pictures have not been displayed. In the subsequent display, the electronic device will select pictures from the selected pictures 28-selected pictures 191 that have not been displayed in photo pool B to display on the desktop card.
[0227] For example, after the third round of selected pictures are displayed, 10 selected pictures are randomly selected from the pictures that have not been displayed in the photo pool B in the fourth round, namely, selected pictures 28 to 37; in the fifth round, 10 selected pictures are randomly selected from the pictures that have not been displayed in the photo pool B, namely, selected pictures 38 to 47; in the sixth round, 10 selected pictures are randomly selected from the pictures that have not been displayed in the photo pool B, namely, selected pictures 48 to 57. It should be understood that the pictures selected in each subsequent round are similar to this, and will not be repeated here.
[0228] It should be understood that each round of selected pictures can be randomly selected by the electronic device from pictures in the photo pool that have not been displayed, or they can be selected in chronological order according to the creation time of the pictures, or they can be selected according to the rating values of the pictures, as long as the displayed pictures are not selected a second time. Figure 5 as well as Fig.11 The featured images in the image are numbered consecutively for ease of understanding only, for example, Fig.11 The fourth round of featured pictures in the may also be featured picture 59, featured picture 62, featured picture 100, featured picture 102, featured picture 155, featured picture 72, featured picture 89, featured picture 42, featured picture 31, and featured picture 68.
[0229] In some embodiments, when the electronic device displays the third round of selected pictures, if the number of deleted pictures in the third round of selected pictures is greater than or equal to 5, the electronic device determines the fourth round of selected pictures to display from the pictures that have not been displayed in the photo pool.
[0230] 4. There are recommended time pictures. When displaying the selected pictures, add the time pictures to display
[0231] 4.1. Introduction of Moment Pictures
[0232] In the embodiment of the present application, the moment picture can be understood as a picture selected from the album pictures according to the same event. Fig.12 , Fig.12 Schematic diagram of a type of moment picture provided by an embodiment of the present application. Fig.12 As shown, the electronic device can treat pictures within a single day or multiple days as the same event, and then select a moment picture from the pictures corresponding to the same event, which can be called an event-type moment picture in the embodiment of the present application. Optionally, the electronic device can also select pictures from portrait pictures, or select pictures from a certain period (such as half a year, 60 years) to obtain a moment picture, which can be called a stage-type moment picture in the embodiment of the present application.
[0233] Furthermore, the time pictures in the embodiment of the present application may include today's time pictures, today's time pictures in previous years, and time pictures of revisiting an old place.
[0234] (1) Today's time picture
[0235] In an embodiment of the present application, today's time picture can be understood as a picture whose time difference between the creation time and the current time is less than or equal to the first time threshold, and the first time threshold can be 1 day, 2 days or 3 days, etc.
[0236] Exemplarily, the picture of today can be obtained in the following manner. For example, if a user takes multiple pictures of travel on Saturday and Sunday, the electronic device can select some pictures from the multiple travel pictures as the picture of today on the weekend (e.g., in the evening of the weekend), or the electronic device can select some pictures from the multiple travel pictures as the picture of today on the next Monday, and then push them to the user.
[0237] (2) Pictures of today's time in previous years
[0238] In an embodiment of the present application, pictures of today in previous years can be understood as pictures whose creation time difference with the first time is less than or equal to a second time threshold. The first time and the current time belong to the same day in different years. The second time threshold can be 1 day, 2 days or 3 days, etc.
[0239] Exemplarily, today's moment picture can be obtained in the following way. For example, if today's date is December 10, 2021, and today is the user's birthday, then the photos taken by the user on past birthdays can be understood as today's moment pictures in previous years. For example, pictures taken by the user on his birthday on December 10, 2020, pictures taken on his birthday on December 10, 2018, etc.
[0240] For another example, if today's date is October 1, 2021, which is the National Day holiday in 2021, all photos taken by users during the National Day in the past can be understood as the same time in previous years. It should be understood that when users go out to play, they can play for multiple days at a time. Therefore, photos taken during the National Day can be understood as pictures generated in the same event, and pictures taken on different dates can be used as pictures of the same time in previous years. For example, photos taken from October 1 to October 3 in previous years can be used as pictures of the same time in previous years on October 1, 2021.
[0241] (3) Pictures of the moment of revisiting the old place
[0242] In the embodiment of the present application, the picture of the revisiting moment can be understood as a picture whose shooting location is the same as the current location of the electronic device. In the embodiment of the present application, the shooting location of the picture can be understood as the location of the electronic device when the picture is taken by the camera. For example, the user goes out to play on the weekend and takes a picture A in the "People's Park" in City A, then the shooting location of picture A is "People's Park, City A". Exemplarily, the electronic device can select a picture from the album pictures whose shooting location is the same as the current location of the electronic device when the location changes, for example, from location A to location B. Exemplarily, the user went to "People's Park, City A" on January 21, 2021, and took pictures A, B, C, and D. Assuming that the current time is October 25, 2021, the user goes to "People's Park, City A" again. When the user arrives at "People's Park, City A", the above pictures A, B, C, and D can all be used as pictures of the revisiting moment.
[0243] In some embodiments, the revisited moment picture can also be understood as a picture whose shooting location is the same as the current location of the electronic device and different from the permanent location of the electronic device. In the embodiment of the present application, the permanent location of the electronic device can be automatically determined by the electronic device. For example, within 6 months, the location of the electronic device has always been location A, then the electronic device can consider its permanent location to be location A. The electronic device can also receive the user's operation instruction and determine its own permanent location according to the instruction.
[0244] It is understandable that, when the electronic device determines its permanent location and the current location of the electronic device is a non-resident location, the pictures in the album whose shooting location is the same as the current location of the electronic device can be understood as pictures of the time of revisiting the old place, such as Fig.12 As shown, event-type moments include non-resident location moments.
[0245] Exemplarily, the revisiting moment picture can be obtained in the following manner: the electronic device determines that the permanent location is location A, and when the current location of the electronic device is location B, the electronic device selects the revisiting moment picture from the pictures taken at location B.
[0246] It should be understood that the electronic device can select the moment picture through the computer vision algorithm according to the evaluation dimension of the above picture, which is similar to the selected picture and will not be repeated here.
[0247] 4.2. Add a certain type of moment picture to display when displaying selected pictures
[0248] It is understandable that when the electronic device displays the selected pictures, there may be recommended pictures of today, pictures of today in previous years, and pictures of revisiting the past that need to be added to the selected pictures for display. Fig.13 , Fig.13 This is a schematic diagram of adding a moment picture to display in the process of displaying a selected picture provided by an embodiment of the present application. It should be understood that Fig.13 The time picture in the figure can be a time picture of today, a time picture of today in previous years, or a time picture of revisiting an old place. In this embodiment, they are collectively referred to as "time pictures" for explanation.
[0249] It should be understood that in the absence of a recommended time picture, the electronic device will follow Fig. 9 Each round of selected pictures is displayed in a cyclic manner. For ease of understanding, the electronic device is taken as an example to display the first round of selected pictures. Fig.13 As shown, exemplarily, the electronic device displays the first round of selected pictures in the desktop card, and displays them in a loop in the order of selected pictures 1 to selected pictures 10. When displaying selected picture 2, the electronic device detects that there is a recommended moment picture, such as Fig.13 As shown, the electronic device detects that there are 10 moment pictures.
[0250] In this embodiment, after the selected picture 2 is displayed, the electronic device will first display the moment picture, and then continue to display the selected picture after the moment picture is displayed. Fig.13 As shown, after the electronic device displays the selected picture 2, it first displays the moment pictures 1 to 10 in sequence, and then displays the remaining selected pictures 3 to 10 in the first round of selected pictures in sequence. The display process of subsequent pictures is the same as the display method of the selected pictures and moment pictures in this round, that is, in the next round after the moment pictures and selected pictures are displayed in this round, the selected pictures 1 and 2 are displayed first, then the moment pictures 1 to 10, and then the selected pictures 3 to 10, and the subsequent ones can be deduced by analogy.
[0251] It is understandable that the order in which the electronic device displays the moment pictures can be consistent with the order in which the selected pictures are displayed, that is, the pictures are displayed from high to low according to their ratings. In addition, the number of moment pictures can be set according to actual conditions, which can be 10, 15, 20, etc., and this application does not limit this.
[0252] In the embodiment of the present application, when the electronic device displays the moment picture on the desktop card, it also displays the name of the moment picture on the desktop card, for example, it can be "Weekend Memories", "Looking Back", "Brilliant Time", etc. Optionally, when the electronic device displays the moment picture, it can also display the creation time of the moment picture on the desktop card.
[0253] 4.3. Priority of different categories of moment images
[0254] It is understandable that for the above three types of moment pictures, the electronic device may recommend other types of moment pictures when displaying one type of moment pictures. For example, when displaying the moment pictures of the same day in previous years, the electronic device may recommend the moment pictures of revisiting the old place; for another example, when displaying the moment pictures of revisiting the old place, the electronic device may recommend the moment pictures of the same day, and so on.
[0255] In this embodiment, an example is given in which an electronic device displays pictures of the same day in previous years and recommends pictures of the same day in a previous year. Fig.14 , Fig.14 It is a schematic diagram provided by an embodiment of the present application of adding a picture of the time of revisiting an old place to the process of displaying pictures of the same day in previous years.
[0256] like Fig.14 As shown, exemplarily, the electronic device displays the first round of selected pictures in the desktop card, and cycles in the order of selected pictures 1 to selected pictures 10. When displaying selected picture 2, the electronic device detects that there are 10 recommended pictures of today's time in previous years. After that, the electronic device first displays pictures 1 to 10 of today's time in previous years in sequence. When displaying picture 2 of today's time in previous years, the electronic device detects that there are 10 recommended pictures of revisiting the old place, then the electronic device displays the recommended pictures of today's time in previous years in sequence.
[0257] Finally, if Fig.14 As shown, the new display order starting from Selected Picture 2 is Selected Picture 2, Previous Years Today's Moment Picture 1-Previous Years Today's Moment Picture 10, Revisited Moment Picture 1-Revisited Moment Picture 10, Selected Picture 3-Selected Picture 10. The display process of subsequent pictures is the same as the display method of Selected Pictures and Moment Pictures in this round, that is, after this round ends, the display order of the next round is Selected Picture 1, Selected Picture 2, Previous Years Today's Moment Picture 1-Previous Years Today's Moment Picture 10, Revisited Moment Picture 1-Revisited Moment Picture 10, Selected Picture 3-Selected Picture 10, and the subsequent ones can be deduced by analogy.
[0258] It should be understood that the display method in other cases can be deduced by analogy, and the electronic device will display the recommended time picture first and then display the recommended other time pictures. For example, in the process of displaying the time picture of revisiting an old place, the electronic device recommends the time picture of today, so the electronic device will display the time picture of today after displaying the time picture of revisiting an old place.
[0259] In some embodiments, the electronic device sets the current time picture as the highest priority, and once the current time picture is pushed, the current time picture is displayed first. This embodiment is described by taking the example of the electronic device displaying the current time pictures of previous years and recommending the current time picture. For example, please refer to Fig.15 , Fig.15 It is a schematic diagram provided by an embodiment of the present application of adding today's time picture to the process of displaying today's time pictures of previous years.
[0260] like Fig.15 As shown, exemplarily, the electronic device displays the first round of selected pictures in the desktop card, and cycles in the order of selected pictures 1 to selected pictures 10. When displaying selected picture 2, the electronic device detects that there are 10 recommended pictures of today's time in previous years. After that, the electronic device first displays pictures 1 to 10 of today's time in previous years in sequence. When displaying picture 2 of today's time in previous years, the electronic device detects that there are 10 recommended pictures of today's time, then the electronic device displays today's time picture completely and then continues to display pictures of today's time in previous years and the selected pictures.
[0261] Finally, if Fig.15 As shown, the new display order starting from Selected Picture 2 is Selected Picture 2, Picture 1 of Today's Moment in Previous Years, Picture 2 of Today's Moment in Previous Years, Picture 1 of Today's Moment in Previous Years - Picture 10 of Today's Moment in Previous Years, Selected Picture 3 to Selected Picture 10. The display process of subsequent pictures is the same as the display method of Selected Pictures and Moment Pictures in this round, that is, after this round ends, the display order of the next round is Selected Picture 1, Selected Picture 2, Picture 1 of Today's Moment in Previous Years, Picture 2 of Today's Moment in Previous Years, Picture 1 of Today's Moment in Previous Years - Picture 10 of Today's Moment in Previous Years, Selected Picture 3 to Selected Picture 10, and the subsequent order can be deduced by analogy.
[0262] It should be understood that the display method in other cases can be deduced by analogy and will not be elaborated here. For example, in the process of displaying a picture of the time of revisiting an old place, the electronic device recommends a picture of today's time. Then the electronic device will continue to display the picture of the time of revisiting an old place that has not been displayed after displaying the picture of today's time.
[0263] In some embodiments, when recommending pictures of today's time in previous years and pictures of revisiting an old place at the same time, the electronic device first displays the pictures of today's time in previous years in sequence, and then displays the pictures of revisiting an old place in sequence after the pictures of today's time in previous years are displayed.
[0264] Therefore, in the embodiment of the present application, the priority of displaying pictures is from high to low: today's time pictures, today's time pictures in previous years, pictures of revisiting the old place, and selected pictures.
[0265] 4.4. The same category of time pictures includes multiple groups of time information and different time pictures
[0266] From the previous text (e.g. Fig.12 Corresponding description) It can be understood that in some embodiments, there can be multiple groups of moment pictures of the same category. For example, for the moment pictures of today in previous years, assuming that this year is October 1, 2021, then the picture of October 1, 2020 can be used as the moment picture of today in previous years, and the picture of October 1, 2015 can also be used as the moment picture of today in previous years, that is, there are two groups of moment pictures of today in previous years, one group is the moment pictures of today in previous years in 2020, and the other group is the moment pictures of today in previous years in 2015.
[0267] In the embodiment of the present application, when the moment pictures of the same category include multiple groups of moment pictures, the electronic device can reduce the number of moment pictures in each group. For example, the number of moment pictures in the above embodiment is 10. When there are multiple groups of moment pictures, the number of moment pictures in each group can be reduced to 5. It can be understood that if there are too many pictures in each round, the time interval between users repeatedly seeing the same picture will be too long, which is not conducive to users recalling the past through pictures. Therefore, the above method can reduce the time interval between users repeatedly seeing the same picture in the process of repeatedly displaying pictures, thereby improving user experience.
[0268] For ease of understanding, an example is given in which an electronic device recommends two sets of pictures of today's time in previous years for display during the process of displaying the first round of selected pictures. Fig.16 , Fig.16 This is a schematic diagram provided by an embodiment of the present application for recommending two groups of pictures of today's time in previous years for display while displaying selected pictures.
[0269] like Fig.16As shown, exemplarily, the electronic device displays the first round of selected pictures in the desktop card, and cycles in the order of selected pictures 1 to selected pictures 10. When displaying selected picture 2, the electronic device detects that there is a recommended picture of today's time in previous years, that is, 5 pictures of today's time in previous years A and 5 pictures of today's time in previous years B. Among them, picture A of today's time in previous years is a picture of 2020, and picture B of today's time in previous years is a picture of 2015. The electronic device will display a group of pictures of today's time in previous years that are closest to the current time in chronological order, and continue to display the selected pictures after displaying the pictures of today's time in previous years.
[0270] Finally, if Fig.16 As shown, the new display order starting from Selected Picture 2 is Selected Picture 2, Previous Years Today's Moment Picture A, Previous Years Today's Moment Picture B, Selected Pictures 3 to Selected Pictures 10. The display process of subsequent pictures is the same as the display method of Selected Pictures and Moment Pictures in this round, that is, after this round ends, the display order of the next round is Selected Picture 1, Selected Picture 2, Selected Picture 2, Previous Years Today's Moment Picture A, Previous Years Today's Moment Picture B, Selected Pictures 3 to Selected Pictures 10, and the subsequent ones can be deduced by analogy.
[0271] It should be understood that, as mentioned above Fig.12 In the embodiment of the present application, the moment pictures in a single day or multiple days can be regarded as the same event, and then the moment pictures are selected from the pictures corresponding to the same event. In the embodiment of the present application, the number of days occupied by the moment pictures can be called the moment days. For example, the moment days of the moment pictures composed of pictures created between May 3rd and May 5th are 3 days, and the moment days of the moment pictures composed of pictures created on April 20th are 1 day.
[0272] When the time day of the time picture is 1 day, the above Figure 13-Figure 16 In the corresponding embodiment, the moment picture will no longer be displayed together with the selected picture after the end of the day, that is, the moment picture of a single day is displayed for 1 day. Fig.16 The previous years' today's time picture A and previous years' today's time picture B are recommended on November 15, 2021. Then on November 15, 2021, previous years' today's time picture A, previous years' today's time picture B and selected pictures are recommended according to Fig.16 The manner shown is displayed in a loop. On November 16, 2021, the electronic device will no longer display Picture A of the same time in previous years and Picture B of the same time in previous years.
[0273] If the time period of a moment picture is multiple days, the display duration of the moment picture is the number of days. Fig.17 , Fig.17It is a schematic diagram of displaying selected pictures and pictures of today's time in previous years with a time range of 3 days, provided in an embodiment of the present application.
[0274] Exemplarily, the electronic device will display the first round of selected pictures from October 1 to October 3, 2021, the second round of selected pictures from October 4 to October 6, 2021, and the first round of selected pictures from October 7 to October 9, 2021, according to the actual way of selecting selected pictures. Exemplarily, on October 2, 2021, there are recommended pictures of today's time in previous years, namely, pictures A of today's time in previous years and pictures B of today's time in previous years, wherein pictures A of today's time in previous years are pictures from October 2 to October 4, 2021, and pictures B of today's time in previous years are pictures from October 2, 2019. In response to the recommendation, the electronic device displays pictures from October 2 to October 4, 2021 in the following manner:
[0275] On October 2, 2021, the display order of each round of pictures is: previous year's today's time A, previous year's today's time B, and the first round of selected pictures. It should be understood that on October 2, 2021, the electronic device will display the pictures in a loop in response to the recommendation in the above display order.
[0276] It should be understood that the previous year's today's time picture B is a picture on October 2, 2019, and will no longer be displayed after being displayed on October 2, 2021. On October 3, 2021, the display order of each round of pictures is: previous year's today's time A, the first round of selected pictures.
[0277] Similar to October 3, 2021, on October 4, 2021, the display order of each round of pictures is: Today's Moment A in previous years, and the second round of selected pictures.
[0278] It should be understood that Fig.17 The embodiment shown is introduced by taking the current time of previous years as an example, and the case where the time picture is the current time picture or the time picture of revisiting the old place can be deduced by analogy. For example, if the time days of the current time picture are 2 days, then the display days of the warning time picture are also 2 days.
[0279] In some embodiments, the number of days for displaying the revisiting moment picture can also be determined based on the location information of the electronic device. When the current location of the electronic device is different from the shooting location of the revisiting moment picture, the display of the revisiting moment picture is stopped.
[0280] The above is an exemplary user interface diagram of the embodiment of the present application. Next, the picture display method provided by the embodiment of the present application is explained. It should be understood that the method provided by the embodiment of the present application can be executed by an electronic device. For ease of understanding, the picture display method provided by the embodiment of the present application is divided into two parts for introduction, namely, the process of displaying the selected pictures and the process of adding the moment picture to the selected pictures for display.
[0281] First, the process of displaying the selected images is introduced. For example, see Fig.18 , Fig.18 1 is a flow chart of a display method for displaying selected pictures provided in an embodiment of the present application. Fig.18 As shown, the method includes:
[0282] 1801: In response to a first user operation, display a first display frame at a first position;
[0283] In the embodiment of the present application, the first user operation can be understood as an operation that triggers the electronic device to display the first display frame, such as the above Figure 4 The user operations in the corresponding embodiments can all be understood as the first user operations.
[0284] In the embodiment of the present application, the first position may be the desktop, negative one screen, lock screen interface, and slide-up card of the electronic device, and the present application does not limit this. It should be understood that when the first position is the desktop, the embodiment of the present application does not limit the category of the desktop displaying the first display frame, which may be the main desktop or other desktops. In addition, when the first position is the desktop, the first display frame may be called a desktop card.
[0285] 1802: Determine a first selected picture set according to the first category of picture attributes;
[0286] In this step, the electronic device determines a first selected picture set from the gallery according to the first type of picture attributes. In the embodiment of the present application, the first selected picture set can be understood as at least one selected picture determined according to the first type of picture attributes. In some embodiments, the first selected picture set can also be understood as any round of selected pictures in the previous embodiments, such as the first round of selected pictures, the second round of selected pictures, the third round of selected pictures, etc.
[0287] As mentioned in the second part of the term above, in the embodiment of the present application, the first type of image attributes may include any one or more of the following: the pixels of the image, the clarity of the image, the color saturation of the image, the composition of the image, the recognition of the image subject, and the recognition of the category of the image subject. Exemplarily, the electronic device may use a computer vision algorithm to evaluate the images in the gallery using the first type of image attributes as the evaluation dimension, calculate the score value of each image, and then determine the first selected image set based on the score value. Exemplarily, the electronic device may sort the images from high to low according to the score value, and use the images ranked in the first percentage as the first selected image set. It should be understood that the first percentage may be set according to the actual situation. For example, the first percentage may be 5%, 6%, 7%, etc., and the present application does not limit this.
[0288] It is understandable that it takes a certain amount of time for the electronic device to calculate the score of the image using the computer vision algorithm, and the calculation is generally performed after the electronic device is locked, or when the electronic device is locked and charging. Therefore, it is possible that when the first display frame is added, the electronic device has not yet determined the at least one selected image through the computer vision algorithm. Therefore, in some embodiments, when the first display frame is displayed at the first position and the at least one selected image is not determined based on the first type of image attributes, the electronic device uses the images in any album as the first selected image set.
[0289] By using the above method, the user experience can be improved, so that the user can display the picture normally after adding the first display frame, avoiding the situation where there is no picture but a blank display frame. For example, the electronic device can use the pictures in the existing "camera" album, or "pet" album, or "illustration" album as the first selected picture set.
[0290] It should be understood that in the embodiment of the present application, even if the electronic device initially displays the pictures in any album as the first selected picture set in the first display frame, the electronic device is still in the "smart selection" mode. After the electronic device completes the evaluation of the pictures through the computer vision algorithm, it will normally display the first selected picture set determined according to the first category of picture attributes.
[0291] 1803: repeatedly displaying the first selected picture set in the first display frame in sequence within the first time period;
[0292] In this step, the first time period can be understood as a continuous period of time. For example, the duration of the first time period can be 1 day, 2 days, or 3 days. It should be understood that the above-mentioned first time period also includes time information of the start time and the end time. For example, the first time period is from 8 am on October 1, 2021 to 8 am on October 2, 2021, that is, the start time is 8 am on October 1, 2021, and the end time is 8 am on October 2, 2021, and the duration is 1 day.
[0293] In this embodiment, the first display frame repeatedly displays the first selected picture set in sequence, which can be understood as starting from the first picture in the first selected picture set in the first display frame and displaying each picture in the first selected picture set in sequence; after displaying the last picture in the first selected picture set, continue to start from the first picture in the first selected picture set and display each picture in the first selected picture set in sequence, and so on, until the end of the first time period. In the case where the first selected picture set is understood as the first round of selected pictures, the method of this step can also refer to the description related to Figure 10 (A) above.
[0294] In a possible implementation, the electronic device may display the pictures in sequence according to the time threshold as the time interval, for example, Figure 6 The corresponding embodiment is a method for refreshing the first round of selected pictures. It should be understood that the above time threshold can be set to 5 seconds, 10 seconds, 15 seconds, etc. according to actual conditions, and can also be customized by receiving user operations.
[0295] In another possible implementation, the time interval for refreshing the picture by the electronic device can be determined according to the frequency of the played music. The higher the frequency of the played music, the faster the picture is refreshed, that is, the smaller the time interval for refreshing the picture is.
[0296] It should be understood that in the embodiment of the present application, the electronic device can also refresh the image in the first display frame by referring to the above Figure 7 as well as Figure 8 The corresponding embodiments.
[0297] In some embodiments, the number of pictures in the first selected picture set can be determined according to the time interval for refreshing pictures. For example, when the time interval is 15 seconds, the number of pictures in the first selected picture set is 20, and when the time interval is reduced from 15 seconds to 5 seconds, the number of pictures in the first selected picture set is 30.
[0298] 1804: In a second time period after the first time period, a second selected picture set is repeatedly displayed in the first display frame in sequence; the second selected picture set is pictures determined according to the attributes of the first category of pictures, and the pictures in the second selected picture set are different from the pictures in the first selected picture set.
[0299] In this step, the second time period is after the first time period, that is, the start time of the second time period is after the end time of the first time period. In some embodiments, the start time of the second time period may also be equal to the end time of the first time period.
[0300] In this step, the specific manner of repeatedly displaying the second selected picture set in the first display frame is similar to that in step 1803, and will not be repeated here. It can be understood that, when the first selected picture set is understood as the first round of selected pictures and the second selected picture set is understood as the second round of selected pictures, the method of this step can also refer to the embodiments corresponding to Figures 10(A) and 10(B) above.
[0301] In this step, the pictures in the second selected picture set are different from the pictures in the first selected picture set, that is, the pictures selected into the first selected picture set will not be selected again, that is, will not be selected as pictures in the second selected picture set. Figure 6 and Figure 7 In the corresponding embodiment, the electronic device will refresh and display the picture only when the interface corresponding to the first display frame remains on the screen. Therefore, the electronic device may be in a screen-off state for most of the first time period and cannot display every picture in the first selected picture set. In the embodiment of the present application, even if the picture in the first selected picture set is not displayed in the first display frame, it will not be determined as a picture in the second selected picture set.
[0302] For the determination of the first selected picture and the second selected picture set, reference may also be made to the above embodiments. Figure 5 Corresponding description, that is, the electronic device can first determine the pictures in the photo pool, and then select the selected picture set from them. Exemplarily, the electronic device marks the pictures each time after selecting pictures, and the marked pictures indicate that they have been selected, and the unmarked pictures indicate that they have not been selected. Then, the electronic device can select from the unmarked pictures each time.
[0303] In the embodiment of the present application, the number of pictures in the photo pool can be determined according to multiple dimensions. For example, assuming that the electronic device refreshes the pictures in the first display frame at a time interval of 5 seconds, and the electronic device can determine based on historical results that within a period of time, the pictures in the first display frame can be automatically refreshed 5 times a day on average, that is, the electronic device can automatically display 5 pictures a day. In the above case, taking the first time period as 3 days as an example, that is, the first selected picture set is automatically refreshed and displayed within 3 days, then the number of pictures in the first selected picture set can be 15. In order to allow users to see different pictures as much as possible within a certain period of time, for example, in order to allow users to see different pictures within a month, the number of pictures in the photo pool can be determined to be 150, that is, (30 / 3)*15=150. For example, the electronic device displays 10 selected pictures every 3 days. In order to allow users to see different pictures within a month, the number of pictures in the photo pool can be determined to be 100, that is, (30 / 3)*10=100. For ease of understanding, the number of pictures in the photo pool determined in the above manner may be referred to as a reference number, that is, the reference number may be 150 as mentioned above, or 100 as mentioned above, and may be determined according to actual needs.
[0304] Therefore, in an embodiment of the present application, when the total number of album pictures multiplied by the first percentage is greater than or equal to the reference number, the electronic device sorts the album pictures from high to low according to the score values of the pictures, and uses the pictures in the first percentage as pictures in the photo pool. When the total number of album pictures is greater than or equal to the reference number, and the total number of album pictures multiplied by the first percentage is less than the reference number, the number of pictures in the photo pool is the reference number, wherein the pictures in the photo pool are determined from high to low according to the score values of the album pictures. When the total number of album pictures is less than the reference number, all album pictures are used as pictures in the photo pool.
[0305] In the embodiment of the present application, the first percentage can be determined according to actual conditions. For example, the second percentage can be 15%, 20%, 25%, etc.
[0306] For example, when the album pictures are sorted from high to low according to the score values of the pictures, and the number of the top 20% of the pictures is greater than 100, the selected pictures in the photo pool are the pictures that are sorted from high to low according to the score values of the pictures. That is, the number of selected pictures in the photo pool is 20% of the total number of pictures in the album.
[0307] When the album pictures are sorted from high to low according to the score values, the number of pictures in the top 20% is less than 100, and the total number of pictures in the album is greater than 100, the selected pictures in the photo pool are the pictures in the top 100 when the album pictures are sorted from high to low according to the score values. That is, the number of selected pictures in the photo pool is 100.
[0308] When the total number of album pictures is less than 100, the selected pictures in the photo pool are all the album pictures. In other words, the number of selected pictures in the photo pool is equal to the number of album pictures.
[0309] Next, we will introduce the process of adding a moment picture to the selected pictures for display. For ease of understanding, we will take the example of adding a moment picture to the first selected picture set. Fig.19 , Fig.19 1 is a flow chart of a display method for adding a moment picture to a selected picture for display provided in an embodiment of the present application. Fig.19 As shown, the method includes:
[0310] 1901: in the process of repeatedly displaying the first selected picture set in sequence, if a moment picture set determined according to the second type of picture attribute is detected, the moment picture set is jumped and displayed;
[0311] In this step, the electronic device determines a moment picture set from the picture library according to the second type of picture attributes. In the embodiment of the present application, the moment picture set can be understood as at least one moment picture determined according to the second type of picture attributes. The description of the moment picture can refer to the above text. Fig.12 The corresponding embodiments.
[0312] In the embodiment of the present application, the second type of picture attributes can be understood as the time information and / or location information of the picture. The time information of the picture can be the creation time, update time, and addition time of the picture, etc. For details, please refer to the first part of the term "time information of the picture". The location information of the picture can be understood as the location when the electronic device obtains the picture, such as the geographical location when the electronic device takes the picture, that is, the shooting location of the picture.
[0313] It should be understood that in this step, the electronic device jumps to display the picture set at this moment in a manner similar to the electronic device displaying the selected picture set in the first display frame. For details, please refer to the above Fig.18 The corresponding embodiments will not be described in detail here.
[0314] In addition, in the embodiments of the present application, as mentioned above Fig.12In the description of the corresponding embodiment, the moment pictures include today's moment pictures, today's moment pictures in previous years, and revisiting moment pictures. It should be understood that the embodiment of the present application does not limit the triggering method of the electronic device to determine the moment picture from the pictures in the photo album. For today's moment pictures and today's moment pictures in previous years, the electronic device can periodically filter the pictures in the gallery according to the second category of picture attributes, for example, once every 8 hours. The electronic device can filter the pictures in the gallery according to the second category of picture attributes at a fixed time every day, for example, every early morning. The electronic device can also filter the pictures in the gallery according to the second category of picture attributes when it detects that the electronic device is in a state of off-screen and charging.
[0315] It should be understood that since the revisited pictures are related to the shooting location of the pictures, the electronic device can be triggered to filter out the revisited pictures from the pictures in the gallery in the following manner:
[0316] Method 1: When the current location of the electronic device is different from the permanent location, the electronic device is triggered to select pictures from the gallery that are taken at the same location as the current location, and further determine the pictures of revisiting the old place. For example, the permanent location of the electronic device is location A, and when the location of the electronic device changes and the current location is location B, the electronic device determines the pictures taken at location B from the stored pictures, and then selects some pictures from them as pictures of the moment of revisiting the old place. For example, the electronic device can use a computer vision algorithm to determine the pictures of the moment of revisiting the old place.
[0317] Method 2: When an electronic device is used to take a picture, and the shooting location of the picture is different from the permanent location, the electronic device is triggered to filter pictures from the gallery pictures whose shooting location is the same as the current location, and further determine the pictures of revisiting the old place. For example, the electronic device takes a picture, and the shooting location of the picture is location B, while the permanent location of the electronic device is location A. The electronic device determines the pictures whose shooting location is location B from the stored pictures, and then selects some pictures from them as pictures of the moment of revisiting the old place. Exemplarily, the electronic device can use a computer vision algorithm to determine the pictures of the moment of revisiting the old place.
[0318] It should be understood that the second method of triggering the electronic device to filter pictures of revisiting the old place takes into account that the gallery application may not have the authority to obtain the location information of the electronic device in real time. In this case, the user can actively wake up the camera application to take pictures as a trigger condition.
[0319] 1902: After the picture set at this moment is displayed, the first selected picture set continues to be displayed starting from the next picture of the picture jumped to in the first selected picture set;
[0320] In this step, the picture set at the moment is displayed, which can be understood as the electronic device completing the first display of the picture set at the moment in the first display frame after detecting the picture set at the moment.
[0321] 1903: After the first selected picture set is displayed, the first selected picture set and the moment picture set are displayed in a first display order; the first display order is the order in which the first selected picture set and the moment picture set are displayed after the moment picture set is detected for the first time.
[0322] It should be understood that after the electronic device detects the moment picture set, it will add the moment picture set to the first selected picture set for display. In this step, the first display order can be understood as the display order of the first selected picture set and the moment picture set after the electronic device detects the moment picture set for the first time, that is, the display order of the pictures in the above steps 1901 and 1902.
[0323] In the case where the first selected picture set is understood as the first round of selected pictures, the method of this embodiment can also refer to the above Fig.13 Corresponding embodiments. It should be understood that Fig.13 In the example, the moment picture is displayed between the selected picture 2 and the selected picture 3. Therefore, the picture being jumped can be understood as the selected picture 2, and the next picture after the picture being jumped can be understood as the selected picture 3. The first display order can be understood as the display order of each picture after the moment picture is inserted into the selected pictures 2 and 3 in the first round of selected pictures, that is, the selected picture 1, the selected picture 2, the moment picture, the selected picture 3-selected picture 10. For step 1903, if Fig.13 As shown, after the selected pictures 3 to 10 in the first round of selected pictures are displayed, the electronic device continues to display the first round of selected pictures and moment pictures in the first display sequence.
[0324] It should be understood that the time pictures include today's time pictures, today's time pictures in previous years, and time pictures of revisiting the old place. Fig.12 In the description of the corresponding embodiment, when the electronic device detects the recommended moment picture, the following situations may occur:
[0325] Case 1: Other time pictures are detected during the display of the time picture
[0326] Since the electronic device determines the moment pictures according to the respective rules of each moment picture, it may detect that other kinds of moment pictures need to be displayed during the process of displaying a certain kind of moment pictures; or at least two kinds of moment pictures may be determined at the same time.
[0327] In the embodiment of the present application, the priority of displaying pictures is from high to low: today's time pictures, today's time pictures in previous years, pictures of revisiting the old place, and selected pictures.
[0328] In some embodiments, when the electronic device detects pictures of the same day in previous years while displaying the pictures of the time of the day at the old place revisited, the pictures of the same day in previous years are displayed after the pictures of the time of the day of the day at the old place revisited are displayed.
[0329] In some embodiments, when the electronic device detects a picture of the time of revisiting an old place while displaying pictures of the same day in previous years, the picture of the time of the same day in previous years is displayed before the picture of the time of revisiting the old place.
[0330] In some embodiments, when the electronic device detects a today's time picture while displaying a revisited time picture, it jumps to display the today's time picture, and continues to display the remaining revisited time pictures after the today's time picture is displayed.
[0331] In some embodiments, when the electronic device detects today's time picture while displaying today's time picture from previous years, it jumps to display today's time picture, and continues to display the remaining today's time pictures from previous years after today's time picture is displayed.
[0332] In some embodiments, when recommending pictures of today's time in previous years and pictures of revisiting an old place at the same time, the electronic device first displays the pictures of today's time in previous years in sequence, and then displays the pictures of revisiting an old place in sequence after the pictures of today's time in previous years are displayed.
[0333] For the above-mentioned situations, reference can be made to the above-mentioned embodiments. Fig.14 , Fig.15 The relevant description will not be repeated here.
[0334] Case 2: The same type of moment images includes multiple groups of images with different time information
[0335] In an embodiment of the present application, when the electronic device determines a moment picture according to the conditions of each type of moment picture, each type of moment picture may include multiple groups of pictures with different time information. For example, for today's moment pictures in previous years, assuming that this year is October 1, 2021, then the picture of October 1, 2020 can be used as today's moment picture in previous years, and the picture of October 1, 2015 can also be used as today's moment picture in previous years. For another example, for the moment picture of revisiting an old place, assuming that this year is 2021, the user may have been to place A in the past 2018, 2015, and 2013. Then in 2021, after the user arrives at place A, the pictures of 2018, 2015, and 2013 in the past can all be used as the moment picture of revisiting an old place.
[0336] In some embodiments, when the recommended moment pictures include at least one group of pictures, the display order of each group of pictures is determined according to the time information of the pictures, and each group of pictures in the at least one group of pictures corresponds to a different time node.
[0337] Exemplarily, the electronic device may preferentially display a group of pictures closest to the current time based on the time information of each group of pictures. For example, this year is 2021, and when the recommended pictures of today's time in previous years include two groups of pictures, namely, pictures of today's time in previous years in 2020 and 2015, the electronic device first displays pictures of today's time in previous years in 2020, and then displays pictures of today's time in previous years in 2015. Exemplarily, the electronic device may also first display pictures of today's time in previous years in 2015, and then display pictures of today's time in previous years in 2020. For this embodiment, please refer to the above Fig.16 Related description.
[0338] In some embodiments, when the recommended moment pictures include at least one group of pictures, the electronic device can reduce the number of pictures in each group. For example, when the recommended moment pictures are a group of pictures, the number of moment pictures is 10, and when the recommended moment pictures have multiple groups of pictures, the number of moment pictures in each group can be reduced to 5.
[0339] Case 3: The moment image set consists of images from multiple days
[0340] In the embodiment of the present application, the moment pictures can be pictures in a single day or multiple days as the same event, and then the moment pictures are selected from the pictures corresponding to the same event. In the case where the moment picture set is composed of pictures from multiple days, the number of days occupied by the moment pictures can be called the moment days. For example, the moment days of the moment pictures composed of pictures created between May 3rd and May 5th are 3 days, and the moment days of the moment pictures composed of pictures created on April 20th are 1 day.
[0341] In some embodiments, the display duration of the picture set at that moment is determined according to the time information of the pictures in the picture set at that moment.
[0342] Exemplarily, when the moment picture set is composed of pictures from the same day of creation, the electronic device detects the moment picture and displays the moment picture in a loop in the first display frame for one day. Exemplarily, when the moment picture set is composed of pictures from three consecutive days of creation, the electronic device detects the moment picture and displays the moment picture set repeatedly in the first display frame for three days.
[0343] It should be understood that in the embodiment of the present application, the display duration of the moment picture set is 1 day, which can be understood as starting from the display of the first picture of the moment picture, the moment picture set is repeatedly displayed within 24 hours. For example, the first picture of the moment picture set is displayed at 11:00 noon on March 1, and the moment picture set can be displayed at 12:00 noon on March 2, 24 hours later. Optionally, a fixed time of each day can also be used as the time to end the display of the moment picture set. For example, the first picture in the moment picture set is displayed at 8:00 in the morning, and the moment picture set is displayed at 23:00 in the evening of the same day. It can also be considered that the display duration of the moment picture set is one day.
[0344] It should be understood that when the electronic device encounters at least two of the above three situations, the display methods in each situation can be combined. For example, when two groups of revisiting moment pictures (such as revisiting moment picture A and revisiting moment picture B) are detected, for each group of revisiting moment pictures, they will be displayed in the order of time in the above situation two. For example, if revisiting moment picture A is a picture from 2015, and revisiting moment picture B is a picture from 2019, then revisiting moment picture B can be displayed first, and then revisiting moment picture A can be displayed. In addition, if the pictures in revisiting moment picture B are composed of pictures from 3 days, and revisiting moment picture A is composed of pictures from 2 days, then according to the method in the above situation three, starting from the detection of the above two groups of revisiting moment pictures, the display duration of revisiting moment picture A is 2 days, and the display duration of revisiting moment picture is 3 days. Furthermore, if in the process of displaying the above two groups of pictures of the time of revisiting the old place, pictures of the time of today in previous years are detected, then according to the method of situation one, the above two groups of pictures of the time of revisiting the old place are displayed before the pictures of the time of today in previous years are displayed.
[0345] It should be understood that other combinations of situations can be deduced in this way, and will not be repeated here. For easier understanding of the above examples, please refer to the previous article Fig.17 The corresponding embodiments.
[0346] In some embodiments, the order in which the first selected picture set is displayed in sequence is determined according to a score value of each picture, and the score value is obtained by the electronic device using a computer vision algorithm according to attributes of the first category of pictures.
[0347] It should be understood that, as described in the above step 1802, the electronic device uses a computer vision algorithm to calculate the score value of each image according to the evaluation dimension of the image. Exemplarily, the electronic device can display the at least one selected image in order from high to low scores; or can display the at least one selected image in order from low to high scores.
[0348] In some embodiments, when the first set of selected pictures are all from the same album, the display order of the pictures in the first set of selected pictures is the same as the arrangement order of each picture in the album.
[0349] It should be understood that when the first display frame is displayed at the first position and the first selected picture set is not determined according to the first type of picture attributes, the electronic device uses pictures in any album as the first selected picture set, and the first selected picture set all comes from the same album. Alternatively, the first selected picture set determined by the electronic device through a computer vision algorithm happens to come from the same album.
[0350] In some embodiments, the order in which the first selected picture set is displayed in sequence is determined according to the creation time of each picture. For example, the electronic device may display the first selected picture set in sequence from the latest to the earliest creation time of the pictures, that is, pictures that are closer to the present are displayed first. Since recent memories are clearer than previous memories, it is convenient for users to recall recent events in a timely manner.
[0351] In the embodiment of the present application, the understanding of the early and late of multiple times is as follows: the closer to the present moment, the later, and the farther away from the present moment, the earlier. For example, now is December 10, 2021. For the moments August 10, 2021 and December 15, 2020, August 10, 2021 is later than December 15, 2020, and the order from late to early is August 10, 2021 and December 15, 2020. It should be understood that the rest of the moments can be inferred by analogy, and will not be repeated later; it should also be understood that the above comparison of the year, month, and day moments can also be compared with the hours, minutes, and seconds according to the actual situation. The comparison method is similar to the above, and will not be repeated here.
[0352] For example, the electronic device can display the first selected picture set in order from the earliest to the latest according to the creation time of the pictures, that is, pictures with a longer time interval from the present are displayed first. It can be understood that the longer the time interval between the pictures and the present, the more vague the memory associated with them is. The above method can timely evoke the user's long-standing memories and relive the good times.
[0353] In some embodiments, the similarity between any two selected pictures is less than or equal to the first similarity, so as to reduce repeated display of similar pictures and improve user experience.
[0354] It should be understood that in this embodiment, the first similarity can be determined according to actual conditions, and different values can be adaptively selected as the first similarity when different standards are used to measure the similarity, and this application does not limit this.
[0355] It is understandable that the similarity (also referred to as matching degree) between two images can be determined in a variety of ways. Exemplarily, in one possible implementation, it can be determined by matching the histograms of the two images. For example, for image A and image B, the electronic device can calculate the histograms of the two images respectively, and then calculate the normalized correlation coefficient of the two histograms. The larger the correlation coefficient, the more similar the two images are. Among them, the normalized correlation coefficient can be Bhattacharyya distance, histogram intersection distance, etc.
[0356] In another possible implementation, the similarity can be determined by performing matrix decomposition on the image. It is understandable that the image itself is a matrix, and the robustness features representing the values and distribution of the matrix elements can be obtained by mathematical matrix decomposition to calculate the similarity of the image. For example, the electronic device can use non-negative matrix factorization (NMF), singular value decomposition (SVD), etc. to perform matrix decomposition on the image to determine the similarity.
[0357] Optionally, in another possible implementation, if the time interval between the creation times of any two pictures is less than a time threshold, the two pictures may be considered similar pictures. For example, when a user uses a camera to take pictures, pressing the shutter button quickly for many times may result in a very short time interval between the creation times of the pictures taken. In this case, it can be considered that the user has taken the same scene and the pictures taken are similar.
[0358] It should be understood that in this embodiment, the above time threshold can be determined according to actual conditions, and can be 1 second, 1.5 seconds or 2 seconds, etc., and this application does not limit this.
[0359] The above introduces the image display method provided by the embodiment of the present application. Next, the electronic device involved in the embodiment of the present application is introduced.
[0360] See also Fig. 20 , Fig. 20 It is a structural diagram of an electronic device 100 provided in an embodiment of the present application.
[0361] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0362] In some embodiments, the internal memory 121 may be used to store pictures.
[0363] It is understandable that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.
[0364] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0365] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.
[0366] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0367] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0368] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 may be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 may be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0369] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.
[0370] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0371] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to implement the function of playing music through a Bluetooth headset.
[0372] The MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0373] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0374] The USB interface 130 is an interface that complies with the USB standard specification, and specifically can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.
[0375] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0376] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.
[0377] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0378] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.
[0379] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0380] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.
[0381] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays a picture or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0382] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0383] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).
[0384] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
[0385] The display screen 194 is used to display pictures, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.
[0386] In some embodiments, the display screen 194 can display pictures, such as the featured pictures and moment pictures mentioned above.
[0387] The electronic device 100 can implement the acquisition function through ISP, camera 193, video codec, GPU, display screen 194 and application processor, so as to realize the image acquisition module of the HAL layer in the embodiment of the present application.
[0388] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into a picture or video visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the picture. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.
[0389] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital picture or video signal. The ISP outputs the digital picture or video signal to the DSP for processing. The DSP converts the digital picture or video signal into a picture or video signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0390] The digital signal processor is used to process digital signals, and can process not only digital images or video signals, but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0391] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0392] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0393] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.
[0394] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, a picture or video playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0395] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.
[0396] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.
[0397] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.
[0398] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.
[0399] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.
[0400] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0401] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.
[0402] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.
[0403] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.
[0404] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover automatic unlocking and other features are set.
[0405] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0406] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.
[0407] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0408] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0409] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0410] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
[0411] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.
[0412] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.
[0413] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.
[0414] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0415] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.
[0416] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0417] In some embodiments, the processor 110 can call computer instructions stored in the internal memory 121 to obtain multiple pictures from the internal memory 121 or through the external memory interface 120; then determine a selected picture from the multiple pictures based on the first type of picture attributes; or, determine a moment picture from the multiple pictures based on the second type of picture attributes.
[0418] The processor 110 can call the computer instructions stored in the internal memory 121 to determine the score value of the selected picture or the moment picture, and display the selected picture or the moment picture on the display screen 194 according to the score value.
[0419] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.
[0420] See also Fig.21, Fig.21 It is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application.
[0421] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.
[0422] The application layer can include a series of application packages.
[0423] like Fig.21 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
[0424] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0425] like Fig.21 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0426] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0427] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.
[0428] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.
[0429] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).
[0430] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, etc.
[0431] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0432] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.
[0433] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.
[0434] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0435] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0436] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0437] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0438] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0439] A 2D graphics engine is a drawing engine for 2D drawings.
[0440] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0441] In some embodiments, the sensor driver is used to respond to user operations and generate events to trigger a camera application in the application layer to take a picture.
[0442] In some embodiments, the sensor driver is used to respond to user operations and generate events to trigger a window manager in the application framework layer to determine a display frame for displaying a picture according to the user operations.
[0443] In the embodiment of the present application, the application framework layer may further include a picture display module. The sensor driver is used to respond to user operations, generate events to trigger the picture display module to obtain multiple pictures, and determine the selected pictures that meet the first type of picture attributes, or the moment pictures that meet the second type of picture attributes, from the multiple pictures;
[0444] The picture display module is also used to determine the rating value of the selected pictures or the rating value of the moment pictures, and sort the selected pictures or the selected pictures according to the rating value of the pictures.
[0445] The sensor driver is also used to respond to user operations and generate events to trigger the image display module to switch the displayed image.
[0446] In some embodiments, the image display module may trigger a two-dimensional graphics engine or a three-dimensional graphics processing library to render the image, and trigger a display driver at the kernel layer to display the image.
[0447] It is understandable that, in some embodiments, the image display module may also be at other levels of the layered architecture, such as an application layer, etc., which is not limited here.
[0448] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.
[0449] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.
[0450] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
Claims
1. A method for displaying an image, characterized in that: Applied to electronic equipment, the method comprises: In response to the first operation, a first card is displayed on the desktop of the electronic device, and before the electronic device detects that there are recommended pictures of the second category, the pictures of the first category are cyclically displayed in the first card, wherein the pictures of the first category are pictures determined from the album of the electronic device according to the attributes of the pictures of the first category; When displaying a first picture in the first category of pictures in the first card, the electronic device detects that there is a recommended picture in the second category; After the electronic device detects that there are recommended pictures of the second category, in response to the recommendation, pictures are displayed in a loop in the following order: after displaying the first picture, pictures of the second category and category identifiers of the pictures of the second category are displayed in the first card, and after displaying the last picture of the second category, pictures of the first category that follow the first picture continue to be displayed; wherein the pictures of the second category are pictures determined from the photo album of the electronic device based on attributes of the pictures of the second category, and the attributes of the pictures of the first category are different from the attributes of the pictures of the second category.
2. The method according to claim 1, characterized in that The first category of image attributes includes any one or more of the following: image pixels, image clarity, image color saturation, image composition, image subject recognition, and image subject category recognition; the second category of image attributes includes image time information and / or location information.
3. The method according to claim 1, characterized in that: After continuing to display the pictures after the first picture in the first category of pictures, the method further includes: The third category of pictures is displayed in a loop in the first card, the third category of pictures is pictures determined from the photo album of the electronic device according to the attributes of the first category of pictures, and the pictures in the third category of pictures are different from the pictures in the first category of pictures.
4. The method according to any one of claims 1 to 3, characterized in that Before detecting that there are recommended second-category pictures, the method further includes: Determine the second category of pictures according to the attributes of the second category of pictures; the second category of pictures includes any one of the first subcategory pictures satisfying the first condition, the second subcategory pictures satisfying the second condition, and the third subcategory pictures satisfying the third condition; The first condition is that the time difference between the creation time of the picture and the current time is less than or equal to the first threshold; the second condition is that the time difference between the creation time of the picture and the first time is less than or equal to the first threshold, and the first time and the current time belong to the same day in different years; the third condition is that the shooting location of the picture is the same as the current location of the electronic device.
5. The method according to claim 4, characterized in that In the case where the second category of pictures is the second subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes: When displaying a second picture in the second subcategory of pictures, detecting that there is a recommended picture of the first subcategory, and in response to the recommendation, displaying the first subcategory picture and a category identifier of the first subcategory picture in the first card after displaying the second picture; After displaying the last picture in the first subcategory of pictures, continue to display pictures after the second picture in the second subcategory of pictures and category identifiers of the pictures; After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes: After displaying the last picture in the second subcategory of pictures, continue to display pictures after the first picture in the first category of pictures.
6. The method according to claim 4, characterized in that In the case where the second category of pictures is the third subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes: When displaying the second picture in the third subcategory of pictures, detecting that there is a recommended picture in the first subcategory, and in response to the recommendation, displaying the first subcategory picture and the category identifier of the first subcategory picture in the first card after displaying the second picture; After displaying the last picture in the first subcategory of pictures, continue to display pictures after the second picture in the third subcategory of pictures and category identifiers of the pictures; After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes: After displaying the last picture in the third subcategory of pictures, continue to display pictures after the first picture in the first category of pictures.
7. The method according to claim 4, characterized in that In the case where the second category of pictures is the second subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes: When displaying the second picture in the second subcategory of pictures, the recommended third subcategory of pictures is detected, and after the last picture of the second subcategory of pictures is displayed, the third subcategory of pictures and the category identifier of the third subcategory of pictures are displayed in the first card; After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes: After displaying the last picture in the third subcategory of pictures, continue to display pictures after the first picture in the first category of pictures.
8. The method according to claim 4, characterized in that In the case where the second category of pictures is the third subcategory of pictures, before displaying the last picture in the second category of pictures, the method further includes: When displaying the second picture in the third subcategory of pictures, a recommended picture of the second subcategory is detected, and after the last picture of the third subcategory is displayed, the picture of the second subcategory and a category identifier of the picture of the second subcategory are displayed in the first card; After displaying the last picture in the second category of pictures, continuing to display pictures after the first picture in the first category of pictures includes: After displaying the last picture in the second subcategory of pictures, continue to display pictures after the first picture in the first category of pictures.
9. The method according to claim 4, characterized in that The displaying of the second category of pictures and the category identifiers of the second category of pictures in the first card includes: When recommended pictures of the second subcategory and the third subcategory are detected at the same time, in response to the recommendation, the pictures of the second subcategory and the category identification of the pictures are displayed in the first card, and after the last picture of the second subcategory is displayed, the pictures of the third subcategory and the category identification of the pictures are displayed.
10. The method according to claim 4, characterized in that The display duration of the second category of pictures in the first card is determined according to the time information of each picture in the second category of pictures.
11. The method according to claim 4, characterized in that When the second-category picture is the third subcategory picture and the current position of the electronic device is different from the shooting position of the picture in the third subcategory picture, stop displaying the third subcategory picture in the first card.
12. The method according to claim 4, characterized in that In the case where the second category of pictures includes at least two groups of pictures formed by different time nodes, the group of pictures closest to the current time is displayed preferentially in chronological order.
13. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: During the process of displaying the first picture, a second operation performed on the first card is detected, and in response to the second operation, a picture next to the first picture in the first category of pictures is displayed in the first card; Alternatively, in response to the second operation, a previous picture of the first picture in the first category of pictures is displayed in the first card.
14. An electronic device, characterized in that: The electronic device includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the electronic device and the display to cooperate to execute the method described in any one of claims 1-13.
15. A chip, characterized in that: The chip is applied to an electronic device, and the chip includes one or more processors, and the processor is used to call computer instructions so that the electronic device and the display cooperate to execute the method as described in any one of claims 1-13.
16. A computer-readable storage medium comprising instructions, characterized in that: When the instructions are executed on an electronic device, the electronic device cooperates with a display to execute the method as claimed in any one of claims 1 to 13.
