Image display method and electronic device
By detecting and displaying the time picture and its logo after displaying the first picture in the desktop card of the electronic device, the problem that it is difficult to arouse user memories in the prior art is solved, and a better user experience is achieved.
Patent Information
- Application Number
- CN202111674207.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-31
- Publication Date
- 2025-07-25
- Estimated Expiration
- 2041-12-31
AI Technical Summary
The prior art is difficult to effectively evoke user memories through pictures and improve user experience.
After the electronic device displays the first picture in the first card on the desktop, it detects the recommended second type of picture, and displays the second type of picture and its category identifier in the first card, giving priority to displaying the moment picture to evoke the user's memories.
By prioritizing the display of time pictures with time and location information, users can recall the past more effectively and improve user experience.
Smart Images

Figure CN116414280B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and in particular to a method for displaying pictures and an electronic device. Background Art
[0002] With the development of digital photography technology, taking pictures has become an increasingly simple thing in people's daily lives. The pictures taken, or the pictures obtained by other means, are all visual records of personal history. For example, the photos taken every year on birthdays, the photos taken during outings on holidays, and the pictures downloaded through social software are all wonderful records of life. In this fast-paced era, the memories evoked by a certain picture can soothe the busy heart and are often the warmest comfort in the soul. Summary of the Invention
[0003] This application provides a method for displaying pictures and an electronic device. Through some embodiments of this application, it can help users recall the past through pictures and improve the user experience.
[0004] In a first aspect, an embodiment of this application provides a method for displaying pictures, and the method includes:
[0005] In response to a first operation, display a first card on the desktop of the electronic device; a first picture is displayed in the first card, and the first picture is one picture in a first type of pictures, and the first type of pictures is pictures determined from the album of the electronic device according to first type of picture attributes;
[0006] Detect that there are recommended second type of pictures, and in response to the recommendation, after displaying the first picture, display the second type of pictures and the category identifier of the second type of pictures in the first card; wherein, the second type of pictures is pictures determined from the album of the electronic device according to second type of picture attributes;
[0007] After displaying the last picture in the second type of pictures, continue to display the pictures in the first type of pictures after the first picture.
[0008] In the embodiments of this application, the first operation can be understood as a user operation that triggers the electronic device to display the first card on the desktop. Exemplarily, the first operation can be understood as Figure 16 the first user operation in the corresponding embodiment, that is, such as Figure 4 the operation that enables the electronic device to turn on the "Smart Selection" mode.
[0009] In the embodiments of the present application, the above-mentioned first card can be understood as a display frame or a desktop card. The electronic device displays the pictures in the above-mentioned first type of pictures within the above-mentioned first card, or the electronic device displays the pictures in the above-mentioned second type of pictures within the above-mentioned first card. It should be understood that one desktop of the electronic device may include multiple above-mentioned first cards, and the electronic device can display pictures on multiple above-mentioned first cards through the above-mentioned picture display method. It should also be understood that the desktop where the first card is located can be the main desktop or other desktops, and the present application does not make any limitations in this regard.
[0010] In the embodiments of the present application, the above-mentioned first type of pictures can be understood as selected pictures. For specific reference, please refer to Figure 4 the description of selected pictures in the corresponding embodiments; the above-mentioned second type of pictures can be understood as moment pictures. For specific reference, please refer to Figure 9 the description of moment pictures in the corresponding embodiments, which will not be elaborated here.
[0011] In the embodiments of the present application, the category identifier of the second type of pictures can be automatically generated by the electronic device for distinguishing from the above-mentioned first type of pictures. For example, the category identifier can be "Weekend Memories", "Holiday Memories", "Looking Back Suddenly", etc. Displaying the category identifier of the second type of pictures in the first card can be understood as displaying the category identifier in text within the first card.
[0012] In the embodiments of the present application, when the electronic device detects that there are recommended second type of pictures while displaying the first picture, it will continue to display the first type of pictures after finishing displaying the second type of pictures. That is to say, the electronic device gives priority to displaying moment pictures. Since moment pictures are determined by the attributes of the second type of pictures and are more meaningful than the first type of pictures determined by the attributes of the first type of pictures, and can better help users evoke a memory, therefore, the method provided by the embodiments of the present application can effectively help users recall the past through pictures and improve the user experience.
[0013] In a possible implementation manner, the above-mentioned first type of picture attributes include any one or more of the following: the pixel of the picture, the clarity of the picture, the color saturation of the picture, the composition of the picture, the recognition degree of the picture subject, the recognition degree of the category of the picture subject; the above-mentioned second type of picture attributes include the time information and / or location information of the picture.
[0014] In the embodiments of the present application, the above-mentioned first type of picture attributes can be understood as the indicators in the dimensions of picture quality evaluation and aesthetic evaluation. For specific reference, please refer to the description in Part 2 of the terms "Evaluation Dimensions of Pictures". It should be understood that the electronic device can use computer vision algorithms to automatically score pictures with the pixel of the picture, the clarity of the picture, the color saturation of the picture, the composition of the picture, the recognition degree of the picture subject, the recognition degree of the category of the picture subject, etc. as indicators, and the pictures with high scores can be considered as better pictures.
[0015] In the embodiments of the present application, the time information of the picture can be the creation time, update time, addition time, etc. of the picture. For details, refer to Part 1 of the terms, "Time Information of Pictures". The location information of the picture can be understood as the location where the electronic device acquires the picture. For example, the geographical location when the electronic device takes the picture, that is, the shooting location of the picture.
[0016] In a possible implementation manner, before detecting the above-mentioned second type of pictures with recommendations, the above method further includes:
[0017] Determining the above-mentioned second type of pictures according to the above-mentioned second type of picture attributes; the above-mentioned second type of pictures includes any one of the first subclass of pictures that meet the first condition, the second subclass of pictures that meet the second condition, and the third subclass of pictures that meet the third condition; the above-mentioned first condition is that the time difference between the creation time of the picture and the current time is less than or equal to the first threshold; the above-mentioned second condition is that the time difference between the creation time of the picture and the first time is less than or equal to the second threshold, and the above-mentioned first time and the current time belong to the same day of different years; the above-mentioned third condition is that the shooting location of the picture is the same as the current location of the above-mentioned electronic device.
[0018] In the embodiments of the present application, the above-mentioned second type of pictures can be understood as moment pictures, the above-mentioned first subclass of pictures can be understood as today's moment pictures, the above-mentioned second subclass of pictures can be understood as moment pictures of the same day in previous years, and the above-mentioned third subclass of pictures can be understood as moment pictures of revisiting old places. That is to say, the above-mentioned first subclass of pictures, the above-mentioned second subclass of pictures, and the above-mentioned third subclass of pictures can all be understood as the second type of pictures, but the conditions for the electronic device to select moment pictures of each category are different.
[0019] For the relevant descriptions of today's moment pictures, moment pictures of the same day in previous years, and moment pictures of revisiting old places, reference can be made to Figure 9 The corresponding embodiments. Among them, the above-mentioned first threshold can be understood as Figure 9 The first time threshold in the corresponding embodiments, and the above-mentioned second threshold can be understood as Figure 9 The second time threshold in the corresponding embodiments.
[0020] It should be understood that in the embodiments of the present application, there can be multiple ways to trigger the electronic device to select a moment picture from the album pictures. For example, the electronic device can periodically screen the pictures in the album and select the pictures that meet the conditions (i.e., the above first condition, or the above second condition, or the above third condition) as the moment pictures; the electronic device can select a moment picture from the album pictures when charging and the screen is turned off; it can also obtain its own geographical location in real time and select a moment picture from the album pictures when the location changes. Therefore, the above current time can be understood as the moment when the electronic device is triggered to select a moment picture from the album pictures. Exemplarily, after triggering the electronic device to select a moment picture from the album pictures, the electronic device can first obtain a time stamp and then use this time stamp as the current time to select a moment picture. In addition, the above current location can be understood as the location of the electronic device when it is triggered to select a moment picture from the album pictures.
[0021] In the embodiments of the present application, when the above second type of picture is displayed in the above first card, the category identifier of the above second type of picture is also displayed in the above first card. That is to say, when the electronic device displays the above first subclass pictures, the above second subclass pictures, and the above third subclass pictures, the category identifier will be displayed in the above first card. For example, it can be "Weekend Memories", "Holiday Memories", "Looking Back Suddenly", etc.
[0022] In a possible implementation manner, when the above second type of picture is the above second subclass picture, before displaying the last picture in the above second type of picture, the method further includes:
[0023] When the second picture in the above second subclass picture is displayed, if it is detected that there is a recommended above first subclass picture, in response to the above recommendation, after displaying the second picture, the above first subclass picture and the category identifier of the above first subclass picture are displayed in the above first card;
[0024] After displaying the last picture in the above first subclass picture, continue to display the picture and the category identifier after the above second picture in the above second subclass picture;
[0025] The above-mentioned after displaying the last picture in the above second type of picture and continuing to display the picture after the above first picture in the above first type of picture includes:
[0026] After displaying the last picture in the above second subclass picture, continue to display the picture after the above first picture in the above first type of picture.
[0027] In this embodiment, the above-mentioned second sub-category pictures can be understood as pictures of the same day in previous years, and the above-mentioned first sub-category pictures can be understood as pictures of the current day. The above-mentioned second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended picture of the current day.
[0028] In this embodiment, when a recommended picture of the current day is detected during the display of the picture of the same day in previous years, the electronic device first jumps to display the picture of the current day, then continues to display the picture of the same day in previous years after the picture of the current day is displayed, and then continues to display the selected pictures after the picture of the same day in previous years is displayed. For details, please refer to Figure 12 the embodiments of
[0029] In a possible implementation manner, when the above-mentioned second category of pictures is the above-mentioned third sub-category of pictures, before the last picture in the above-mentioned second category of pictures is displayed, the method further includes:
[0030] When the second picture in the above-mentioned third sub-category of pictures is being displayed and a recommended above-mentioned first sub-category of pictures is detected, in response to the above-mentioned recommendation, after the above-mentioned second picture is displayed, the above-mentioned first sub-category of pictures and the category identifier of the above-mentioned first sub-category of pictures are displayed in the above-mentioned first card;
[0031] After the last picture in the above-mentioned first sub-category of pictures is displayed, continue to display the picture and the category identifier after the above-mentioned second picture in the above-mentioned third sub-category of pictures;
[0032] After the last picture in the above-mentioned second category of pictures is displayed, continuing to display the picture after the above-mentioned first picture in the above-mentioned first category of pictures includes:
[0033] After the last picture in the above-mentioned third sub-category of pictures is displayed, continue to display the picture after the above-mentioned first picture in the above-mentioned first category of pictures.
[0034] In this embodiment, the above-mentioned third sub-category pictures can be understood as pictures of revisiting old places, and the above-mentioned first sub-category pictures can be understood as pictures of the current day. The above-mentioned second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended picture of the current day.
[0035] In this embodiment, when a recommended picture of the current day is detected during the display of the picture of revisiting old places, the electronic device first jumps to display the picture of the current day, then continues to display the picture of revisiting old places after the picture of the current day is displayed, and then continues to display the selected pictures after the picture of revisiting old places is displayed.
[0036] In a possible implementation, when the second type of picture is the second sub-type picture, before displaying the last picture in the second type of picture, the method further includes:
[0037] When displaying the second picture in the second sub-type picture, if the recommended third sub-type picture is detected, after displaying the last picture in the second sub-type picture, display the third sub-type picture and the category identifier of the picture in the first card;
[0038] After displaying the last picture in the second type of picture, continuing to display the picture after the first picture in the first type of picture includes:
[0039] After displaying the last picture in the third sub-type picture, continue to display the picture after the first picture in the first type of picture.
[0040] In this embodiment, the second sub-type picture can be understood as a picture of the same day in previous years, and the third sub-type picture can be understood as a picture of revisiting an old place. The second picture can be understood as the picture being displayed in the first card when the electronic device detects a recommended picture of revisiting an old place.
[0041] In this embodiment, when a recommended picture of revisiting an old place is detected during the display of the picture of the same day in previous years, the electronic device first displays the picture of the same day in previous years and then displays the picture of revisiting an old place, and then displays the selected pictures after the picture of revisiting an old place is displayed. For details, please refer to Figure 12 the embodiment of
[0042] In a possible implementation, when the second type of picture is the third sub-type picture, before displaying the last picture in the second type of picture, the method further includes:
[0043] When displaying the second picture in the third sub-type picture, if the recommended second sub-type picture is detected, after displaying the last picture in the third sub-type picture, display the second sub-type picture and the category identifier of the picture in the first card;
[0044] After displaying the last picture in the second type of picture, continuing to display the picture after the first picture in the first type of picture includes:
[0045] After displaying the last picture in the second sub-type picture, continue to display the picture after the first picture in the first type of picture.
[0046] In this embodiment, the above-mentioned second subclass of pictures can be understood as pictures of the same day in previous years, and the above-mentioned third subclass of pictures can be understood as pictures of revisiting old places. The above-mentioned second picture can be understood as the picture being displayed in the first card when the electronic device detects that there is a recommended picture of the same day in previous years.
[0047] In this embodiment, when a recommended picture of the same day in previous years is detected during the display of the picture of revisiting old places, the electronic device first finishes displaying the picture of revisiting old places and then displays the picture of the same day in previous years, and then displays the selected pictures after the picture of the same day in previous years is displayed.
[0048] In a possible implementation manner, when a recommended second type of picture is detected, in response to the above recommendation, after the above first picture is displayed, the second type of picture and the category identifier of the second type of picture are displayed in the above first card, including:
[0049] When both the above-mentioned second subclass of pictures and the above-mentioned third subclass of pictures are detected to be recommended, in response to the above recommendation, the above-mentioned second subclass of pictures and the picture category identifier are displayed in the above first card, and after the last picture in the above-mentioned second subclass of pictures is displayed, the above-mentioned third subclass of pictures and the picture category identifier are displayed.
[0050] In this embodiment, the above-mentioned second subclass of pictures can be understood as pictures of the same day in previous years, and the above-mentioned third subclass of pictures can be understood as pictures of revisiting old places. When both a recommended picture of the same day in previous years and a picture of revisiting old places are detected, the electronic device first displays the picture of the same day in previous years and then displays the picture of revisiting old places. It should be understood that after the picture of revisiting old places is displayed, the electronic device continues to display the selected pictures.
[0051] In a possible implementation manner, the above-mentioned displaying the second type of picture and the category identifier of the second type of picture in the above first card includes:
[0052] When the second picture in the above-mentioned second type of picture is displayed, in response to the second operation, determine the new picture added to the above-mentioned second type of picture;
[0053] After the above-mentioned second picture is displayed, the above-mentioned new picture and the picture category identifier are displayed in the above first card;
[0054] After the above-mentioned new picture is displayed, continue to display the picture after the above-mentioned second picture in the above-mentioned second type of picture.
[0055] In the embodiment of the present application, the above-mentioned second operation can be understood as an operation for the user to add a picture to the moment picture. For example, it can be Figure 13The user operation in the corresponding embodiment. In this embodiment, the second picture can be understood as the second picture being displayed in the first card when the electronic device responds to the second operation. The second picture is a picture in the second type of pictures. That is to say, when the user adds a new picture to the second type of pictures through the second operation, the first card is displaying the second type of pictures.
[0056] In the above case, after the second picture is displayed, the electronic device first displays the new picture in the first card, and then continues to display the pictures in the second type of pictures after the second picture. For details, please refer to Figure 15 The corresponding embodiment.
[0057] In a possible implementation manner, after determining the second type of pictures according to the second type of picture attributes and before detecting the recommended second type of pictures, the method further includes:
[0058] In response to the second operation, determine the new picture added to the second type of pictures;
[0059] According to the new picture and the second type of picture attributes, re-determine the second type of pictures; the second type of pictures includes the new picture.
[0060] In the embodiment of the present application, the second operation can be understood as an operation for the user to add a picture to the moment picture. For example, it can be Figure 13 The user operation in the corresponding embodiment. The second type of pictures can be understood as moment pictures. Before detecting the recommended moment pictures, the electronic device determines the new picture added to the second type of pictures in response to the second operation. Since the moment pictures have not been displayed in the first card yet, the electronic device re-determines the moment pictures according to the new picture and the second type of picture attributes. The re-determined moment pictures include the pictures newly added by Tong Hu through the second operation, that is, the new pictures. For details, please refer to Figure 14 The corresponding embodiment.
[0061] In a possible implementation manner, after displaying the first picture, the method further includes:
[0062] Detect the changed first type of pictures, and determine the display position of the next picture of the first picture in the first type of pictures;
[0063] Display the picture located at the display position in the changed first type of pictures.
[0064] It can be understood that the pictures in the picture gallery are dynamically changing. For example, the user can take new pictures at any time, can also receive pictures sent by other electronic devices at any time, and can also delete pictures from the electronic device at any time. Therefore, during the process of the electronic device sequentially displaying the selected pictures, the displayed selected pictures may change. In the embodiments of the present application, after the pictures in the picture gallery change, the electronic device will re-select the first type of pictures from the pictures in the picture gallery according to the first type of picture attributes. The re-selected first type of pictures can be understood as the first type of pictures after the change.
[0065] In this embodiment, when the first picture is detected in the first card and the first type of pictures after the change is detected, the electronic device determines the display position of the next picture of the first picture in the first type of pictures before the change. For example, if the first picture is the 5th picture in the first type of pictures before the change, then the display position of the next picture of the first picture in the first type of pictures before the change is the 6th picture. After the first picture is displayed, the electronic device displays the 6th picture in the pictures after the change. For details, reference can also be made to Figure 7 The corresponding embodiment.
[0066] In a possible implementation manner, after the first picture is displayed, the method further includes:
[0067] Detecting the first type of pictures after the change, and determining the pictures that have been displayed. The pictures that have been displayed are the pictures in the first type of pictures whose display positions are before the first picture;
[0068] Taking the pictures in the first type of pictures after the change except the pictures that have been displayed as the pictures in the first type of pictures after the first picture and displaying them.
[0069] As in the previous embodiment, the pictures in the picture gallery are dynamically changing. For example, the user can take new pictures at any time, can also receive pictures sent by other electronic devices at any time, and can also delete pictures from the electronic device at any time. Therefore, during the process of the electronic device sequentially displaying the selected pictures, the displayed selected pictures may change. In the embodiments of the present application, after the pictures in the picture gallery change, the electronic device will re-select the first type of pictures from the pictures in the picture gallery according to the first type of picture attributes. The re-selected first type of pictures can be understood as the first type of pictures after the change.
[0070] In order to reduce duplicate display, the electronic device starts displaying from the first picture in the first type of pictures after the change, but skips the pictures that have been displayed in the first type of pictures before the change. The pictures that have been displayed are the pictures in the first type of pictures whose display positions are before the first picture. For details, reference can also be made to Figure 8 The corresponding embodiment.
[0071] In a possible implementation, it is characterized in that the similarity between any two pictures in the above-mentioned first type of pictures or any two pictures in the above-mentioned second type of pictures is less than or equal to the first similarity.
[0072] It should be understood that in the embodiments of the present application, the above-mentioned first similarity can be determined according to the actual situation, and different values can be adaptively selected as the above-mentioned first similarity when different criteria are used to measure the similarity. The present application does not make any limitations in this regard. For example, it can be determined by histogram matching of two pictures, or by matrix decomposition of pictures, or according to the time interval between the creation times of any two pictures, etc. For details, reference can be made to Figure 16 the relevant descriptions in the corresponding embodiments.
[0073] In a second aspect, an embodiment of the present application provides an electronic device, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, and the computer program code includes computer instructions. The one or more processors call the computer instructions to cause the electronic device to cooperate with a display to execute the method in the first aspect or any possible implementation manner of the first aspect;
[0074] In a third aspect, an embodiment of the present application provides a chip, which is applied to an electronic device. The chip includes one or more processors, and the processors are used to call computer instructions to cause the electronic device to cooperate with a display to execute the method described in the first aspect and any possible implementation manner in the first aspect.
[0075] In a fourth aspect, an embodiment of the present application provides a computer program product containing instructions. When the computer program product runs on an electronic device, the electronic device is caused to execute the method described in the first aspect and any possible implementation manner in the first aspect.
[0076] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, including instructions. When the instructions run on an electronic device, the electronic device is caused to execute the method described in the first aspect and any possible implementation manner in the first aspect. Description of the Drawings
[0077] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.
[0078] Figure 1It is a schematic diagram of a user interface for displaying "wonderful moments" pictures on the negative first screen provided by an embodiment of the present application;
[0079] Figure 2 It is a schematic diagram of a user interface for setting the desktop and adding a display frame to display gallery photos on the desktop provided by an embodiment of the present application;
[0080] Figure 3 It is a schematic diagram of a user interface for setting a service card on a gallery application to display pictures provided by an embodiment of the present application;
[0081] Figure 4 It is a schematic diagram of a user interface for enabling the "intelligent selection" mode provided by an embodiment of the present application;
[0082] Figure 5 It is a schematic diagram of a user interface for refreshing the selected pictures displayed in a desktop card while keeping the interface unchanged provided by an embodiment of the present application;
[0083] Figure 6 It is a schematic diagram of a user interface for refreshing the selected pictures displayed in a desktop card when the interface changes provided by an embodiment of the present application;
[0084] Figure 7 It is a schematic diagram of the display method after new pictures are added to the gallery during the process of sequentially displaying selected pictures in a desktop card provided by an embodiment of the present application;
[0085] Figure 8 It is another schematic diagram of the display method after new pictures are added to the gallery during the process of sequentially displaying selected pictures in a desktop card provided by an embodiment of the present application;
[0086] Figure 9 It is a schematic diagram of the type of moment pictures provided by an embodiment of the present application;
[0087] Figure 10 It is a schematic diagram of adding moment pictures for display during the process of displaying selected pictures provided by an embodiment of the present application;
[0088] Figure 11 It is a schematic diagram of adding pictures of revisiting old places during the process of displaying pictures of the same day in previous years provided by an embodiment of the present application;
[0089] Figure 12 It is a schematic diagram of adding pictures of the current day during the process of displaying pictures of the same day in previous years provided by an embodiment of the present application;
[0090] Figure 13 It is a schematic diagram of a user interface for adding moment pictures provided by an embodiment of the present application;
[0091] Figure 14 It is a schematic diagram provided by an embodiment of the present application for displaying a moment picture on a desktop card after adding a moment picture;
[0092] Figure 15 It is a schematic diagram provided by an embodiment of the present application for displaying a newly added moment picture during the display of a moment picture;
[0093] Figure 16 It is a schematic flowchart of a picture display method provided by an embodiment of the present application;
[0094] Figure 17 It is a schematic structural diagram of an electronic device 100 provided by an embodiment of the present application;
[0095] Figure 18 It is a software structural block diagram of an electronic device 100 provided by an embodiment of the present application. Detailed implementation manners
[0096] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification and appended claims of the present application, the singular forms "a", "an", "the", "above-mentioned", "said", and "this" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term " / and / " used in the present application refers to and includes any or all possible combinations of one or more of the listed items.
[0097] To describe the solution provided by the present application more clearly, the terms related to the embodiments of the present application will be introduced first below.
[0098] 1. Time information of a picture
[0099] It can be understood that multiple pictures can be stored inside the electronic device, and the electronic device can respond to user operations to perform operations such as adding, deleting, and modifying pictures. Therefore, in the embodiments of the present application, the picture attributes include time information.
[0100] In the embodiments of the present application, a picture can correspond to 3 different time information, namely the creation time of the picture, the update time of the picture, and the addition time of the picture.
[0101] 1.1. Creation time of a picture
[0102] The creation time of the picture can be understood as the time when the electronic device acquires the picture. For example, the moment when the electronic device takes the picture (which can also be called the shooting time), the moment when the picture is obtained by taking a screenshot (which can also be called the screenshot time), the moment when the picture is saved from software (such as WeChat, Weibo), and the moment when the picture is acquired through a communication connection with other electronic devices. Exemplarily, the electronic device can determine the creation time of the picture from the exchangeable image file (EXIF) information.
[0103] 1.2. Update time of the picture
[0104] The update time of the picture can be understood as the time when the picture is updated after its creation time. Exemplarily, updating the picture can be understood as editing the picture. For example, the electronic device can respond to the user's editing operation and modify the size, color, etc. of the picture. In the case where the electronic device edits Picture A and saves the edited Picture A as Picture B, the creation time of Picture B is the creation time of Picture A. At the same time, Picture B also corresponds to an update time, that is, the time when the electronic device stores Picture B.
[0105] Another exemplarily, Picture C is taken by electronic device B. Therefore, in electronic device B, the time information of Picture C includes the creation time. After electronic device B shares Picture C to electronic device A through social software, in electronic device A, the time information of Picture C includes the creation time and the update time, and the update time is the time when electronic device A receives Picture C.
[0106] 1.3. Addition time of the picture
[0107] The addition time of the picture can be understood as the time when the picture is added to the album. For example, the electronic device can respond to sharing operations, moving operations, copy / paste operations, edit and save operations, etc. to add pictures to the album.
[0108] It should be understood that electronic device A can establish a wireless connection with electronic device B, such as a Bluetooth connection, a wifi connection, etc., and then share pictures through this wireless connection. Taking the example that electronic device B shares Picture C to electronic device A through a Bluetooth connection, electronic device A will automatically create a shared album, such as a "Bluetooth Share" album, and automatically add the received Picture C through the Bluetooth connection to this "Bluetooth Share" album. Therefore, in electronic device A, the addition time of Picture C is the time when Picture C is added to the "Bluetooth Share" album after electronic device A receives Picture C through the Bluetooth connection.
[0109] It should be understood that in the case of moving Picture C from Album A to Album B, the creation time of Picture C will not change, and the addition time is the time when it is moved to Album B.
[0110] It should be understood that in the case of copying and pasting Picture C and adding it to an album, the electronic device will create a copy of Picture C (which can be called Picture C_1). The creation time of Picture C_1 is the creation time of Picture C, and the addition time of Picture C_1 is the time when it is added to the album.
[0111] In the case of editing Picture C in Album A and then saving it as Picture D to Album B, the creation time of Picture D in Album B is the creation time of Picture C, and the addition time of Picture D is the time when it is saved to Album B.
[0112] In the embodiments of this application, the gallery can be understood as software on the electronic device for displaying stored pictures. It can be understood that the gallery can include multiple albums, and each album can include at least one picture. Exemplarily, the electronic device can customize and generate albums, or respond to user operations to generate albums. For example, the electronic device can create albums such as "Garden", "Pet", "Clothing", etc. according to user operations.
[0113] In the embodiments of this application, the electronic device can respond to user operations to determine the arrangement order of pictures in an album. For example, the electronic device can, according to user operations, sort the pictures in the album from the latest to the earliest creation time, or from the latest to the earliest update time, or from the latest to the earliest addition time.
[0114] Generally, the "Camera Album" includes pictures taken by the electronic device through the camera, and the pictures in it are sorted from the latest to the earliest creation time; the "All Photos Album" includes all pictures stored by the electronic device, and the pictures in it are sorted from the latest to the earliest update time.
[0115] It can be understood that in the case of the electronic device editing Picture A and storing the edited Picture A as Picture B, Picture A and Picture B will exist in the album at the same time. Among them, Picture A can be understood as the original picture, and Picture B can be understood as the saved picture. Generally, the name of the saved picture is "IMG_Update Date_Time". Therefore, in the case where the creation times of the two pictures are the same, the update time of the pictures can be further determined by the naming of the pictures.
[0116] It can be understood that in an album where pictures are sorted from the latest update time to the earliest, and the album includes original pictures and saved-as pictures, the saved-as pictures can be displayed in front of the original pictures or behind the original pictures. For example, when the original picture is taken by a camera, the original picture can be named "IMG_20211204_175901", and the saved-as picture obtained by editing the original picture can be named "IMG_20211207_110101". In this case, the saved-as picture is displayed in front of the original picture. When the original picture is downloaded from software (such as Weibo, etc.), the original picture can be named "img-134XXXX", and the saved-as picture obtained by editing the original picture can be named "IMG_20211207_110101". In this case, the saved-as picture is displayed behind the original picture.
[0117] 2. Evaluation Dimensions of Pictures
[0118] In the embodiments of the present application, the electronic device can evaluate pictures from two aspects: quality and aesthetics. Among them, the indicators for evaluating pictures from the quality perspective can be the pixels of the pictures, the clarity of the pictures, and whether there is noise in the pictures, etc.; the indicators for evaluating pictures from the aesthetics perspective can be composition, color, content subject, etc. Exemplarily, the electronic device can evaluate whether the color of the picture is moderate, whether it is overexposed or underexposed; whether the main body in the picture is complete and can be recognized; whether the category of the main body in the picture can be recognized; whether the main body and the background in the picture can be distinguished, etc.
[0119] It can be understood that the quality evaluation and aesthetic evaluation of pictures are hot research issues in the field of computer vision. Through computer vision algorithms, the electronic device can automatically score pictures, and pictures with high scores can be considered better pictures. Therefore, in the embodiments of the present application, the score value of a picture can be understood as the score value obtained by performing quality evaluation and aesthetic evaluation on the picture through computer vision algorithms. It can be understood that the score calculated by the computer vision algorithm can be negative, positive, or 0.
[0120] With the development of digital photography technology, taking pictures has become an increasingly simple thing in people's daily lives. The pictures taken, or the pictures obtained through other means, are all visual records of personal history. For example, the photos taken on birthdays every year, the photos taken during holidays when going out to play, the pictures downloaded through social software, etc. are all wonderful records of life.
[0121] In this fast-paced era, the memories evoked by a certain picture can soothe the busy heart and are often the warmest comfort in the soul. Currently, the electronic device can help users evoke memories of past lives in various ways.
[0122] Exemplarily, please refer to Figure 1 , Figure 1 which is a schematic diagram of a user interface for displaying "wonderful moments" pictures on the negative first screen provided by an embodiment of the present application. In the embodiment of the present application, the negative first screen can be understood as a user interface that appears after swiping right on the main desktop, and can provide functions such as search, application suggestions, and quick services for users.
[0123] When the electronic device supports the "Scene Intelligence" function, the user can enter the "Settings" to select to display pictures or videos of "wonderful moments" on the negative first screen. In the embodiment of the present application, the Scene Intelligence mode can be understood as obtaining the user's dynamics through multiple dimensions such as travel, shopping, preferences, and concerns, and then constructing an intelligent display reminder method according to multiple dimensions such as time, location, position, and environment.
[0124] Exemplarily, as Figure 1 the user interface 10 in can be understood as the settings interface of "Scene Intelligence". In response to a click operation on the "wonderful moments" button, the electronic device adds a display frame on the negative first screen, such as Figure 1 the user interface 11 in. The user interface 11 can be understood as the negative first screen interface, and the display frame 110 therein is used to display the recommended pictures. Exemplarily, the display frame 110 is used to display the cover picture of the recommended video, and the name "Happy Holidays" of the video is displayed in the display frame 110.
[0125] In the embodiment of the present application, the display frame can be understood as a region in the screen area of the electronic device, and pictures, texts, or videos can be played in the display frame. It can be understood that the shape of the display frame is not limited in the embodiment of the present application, and the display frame can be rectangular, trapezoidal, circular, etc. In some embodiments, the display frame can also be referred to as a card, a widget, or a component, etc.
[0126] In the user interface 11, in response to a click operation on the picture, the electronic device displays the user interface 12, and the user interface 12 is used to display the details of the "wonderful moments" recommended in the display frame 110. For example, the name of the recommended "wonderful moments" is "Happy Holidays", and the creation date is "January 13, 2021", which includes a video 120 ( Figure 1 only the cover picture of the video is shown in), pictures 121, 122, and 123, etc.
[0127] In addition, in the user interface 11, in response to a click operation on the play button 111, the electronic device displays the user interface 13, and the user interface 13 can be understood as the play interface of the video in the "wonderful moments".
[0128] At the user interface 12, in response to a click operation on the "Back" button 124, the electronic device returns to the negative first screen interface, that is, the electronic device displays the user interface 11.
[0129] In addition to adding a display box on the negative first screen to display pictures, a display box can also be added to the desktop to display pictures.
[0130] Exemplarily, please refer to Figure 2 , Figure 2 which is a schematic diagram of a user interface provided by an embodiment of the present application for setting the desktop and adding a display box on the desktop to display pictures in the picture gallery.
[0131] In the embodiment of the present application, the desktop can be understood as the screen area displayed by the electronic device after initially turning on the electronic device and successfully logging in to the system of the electronic device. It should be understood that there can be multiple desktops for the electronic device. In this case, the leftmost desktop can be called the main desktop or the home page. As Figure 2 shown in the user interface 20, it can be understood as the main desktop of the electronic device. The navigation bar 201 shows that the electronic device has a total of 5 desktops. The black circle indicates that the electronic device is in the current interface. In response to a right swipe operation on the user interface 20, the electronic device can also display other desktops. In addition, the navigation bar 201 also shows that the electronic device includes a negative first screen. In response to being on the main desktop (i.e., the current user interface 20), the electronic device can display the negative first screen.
[0132] As Figure 2 shown, in the user interface 20, in response to a user operation on the desktop by the user, such as a long press operation, a two-finger pinch operation, etc., the electronic device displays the user interface 21, and the user can set the desktop on the user interface 21.
[0133] In the user interface 21, in response to a click operation on the "Picture Gallery" tool button, the electronic device displays the user interface 22, and a display box for displaying pictures is added to the desktop in the user interface 22, such as the display box 220 in the user interface 22. In the embodiment of the present application, the display box on the desktop can also be called a desktop card.
[0134] In the user interface 22, in response to a click operation on the display box 220, the electronic device displays the user interface 23, and the user interface 23 includes a selection bar 230. The selection bar 230 includes a "Select Album" button and a "Select Picture" button. In response to a click operation on the "Select Picture" button, the electronic device can display the pictures stored in the picture gallery to the user. Then, the pictures selected by the user are displayed on the display box on the desktop. As Figure 2 shown in the user interface 24, the electronic device displays the picture selected by the user in the display box 240 and displays the name of the picture, "Little Girl".
[0135] Optionally, on the user interface 24, in response to a click operation on the display box 240, the electronic device displays the user interface 25, which includes a selection bar 250. The selection bar 250 includes a "Browse Pictures" button, a "Select Album" button, and a "Select Picture" button. After clicking the "Browse Pictures" button, the user can enter the gallery to browse pictures. After clicking the "Select Album" button, the user can specify that the pictures in a certain album are sequentially displayed in the display box on the desktop, and the pictures in the selected album can be switched every 15 seconds, every 10 seconds, or every 5 seconds. After clicking the "Select Picture" button, other pictures can be reselected for display in the display box on the desktop. It can be understood that after a certain picture is selected, the selected picture will always be displayed in the display box.
[0136] In Figure 2 the corresponding user scenario, the user adds a display box to the desktop through relevant desktop settings to display pictures. Optionally, pictures can also be displayed on the desktop after setting the gallery application. Exemplarily, please refer to Figure 3 , Figure 3 which is a schematic diagram of a user interface for setting a service card to display pictures on a gallery application provided by an embodiment of the present application.
[0137] As Figure 3 shown, for an electronic device that supports the "service card" function, a horizontal line will be displayed below the gallery application. As Figure 3 shown in 301 in the user interface 30, the display of a horizontal line below the gallery application indicates that the gallery application supports displaying pictures after the user swipes up.
[0138] On the user interface 30, in response to a long - press operation on the gallery application icon, the electronic device displays the user interface 31, which includes a selection bar 311. The selection bar 311 includes a "Service Card" button, a "Latest Photos" button, and a "Search" button. On the user interface 31, in response to a click operation on the "Service Card" button, the electronic device displays the user interface 32.
[0139] Since the electronic device defaults to displaying the pictures in the "Camera" album in the card, therefore, on the user interface 32, the electronic device previews and displays the pictures in the "Camera" album. It can be understood that in response to a downward - slide operation, the size of the display box (i.e., the card) can be modified. For example, the size of picture 323 is 2×2, the size of picture 322 is 4×2, and the size of picture 321 is 4×4. The electronic device can default to display in a 2×2 specification.
[0140] The user interface 32 also includes a "Set as Swipe - up Card" button and an "Add to Desktop" button. In response to a click operation on the "Set as Swipe - up Card", the electronic device displays the user interface 33.
[0141] On user interface 33, in response to an upward sliding operation on the gallery application, the electronic device displays user interface 34. User interface 34 includes a display frame 341 with a specification of 2×2. The electronic device displays the selected picture 323 in user interface 32 in display frame 341, and the name of the album where picture 323 is located, namely "Camera", is also displayed within this display frame 341.
[0142] It can be understood that in the case where there are multiple pictures in the "Camera" album, these multiple pictures are sequentially displayed in the display frame, and the interval between adjacent pictures can be 5 seconds, 10 seconds, 15 seconds, etc.
[0143] The embodiment of the present application provides a picture display method. The electronic device can automatically select multiple pictures from the gallery for display on the desktop, and add pictures related to the time according to a preset rule for display. This can not only personalize the desktop decoration but also add a sense of surprise to the user, enabling the user to recall the past through the displayed pictures and enhancing the user experience.
[0144] Next, the user interface related to the embodiment of the present application is introduced.
[0145] First, the process of the user enabling the "Smart Selection" mode is introduced. In the embodiment of the present application, "Smart Selection" can be understood as a service or function provided by the electronic device to support the picture display method provided by the embodiment of the present application. It can be understood that "Smart Selection" is just a term used in this embodiment, and its meaning has been recorded in this embodiment, and its name does not constitute any limitation to this embodiment. Additionally, in some other embodiments of the present application, "Smart Selection" can also be referred to as other terms such as "Smart Recommendation", "Default Mode", etc.
[0146] Exemplarily, please refer to Figure 4 , Figure 4 A schematic diagram of the user interface for enabling the "Smart Selection" mode provided by the embodiment of the present application. As Figure 4 shown, the user interface 40 displayed by the electronic device can be understood as the main desktop interface, which includes a gallery application icon. In response to a long - press operation on the gallery application icon, the electronic device displays user interface 41.
[0147] User interface 41 includes a prompt message "Relive wonderful moments with Smart Selection photos to help you recall memories. You can also customize the displayed pictures or albums", as well as a "Set as upward - sliding card" button, an "Add to negative first screen" button, and an "Add to desktop" button. It can be understood that the above 3 buttons can determine the position of the display frame for displaying pictures, that is, it can be used as an upward - sliding card, or on the negative first screen, or on the desktop. Among them:
[0148] In response to a click operation on the "Set as Swipe-up Card" button, the electronic device overlays and displays a swipe-up card, i.e., a display box, on the gallery application icon, and displays the selected picture in the user interface 41 within the swipe-up card. In response to a click operation on the area outside the swipe-up card, the electronic device closes the display of the swipe-up card. After that, in response to a swipe-up operation on the gallery application, the electronic device redisplay the swipe-up card.
[0149] In response to a click operation on the "Add to Negative Screen" button, the electronic device adds a display box to the negative screen and displays the selected picture in the user interface 41 within the display box.
[0150] In response to a click operation on the "Add to Desktop" button, the electronic device displays the user interface 42, which can also be understood as the main desktop interface. The difference between the user interface 42 and the user interface 40 is that a display box 420 is added in the user interface 42, and the display box 420 is used to display the picture selected by the user in the user interface 41 and display it.
[0151] In the user interface 42, in response to a click operation on the display box 420, the electronic device displays the user interface 43. The user interface 43 includes a display box 431 and a function box 430, which includes an "Edit" button, a "Service Card" button, and a "Remove" button. Among them:
[0152] In response to a click operation on the "Service Card" button, the electronic device can jump to an interface to display more service card types. The user can change the size of the display box 431 and can also change the picture displayed in the display box 431.
[0153] In response to a click operation on the "Remove" button, the electronic device deletes the display box 431 in the user interface 43.
[0154] In response to a click operation on the "Edit" button, the electronic device displays the user interface 44. The user interface 44 includes a selection box 440, and the selection box 440 includes an "Intelligent Selection" icon, a "Specify Album" icon, a "Specify Photo" icon, and their respective buttons. Among them:
[0155] In response to a click operation on the "Specify Album" button, the electronic device jumps to a page to display the details of the albums in the gallery. After the user selects one of the albums, the electronic device will sequentially display all the pictures in the selected album in the display box. Exemplarily, the time interval between sequentially displaying two pictures can be 5 seconds, 10 seconds, 15 seconds, etc.
[0156] In response to a click operation on the "Specified Picture" button, the electronic device jumps to a page and displays details of all pictures in the gallery. After the user selects one of the pictures, the electronic device will display the selected picture in the display box.
[0157] In response to a click operation on the "Intelligent Selection" button, the electronic device displays the selected pictures selected by the electronic device in the desktop display box.
[0158] In the embodiments of the present application, the selected pictures can be understood as the pictures selected by the electronic device according to the picture attributes. Exemplarily, the electronic device can use a computer vision algorithm to calculate the score value of each picture according to the above "evaluation dimensions of the picture", and then select the selected pictures according to the score value of each picture. For example, the electronic device can sort the pictures from high to low according to the score value, and use the pictures ranked in the top 20% or the top 15% as the selected pictures.
[0159] It can be understood that through Figure 4 the schematic diagram of the user interface shown, the electronic device can turn on the "Intelligent Selection" mode. Next, the scenario where the electronic device displays the selected pictures in the desktop display box after turning on the "Intelligent Selection" mode will be introduced. It should be understood that the following embodiments are introduced by taking adding a display box to the desktop as an example. Setting the display box to a swiping-up card or adding it to the negative first screen and other positions still applies the following display method. In addition, for the sake of vivid understanding, the display box added to the desktop will be referred to as the desktop card in the following introduction.
[0160] Scenario 1: The electronic device sequentially displays the selected pictures
[0161] Exemplarily, please refer to Figure 5 , Figure 5 which is a schematic diagram of a user interface provided by an embodiment of the present application for refreshing the selected pictures displayed in the desktop card while keeping the interface unchanged.
[0162] Exemplarily, after the electronic device turns on the "Intelligent Selection" mode, it selects the selected picture A, the selected picture B, and the selected picture C from the gallery according to the score value of each picture. Among them, the score value of the selected picture A is 248, the score value of the selected picture B is 355, and the score value of the selected picture C is 296. Therefore, the result of sorting from high to low according to the score value of the pictures is: the selected picture B, the selected picture C, and the selected picture A.
[0163] Thus, in response to a click operation on the "Intelligent Selection" button in the user interface 44, the electronic device turns on the "Intelligent Selection" mode and jumps to the user interface 50. As Figure 5As shown, the user interface 50 includes a desktop card 501, and a selected picture B is displayed in the desktop card 501. Exemplarily, the time when the electronic device starts to display the selected picture B is 08:08:20. After the electronic device continuously keeps the screen on in the user interface 50 for 10 seconds, that is, at 08:08:30, the electronic device automatically refreshes the selected picture in the desktop card 501 and displays the user interface 51.
[0164] The user interface 51 includes a desktop card 511, and a selected picture C is displayed in the desktop card 511. After the electronic device continuously keeps the screen on in the user interface 51 for 10 seconds, that is, at 08:08:40, the electronic device automatically refreshes the selected picture in the desktop card 511 and displays the user interface 52.
[0165] The user interface 52 includes a desktop card 521, and a selected picture A is displayed in the desktop card 521. After the electronic device continuously keeps the screen on in the user interface 52 for 10 seconds, that is, at 08:08:50, the electronic device automatically refreshes the selected picture in the desktop card 521 and displays the user interface 53.
[0166] The user interface 53 includes a desktop card 531. In the desktop card 531, the electronic device redisplay the selected picture B, that is, the electronic device will redisplay the selected picture B, the selected picture C, and the selected picture A in sequence. The subsequent display process is not described here.
[0167] It should be understood that the time interval for the electronic device to refresh the selected picture A, the selected picture B, and the selected picture C in the desktop card can also be other durations, such as 5 seconds, 15 seconds, 20 seconds, etc. The present application does not limit this.
[0168] In some embodiments, within the 10 - second time interval for the electronic device to refresh two selected pictures, the interface of the electronic device may be switched. In the above - mentioned case, the refresh method of the selected picture in the desktop card by the electronic device is as Figure 6 shown. Figure 6 It is a schematic diagram of a user interface provided by an embodiment of the present application for refreshing the selected picture displayed in the desktop card when the interface changes.
[0169] For ease of understanding, the above - mentioned selected picture A, selected picture B, and selected picture C are used as examples in this embodiment for illustration.
[0170] In response to a click operation on "Intelligent Selection" in the user interface 44, the electronic device enables the "Intelligent Selection" mode and jumps to the user interface 60. As Figure 6As shown, the user interface 60 includes a desktop card 601, and a selected picture B is displayed in the desktop card 601. Exemplarily, the time when the electronic device starts to display the selected picture B is 08:08:20. After the electronic device continuously keeps the screen on for 5 seconds in the user interface 60, that is, at 08:08:25, in response to a right-swipe operation on the blank area of the user interface 60, the electronic device enters the minus-one screen, that is, the electronic device displays the user interface 61.
[0171] One minute later, that is, at 08:09:25, in response to a left-swipe operation on the blank area of the user interface 61, the electronic device displays the user interface 62. It should be understood that as Figure 6 shown, when the electronic device jumps back to the user interface that displays the selected picture B, the desktop card still displays the selected picture B, that is, the display box 621 in the user interface 62 still displays the selected picture B.
[0172] For the selected picture B, since it has been displayed in the user interface 60 for 5 seconds, after the duration of continuously keeping the screen on in the user interface 62 reaches 5 seconds, that is, at 08:09:30, the electronic device automatically refreshes the selected picture in the desktop card 621 and displays the user interface 63. The user interface 63 includes a desktop card 631, and a selected picture C is displayed in the desktop card 631.
[0173] It should be understood that when the electronic device continuously keeps the screen on for 10 seconds in the user interface 63, the electronic device will refresh the selected picture in the desktop card 631 at 08:09:30 and display the selected picture A. For specific reference, please refer to Figure 5 the corresponding embodiment. When the electronic device continuously keeps the screen on for less than 10 seconds in the user interface 63 and switches to other interfaces, the refreshing method of the selected picture in the desktop card 631 by the electronic device is similar to the refreshing methods of the above user interfaces 60 - 62, and will not be elaborated here.
[0174] It can be understood that the pictures in the gallery are dynamically changing. For example, the user can take new pictures at any time, can also receive pictures sent by other electronic devices at any time, and can also delete pictures from the electronic device at any time, etc. Therefore, during the process of the electronic device sequentially displaying the selected pictures, the displayed selected pictures may change.
[0175] For ease of understanding, an example of a new picture added to the gallery is used for introduction. Exemplarily, please refer to Figure 7 , Figure 7 which is a schematic diagram of a display method after a new picture is added to the gallery during the process of sequentially displaying selected pictures in the desktop card provided by an embodiment of the present application.
[0176] As Figure 7As shown, exemplarily, the electronic device selects 10 selected pictures from the picture gallery. According to the scoring values of the pictures, the display order in the desktop card is successively Selected Picture 1 to Selected Picture 10, as Figure 7 shown in the "Selected Pictures" queue in. After adding pictures in the picture gallery, the electronic device re-selects the selected pictures from them according to the scoring values of the pictures. As Figure 7 shown, after re-selecting the selected pictures, New Added Picture A, New Added Picture B, New Added Picture C, New Added Picture D, and New Added Picture E are added. It can be understood that the above New Added Picture A, New Added Picture B, New Added Picture C, New Added Picture D, and New Added Picture E are the selected pictures re-selected by the electronic device. Here, they are called new added pictures in order to distinguish them from the previously selected Selected Picture 1 - Selected Picture 10.
[0177] After re-selecting the selected pictures, they are sorted from high to low according to the scoring values of the pictures as Figure 7 shown in the "New Added Pictures" queue in, successively as New Added Picture A, Selected Picture 1, Selected Picture 2, New Added Picture B, Selected Picture 3, New Added Picture C, Selected Picture 4, New Added Picture D, New Added Picture E, and Selected Picture 5, etc.
[0178] Exemplarily, during the process of the electronic device displaying Selected Picture 4, the electronic device re-determines the selected pictures, that is, the above "New Added Pictures" queue. After Selected Picture 4 is displayed, the electronic device starts to display the pictures in the "New Added Pictures" queue whose sorting is the same as that of the next picture of Selected Picture 4 in the "Selected Pictures".
[0179] As Figure 7 shown, the next picture of Selected Picture 4 in the "New Added Pictures" queue is Selected Picture 5, and Selected Picture 5 ranks 5th in the "New Added Pictures" queue. Then, when the electronic device displays the pictures in the "New Added Pictures" queue, it starts to display Selected Picture 3 which ranks 5th, and then successively displays New Added Picture C, Selected Picture 4, New Added Picture D, New Added Picture E, and Selected Picture 5, etc. after Selected Picture 3. After finishing displaying the pictures in the "New Added Pictures" queue from Selected Picture 3 in this round, in the next round of display, the electronic device starts to display the first picture in the "New Added Pictures" queue, that is, New Added Picture A.
[0180] In some other embodiments, in order to reduce duplicate display, the display manner of the re-selected selected pictures by the electronic device is as Figure 8 shown, Figure 8 which is a schematic diagram of another display manner after adding new pictures in the picture gallery during the process of successively displaying selected pictures in the desktop card provided by the embodiment of the present application.
[0181] For ease of understanding, this embodiment continues with Figure 7Take the selected pictures and newly added pictures in it as examples for illustration.
[0182] When the electronic device displays the selected picture 4, after re-selecting a picture in the "newly added pictures" queue as shown in Figure 8 as the new selected picture, after the electronic device finishes displaying the selected picture 4, it starts to display the pictures in the "newly added pictures" queue from the first picture in the "newly added pictures" queue, but skips the selected pictures in the "selected pictures" queue that are before the selected picture 4 and the selected picture 4. As shown in Figure 8 , the selected pictures in the "selected pictures" queue that are before the selected picture 4 are the selected picture 1, the selected picture 2, and the selected picture 3. Then the electronic device will filter out the already displayed selected picture 1, selected picture 2, selected picture 3, and selected picture 4 ( Figure 8 the dotted boxes in represent the pictures to be filtered).
[0183] Finally, as shown in Figure 8 , after the selected picture 4 is displayed, the electronic device sequentially displays the newly added picture A, newly added picture B, newly added picture C, newly added picture D, newly added picture E, and the selected picture 5, etc. in this round. When displaying in the next round, the electronic device starts to sequentially display each picture from the first picture in the "newly added pictures" queue. It should be understood that the pictures to be displayed in the next round will include the previously filtered selected picture 1, selected picture 2, etc.
[0184] Scenario 2: When there are recommended moment pictures, the electronic device adds moment pictures for display during the process of displaying selected pictures. First, introduce the moment pictures in the embodiments of the present application.
[0185] In the embodiments of the present application, the moment pictures can be understood as pictures selected from the picture library based on the same event. Exemplarily, please refer to Figure 9 , Figure 9 which is a schematic diagram of a type of moment picture provided by the embodiments of the present application. As shown in Figure 9 , the electronic device can take the pictures within one day or multiple days as the same event, and then select moment pictures from the pictures corresponding to the same event. In the embodiments of the present application, it can be called event-based moment pictures. Optionally, the electronic device can also select pictures from portrait pictures, or select pictures from a certain period (such as half a year, 60 years) to obtain moment pictures. In the embodiments of the present application, it can be called stage-based moment pictures.
[0186] Furthermore, the moment pictures in the embodiments of the present application can include today's moment pictures, today's moment pictures of previous years, and moment pictures of revisiting old places. Among them:
[0187] 1. Today's moment pictures
[0188] In the embodiments of the present application, the picture of the current day can be understood as a picture whose time difference between the creation time and the current time is less than or equal to the first time threshold, and the first time threshold can be 1 day, 2 days, 3 days, etc.
[0189] Exemplarily, the picture of the current day can be obtained in the following way. For example, the user took a number of pictures during outings on Saturday and Sunday. The electronic device can select some pictures from the multiple outing pictures as the pictures of the current day on the weekend (such as in the evening of the weekend), or the electronic device can also select some pictures from the multiple outing pictures as the pictures of the current day on the next Monday, and then push them to the user.
[0190] 2. Pictures of the same day in previous years
[0191] In the embodiments of the present application, the picture of the same day in previous years can be understood as a picture whose time difference between the creation time and the first time is less than or equal to the second time threshold, and the first time and the current time belong to the same day of different years, and the second time threshold can be 1 day, 2 days, 3 days, etc.
[0192] Exemplarily, the picture of the same day in previous years can be obtained in the following way. For example, today's date is December 10, 2021, and today is the user's birthday. Then, the photos taken by the user on past birthdays can all be understood as pictures of the same day in previous years. For example, the pictures taken by the user on December 10, 2020, and the pictures taken on December 10, 2018, etc.
[0193] Another example is that when today's date is October 1, 2021, that is, during the National Day holiday in 2021, the photos taken by the user during past National Day holidays can all be understood as pictures of the same day in previous years. It should be understood that when the user goes on an outing, they can play for multiple days at a time. Therefore, the photos taken during the National Day holiday can be understood as pictures generated in the same event, and the pictures taken on different dates can all be used as pictures of the same day in previous years. For example, the photos taken during the period from October 1 to October 3 in previous years can all be used as pictures of the same day in previous years on October 1, 2021.
[0194] 3. Pictures of the moment of revisiting the old place
[0195] In the embodiments of the present application, a picture taken at a revisit moment can be understood as a picture whose shooting location is the same as the current location of the electronic device but different from the permanent location of the electronic device. In the embodiments of the present application, the shooting location of a picture can be understood as the location where the electronic device takes the picture through the camera. For the permanent location of the electronic device, the permanent location can be automatically determined by the electronic device. For example, if the location of the electronic device has been at location A for 6 months, then the electronic device can consider its permanent location to be location A. The electronic device can also receive an operation instruction from the user and determine its permanent location according to the instruction.
[0196] When the electronic device determines its permanent location and the current location of the electronic device is a non-permanent location, pictures in the electronic device's storage whose location is the same as the current location of the electronic device can be understood as pictures taken at a revisit moment, as Figure 9 shown, the event type moments include non-permanent location moments.
[0197] Exemplarily, a picture taken at a revisit moment can be obtained in the following way. The electronic device determines that the permanent location is location A. When the current location of the electronic device is location B, the electronic device selects a picture taken at a revisit moment from the pictures whose shooting location is location B.
[0198] It should be understood that the electronic device can select moment pictures through a computer vision algorithm according to the above evaluation dimensions of the pictures. Similar to the selected pictures, it will not be elaborated here.
[0199] In the embodiments of the present application, when the same type of moment pictures correspond to different years, the most recent year is taken as the moment pictures of this type. For example, for a user who has a birthday on December 10, 2021, if there are pictures of the user's birthdays on December 10, 2020 and December 10, 2019 at the same time, then on December 10, 2021, the electronic device will recommend the picture of the user's birthday on December 10, 2020 as the picture of the same day of the previous year moment. It should be understood that other types of moment pictures can be inferred by analogy and will not be elaborated here.
[0200] Then, the process of adding moment pictures for display during the process of the electronic device displaying the selected pictures is introduced.
[0201] 1. The process of adding a certain type of moment pictures for display during the process of the electronic device displaying the selected pictures
[0202] It can be understood that during the process of the electronic device displaying the selected pictures, there may be recommended pictures of the current day moment, pictures of the same day of the previous year moment, or pictures taken at a revisit moment that need to be added to the selected pictures for display. Exemplarily, please refer to Figure 10 , Figure 10This is a schematic diagram provided by an embodiment of the present application for displaying moment pictures during the display of selected pictures. It should be understood that Figure 10 The moment pictures in
[0203] can be today's moment pictures, can also be moment pictures of the same day in previous years, or can be moment pictures of revisiting old places. In this embodiment, they are uniformly referred to as "moment pictures" for description. Figure 10 As Figure 10 shown, the electronic device selects 10 selected pictures, namely selected picture 1 to selected picture 10; and, they are sequentially displayed in the desktop card in the order of selected picture 1 to selected picture 10. When displaying selected picture 4, the electronic device detects that there are recommended moment pictures. As
[0204] shown, the electronic device detects 10 moment pictures. Figure 10 In this embodiment, after displaying selected picture 4, the electronic device will first display the moment pictures, and then continue to display the selected pictures after the moment pictures are displayed. As
[0205] shown, after the electronic device finishes displaying selected picture 4, it first sequentially displays moment picture 1 - moment picture 10, and then sequentially displays the remaining selected pictures 5 - selected picture 10. After finishing displaying the moment pictures and selected pictures in this round, the next round continues to sequentially display from the first picture of the selected pictures.
[0206] It can be understood that the order in which the electronic device displays the moment pictures can be the same as the order in which it displays the selected pictures, that is, they are displayed in descending order of the picture score value. In addition, the number of moment pictures can be set according to the actual situation, and can be 10, 15, 20, etc. The present application does not make any limitations in this regard.
[0207] 2. The display process of other types of moment pictures recommended during the display of a certain type of moment pictures by the electronic device
[0208] It can be understood that for the above 3 types of moment pictures, during the display of one type of moment pictures by the electronic device, other types of moment pictures may be recommended. For example, during the display of moment pictures of the same day in previous years, the electronic device may recommend moment pictures of revisiting old places; and for another example, during the display of moment pictures of revisiting old places, the electronic device may recommend today's moment pictures, etc.
[0209] In this embodiment, an example is given where, during the process of an electronic device displaying pictures of the same date in previous years, there are recommended pictures of moments for revisiting old places. Exemplarily, please refer to Figure 11 , Figure 11 which is a schematic diagram provided by an embodiment of the present application for adding pictures of moments for revisiting old places to be displayed during the process of displaying pictures of the same date in previous years.
[0210] As Figure 11 shown, the electronic device selects 10 selected pictures, namely selected picture 1 to selected picture 10; and, they are sequentially displayed in the desktop card in the order of selected picture 1 to selected picture 10. When displaying selected picture 4, the electronic device detects 10 recommended pictures of the same date in previous years. After that, the electronic device first sequentially displays pictures of the same date in previous years 1 - pictures of the same date in previous years 10. When displaying picture of the same date in previous years 2, the electronic device detects 10 recommended pictures of moments for revisiting old places. Then, after the electronic device finishes sequentially displaying the previously recommended pictures of the same date in previous years, it will sequentially display the recommended pictures of moments for revisiting old places.
[0211] Finally, as Figure 11 shown, the display order is selected picture 4, pictures of the same date in previous years 1 to pictures of the same date in previous years 10, pictures of moments for revisiting old places 1 to pictures of moments for revisiting old places 10, selected picture 5 to selected picture 10. It should be understood that after this round, in the next round, selected pictures 1 - selected picture 10 will be sequentially displayed.
[0212] It should be understood that the display method in other cases can be analogized in this way, and the electronic device will display the previously recommended moment pictures and then display other recommended moment pictures. For example, during the process of displaying pictures of moments for revisiting old places, if the electronic device recommends pictures of the current date, then the electronic device will display the pictures of moments for revisiting old places and then display the pictures of the current date.
[0213] In some embodiments, the electronic device sets the pictures of the current date as the highest priority, and once the pictures of the current date are pushed, they will be preferentially displayed. This embodiment takes the example where there are recommended pictures of the current date during the process of the electronic device displaying pictures of the same date in previous years. Exemplarily, please refer to Figure 12 , Figure 12 which is a schematic diagram provided by an embodiment of the present application for adding pictures of the current date to be displayed during the process of displaying pictures of the same date in previous years.
[0214] As Figure 12As shown, the electronic device selects 10 selected pictures, namely, selected picture 1 to selected picture 10; and, they are sequentially displayed in the desktop card in the order of selected picture 1 to selected picture 10. When displaying selected picture 4, the electronic device detects 10 recommended pictures of the same day of the previous year at this time. After that, the electronic device first sequentially displays pictures of the same day of the previous year 1 - pictures of the same day of the previous year 10. When displaying picture of the same day of the previous year 2, the electronic device detects 10 recommended pictures of the current time. Then, after the electronic device finishes displaying the pictures of the current time, it continues to display the pictures of the same day of the previous year and the selected pictures.
[0215] Finally, as Figure 12 shown, the final display order is selected picture 4, picture of the same day of the previous year 1, picture of the same day of the previous year 2, pictures of the current time 1 - pictures of the current time 10, pictures of the same day of the previous year 3 - pictures of the same day of the previous year 10, selected pictures 5 to selected pictures 10. It should be understood that after this round ends, the next round will sequentially display selected pictures 1 - selected picture 10.
[0216] It should be understood that the display method in other cases can be deduced by analogy and will not be elaborated here. For example, during the process of displaying pictures of revisiting old places at this time, if the electronic device recommends pictures of the current time, then after the electronic device finishes displaying the pictures of the current time, it continues to display the pictures of revisiting old places at this time that have not been displayed.
[0217] In some embodiments, in the case of simultaneously recommending pictures of the same day of the previous year and pictures of revisiting old places at this time, the electronic device first sequentially displays pictures of the same day of the previous year, and then sequentially displays pictures of revisiting old places at this time after the pictures of the same day of the previous year are displayed.
[0218] Thus, in the embodiments of the present application, the priority of displaying pictures from large to small is: pictures of the current time, pictures of the same day of the previous year, pictures of revisiting old places at this time, selected pictures.
[0219] Scenario 3: Display process after adding pictures of a moment
[0220] In the embodiments of the present application, before the electronic device recommends pictures of a moment in the desktop card, it has already displayed pictures of a moment in the gallery application, and the number of pictures of a moment displayed in the gallery application is greater than the number of pictures of a moment recommended in the desktop card. Exemplarily, please refer to Figure 13 , Figure 13 which is a schematic diagram of a user interface for adding pictures of a moment provided by the embodiments of the present application.
[0221] As Figure 13As shown, after the "Smart Selection" mode is turned on, the electronic device jumps to the desktop to display selected pictures. Exemplarily, at a certain moment, the electronic device displays the user interface 130, and the user interface 130 includes the desktop card 1301, and the desktop card 1301 displays the selected picture H. In response to a click operation on the gallery application, the electronic device enters the gallery application. Exemplarily, the electronic device displays the user interface 131. It can be understood that in response to a click operation on the gallery application, the gallery application can default to display the user interface corresponding to the "moment", or can display the interface corresponding to other tags. In the case where the electronic device displays the interface corresponding to other tags, in response to a click operation on the gallery application, the electronic device can display the user interface 131.
[0222] The user interface 131 includes moment pictures selected by the electronic device from the gallery pictures according to the requirements corresponding to various moment pictures. Exemplarily, today's date is October 2, 2021, and the electronic device selects the pictures of the same day in previous years from the gallery pictures, and previews one of the pictures of the same day in previous years in the display box 1311, and displays the name "National Day Memory" of the picture of the same day in previous years and the creation time "2020 / 10 / 2" of the picture in the picture in the display box 1311. It can be understood that the electronic device can also display other moment pictures, such as today's moment pictures, pictures of revisiting old places; or, the electronic device can also display historical moment pictures, such as the display boxes 1312 and 1313 in the user interface 131.
[0223] In response to a click operation inside the display box 1311, the electronic device displays the user interface 132. The user interface 132 can be understood as the details page of the picture of the same day in previous years. Exemplarily, in the area 1321, the electronic device sequentially displays each picture in the picture of the same day in previous years, and displays the name "National Day Memory", time information "2 / 0 / 2 / 0 October 2nd" in the area below the area 1321, and other pictures except the preview picture, such as picture P_A, picture P_B, picture P_C, etc. In the embodiment of the present application, the electronic device can select multiple pictures of the same day in previous years to be displayed through the user interface 132, such as 20, 25, etc.; then, select some pictures from them according to the score value of the pictures for recommendation on the desktop card, such as 10, 12, etc.
[0224] In the user interface 132, in response to a click operation on the "Add" button, the electronic device displays the user interface 133. All the pictures in the electronic device are default displayed in the user interface 133, such as Figure 13As shown, the electronic device displays pictures P1 - P12. In response to an upward or downward swipe operation on the user interface 133, the electronic device can display all pictures. In response to a click operation on the icon 1331, the electronic device displays the albums that have been created in the electronic device, allowing the user to select pictures according to the albums.
[0225] Exemplarily, in response to a click operation on pictures P8 and P9, the electronic device displays the user interface 134. The selection boxes on pictures P8 and P9 change from white to black, indicating that the electronic device has selected pictures P8 and P9 and previews pictures P8 and P9 in the area 1341.
[0226] On the user interface 134, in response to a click operation on the "Done" button, the electronic device adds pictures P8 and P9 to the pictures of the same day in previous years named "National Day Memories", that is, pictures P8 and P9 can be understood as newly added moment pictures.
[0227] It can be understood that the addition of new pictures to other types of moment pictures is Figure 13 similar in a corresponding manner, which will not be elaborated here.
[0228] In the embodiments of the present application, the display methods after adding moment pictures include the following situations:
[0229] Situation 1: After adding moment pictures, the electronic device only recommends moment pictures on the desktop card
[0230] Exemplarily, please refer to Figure 14 , Figure 14 which is a schematic diagram showing the display of moment pictures on the desktop card after adding moment pictures provided by the embodiments of the present application.
[0231] Exemplarily, before the user adds new moment picture 1 and new moment picture 2, the moment pictures selected by the electronic device in descending order of the picture score value are moment picture 1 - moment picture 10. After responding to the user operation to add new moment picture 1 and new moment picture 2, the electronic device filters out the two moment pictures with lower score values, that is, moment picture 9 and moment picture 10, and uses the remaining moment pictures 1 - moment picture 8 and the added new moment picture 1 and new moment picture 2 as the recommended moment pictures.
[0232] When displaying moment pictures on the desktop card, they are displayed in descending order of the picture score value. Exemplarily, the electronic device sequentially displays moment picture 1, moment picture 2, new moment picture 1, moment picture 3, moment picture 4, new moment picture 2, and moment pictures 5 - moment picture 8.
[0233] Case 2: During the process of the electronic device displaying moment pictures, new moment pictures are added for display
[0234] Exemplarily, please refer to Figure 15 , Figure 15 which is a schematic diagram of adding new moment pictures for display during the process of displaying moment pictures provided by an embodiment of the present application.
[0235] Exemplarily, the moment pictures selected by the electronic device in descending order of the picture score value are moment picture 1 - moment picture 10. When displaying moment picture 4, the electronic device adds new moment picture 1 and new moment picture 2 in response to a user operation. In the above case, after the electronic device finishes displaying moment picture 4, it preferentially displays new moment picture 1 and new moment picture 2, and then continues to display the remaining moment pictures 5 - moment picture 10.
[0236] Optionally, when the electronic device displays the remaining moment pictures 5 - moment picture 10, it can filter out the two moment pictures with the lowest score values, that is, after new moment picture 1 and new moment picture 2 are displayed, the electronic device sequentially displays the remaining moment pictures 5 - moment picture 8.
[0237] Optionally, when the electronic device displays new moment picture 1 and new moment picture 2, it can display them in descending order of the picture score value, or display them in the order of the user's clicks on the pictures. For example, if the user clicks on new moment picture 1 first, then new moment picture 1 is preferentially displayed, and then new moment picture 2 is displayed.
[0238] The above has exemplarily given the schematic diagram of the user interface of the embodiment of the present application. Next, the picture display method provided by the embodiment of the present application will be explained. Exemplarily, please refer to Figure 16 , Figure 16 which is a schematic flowchart of a picture display method provided by an embodiment of the present application. It should be understood that the picture display method provided by the embodiment of the present application is executed by an electronic device. As Figure 16 shown, the method includes:
[0239] 1601: In response to a first user operation, display a first display frame at a first position;
[0240] In the embodiment of the present application, this first user operation can be understood as an operation that triggers the electronic device to display this first display frame. For example, the user operations in the corresponding embodiments described above can all be understood as this first user operation. Figure 4
[0241] In the embodiments of the present application, the first position may be positions such as the desktop of the electronic device, the negative first screen, the lock screen interface, and the swiped-up card. The present application does not limit this. It should be understood that when the first position is the desktop, the embodiments of the present application do not limit the type of the desktop where the first display frame is displayed, which may be the main desktop or other desktops.
[0242] 1602: Determine at least one selected picture according to the first type of picture attributes, and sequentially display the at least one selected picture in the first display frame;
[0243] In this step, the electronic device selects at least one selected picture from the picture library according to the first type of picture attributes. Exemplarily, the electronic device may use a computer vision algorithm to evaluate the pictures in the picture library, calculate the score value of each picture, and then determine the at least one selected picture according to the high and low of the score value. Exemplarily, the electronic device may sort the pictures in descending order of the score value, and use the pictures ranked in the top first percentage as the at least one selected picture. It should be understood that the first percentage may be set according to the actual situation. For example, the first percentage may be 15%, 20%, 25%, etc. The present application does not limit this.
[0244] In the embodiments of the present application, the first type of picture attributes may be the attribute information of the picture itself, such as the pixel, clarity, whether there is noise in the picture, or the composition, color, and whether the content main body of the picture is complete, etc.; it may also be the adaptability of the picture to the electronic device, such as the clarity, color saturation of the picture displayed on the electronic device, or the integrity of the picture after being displayed in the first display frame, etc.
[0245] It can be understood that it takes a certain amount of time for the electronic device to calculate the scores of the pictures using the computer vision algorithm, generally when the electronic device is locked, or when the electronic device is locked and charging. Therefore, it is possible that when adding the first display frame, the electronic device has not determined the at least one selected picture through the computer vision algorithm. Therefore, in some embodiments, when the first display frame is displayed at the first position and the at least one selected picture has not been determined according to the first type of picture attributes, the electronic device uses the pictures in any photo album as the at least one selected picture.
[0246] Through the above method, the user experience can be improved, so that the user can normally display pictures after adding the first display frame, and avoid the situation of displaying a blank display frame without pictures. Exemplarily, the electronic device may use the pictures in the existing "Camera" photo album, or "Pet" photo album, or "Illustration" photo album as the at least one selected picture.
[0247] It should be understood that in the embodiments of the present application, even if the electronic device initially displays the pictures in any album as the at least one selected picture in the first display frame, the electronic device is still in the "intelligent selection" mode. After the electronic device completes the evaluation of the pictures through computer vision algorithms, it will normally display at least one selected picture determined according to the first type of picture attributes.
[0248] In the embodiments of the present application, the electronic device sequentially displays pictures (including the above-mentioned selected pictures and the moment pictures hereinafter). It can be understood that the electronic device starts from the first moment and displays one picture within the first time length; at the second moment when the one picture is displayed, it jumps and displays another picture within the second time length. The embodiments of the present application do not limit the way of sequentially displaying pictures. In one possible implementation, pictures can be sequentially displayed at intervals of a time threshold. For example, in the corresponding embodiment of the above-mentioned selected pictures Figure 5 The refresh method. It should be understood that the above-mentioned time threshold can be set to 5 seconds, 10 seconds, 15 seconds, etc. according to the actual situation, or can be customized by receiving user operations.
[0249] In another possible implementation, the time interval for the electronic device to refresh pictures can be determined according to the frequency of the played music. The higher the frequency of the played music, the faster the pictures are refreshed, that is, the smaller the time interval for refreshing pictures.
[0250] 1603: During the process of sequentially displaying the at least one selected picture, if at least one moment picture determined according to the second type of picture attributes is detected, then jump to display the at least one moment picture;
[0251] In the embodiments of the present application, the second type of picture attributes can be understood as the time information of the picture, the shooting location information, etc. As described in the previous embodiments, the moment pictures include today's moment pictures, today's moment pictures of previous years, and moment pictures of revisiting old places. Among them, today's moment pictures can be understood as pictures whose time difference between the creation time and the current time is less than or equal to the first time threshold, and the first time threshold can be 1 day, 2 days, 3 days, etc. Today's moment pictures of previous years can be understood as pictures whose time difference between the creation time and the first moment is less than or equal to the second time threshold, and the first moment and the current time belong to the same day of different years, and the second time threshold can be 1 day, 2 days, 3 days, etc. Moment pictures of revisiting old places can be understood as pictures whose shooting location is the same as the current location of the electronic device and different from the resident location of the electronic device. The introduction of each type of moment picture can refer to the relevant Figure 9 Descriptions, which will not be repeated here.
[0252] It should be understood that the embodiments of the present application do not limit the triggering manner for the electronic device to determine the moment pictures from the pictures in the picture library. For the pictures of the current moment today and the pictures of the same moment in previous years, the electronic device can periodically screen the pictures in the picture library according to the second type of picture attributes. For example, it can be screened once every 8 hours. The electronic device can screen the pictures in the picture library according to the second type of picture attributes at a fixed time every day, such as early in the morning every day. The electronic device can also screen the pictures in the picture library according to the second type of picture attributes when it detects that the electronic device is in the screen-off and charging state.
[0253] It should be understood that since the pictures of revisiting the old place are related to the shooting location of the pictures, the electronic device can be triggered to screen out the pictures of revisiting the old place from the pictures in the picture library in the following ways:
[0254] Method 1: When the current location of the electronic device is different from the resident location, trigger the electronic device to screen the pictures in the picture library whose shooting location is the same as the current location, and further determine the pictures of revisiting the old place. For example, the resident location of the electronic device is location A. When the location of the electronic device changes and the current location is location B, the electronic device determines the pictures whose shooting location is location B from the stored pictures, and then selects some of them as the pictures of the moment of revisiting the old place. Exemplarily, the electronic device can use computer vision algorithms to determine the pictures of the moment of revisiting the old place.
[0255] Method 2: When taking pictures with the electronic device and the shooting location of the pictures is different from the resident location, trigger the electronic device to screen the pictures in the picture library whose shooting location is the same as the current location, and further determine the pictures of revisiting the old place. For example, the electronic device takes a picture, the shooting location of the picture is location B, and the resident location of the electronic device is location A. The electronic device determines the pictures whose shooting location is location B from the stored pictures, and then selects some of them as the pictures of the moment of revisiting the old place. Exemplarily, the electronic device can use computer vision algorithms to determine the pictures of the moment of revisiting the old place.
[0256] It should be understood that triggering the electronic device to screen the pictures of the moment of revisiting the old place by Method 2 is considered because the picture library application may not have the permission to obtain the location information of the electronic device in real time. Then, the trigger condition can be that the user actively wakes up the camera application to take pictures.
[0257] It should be understood that in this step, during the process of sequentially displaying the at least one selected picture, when any one of the above-mentioned moment pictures is detected, the display jumps to the moment pictures of this type.
[0258] 1604: After the at least one moment picture is displayed, continue to sequentially display the at least one selected picture from the next picture of the picture that has been jumped from the at least one selected picture.
[0259] For the above steps 1603 and 1604, the relevant explanations for jumping to display the at least one moment picture and sequentially displaying the at least one selected picture starting from the picture next to the picture jumped from the at least one selected picture can refer to the relevant descriptions in the previous embodiments of Figure 10 which will not be elaborated here.
[0260] In the embodiments of the present application, when there are multiple groups of the same type of moment pictures, the electronic device displays the group closest to the current time. For example, on December 22, 2021, there are moment pictures of the same day last year in 2020 and moment pictures of the same day last year in 2018 at the same time. Then, the moment picture of the same day last year on December 22, 2021 is the moment picture of the same day last year in 2020, and other situations can be inferred by analogy.
[0261] It should be understood that in the embodiments of the present application, during the process of sequentially displaying pictures by the electronic device, the duration is accumulated when the screen corresponding to the first position remains on. For specific details, reference can be made to the relevant descriptions in the previous embodiments of Figure 6 which will not be elaborated here. Therefore, the duration for which the screen corresponding to the first position remains on by the electronic device may not be sufficient to display all the moment pictures. In the embodiments of the present application, after jumping to display at least one moment picture, the display of at least one moment picture stops at the second moment; the time difference between the second moment and the moment when jumping to display at least one moment picture is less than or equal to the second time threshold. Exemplarily, the second time threshold can be 3 hours, 4 hours, 5 hours, 1 day, etc. Taking 3 hours as an example, starting from the time when the moment pictures start to be displayed, the electronic device sequentially displays the moment pictures within 3 hours, and the moment pictures that are not displayed will no longer be displayed. For another example, by setting the second time threshold, the second moment can be set to the early morning of the current day, that is, when moment pictures are recommended for display, but not all moment pictures are displayed by the current early morning, then the remaining moment pictures that are not displayed will no longer be displayed.
[0262] Since the moment pictures include current day moment pictures, moment pictures of the same day last year, and moment pictures of revisiting old places, and the electronic device determines the moment pictures according to the respective rules of each type of moment picture, it is possible to detect that there are other types of moment pictures that need to be displayed during the display of a certain type of moment picture; or, at least two types of moment pictures may be determined simultaneously. In the embodiments of the present application, the priority for displaying pictures from high to low is: current day moment pictures, moment pictures of the same day last year, moment pictures of revisiting old places, selected pictures.
[0263] In some embodiments, when the electronic device detects the picture of the same day of the previous year during the process of displaying the picture of the moment of revisiting the old place, it will display the picture of the same day of the previous year after finishing displaying the picture of the moment of revisiting the old place.
[0264] In some embodiments, when the electronic device detects the picture of the moment of revisiting the old place during the process of displaying the picture of the same day of the previous year, it will display the picture of the moment of revisiting the old place after finishing displaying the picture of the same day of the previous year.
[0265] In some embodiments, when the electronic device detects the picture of the current moment during the process of displaying the picture of the moment of revisiting the old place, it will jump to display the picture of the current moment and continue to display the remaining pictures of the moment of revisiting the old place after the picture of the current moment is displayed.
[0266] In some embodiments, when the electronic device detects the picture of the current moment during the process of displaying the picture of the same day of the previous year, it will jump to display the picture of the current moment and continue to display the remaining pictures of the same day of the previous year after the picture of the current moment is displayed.
[0267] In some embodiments, when recommending the pictures of the same day of the previous year and the pictures of the moment of revisiting the old place at the same time, the electronic device will first display the pictures of the same day of the previous year in sequence and then display the pictures of the moment of revisiting the old place in sequence after the pictures of the same day of the previous year are displayed.
[0268] For each of the above situations, reference can be made to the relevant descriptions of Figure 11 , Figure 12 in the previous embodiments, which will not be elaborated here.
[0269] In addition, in the embodiments of the present application, in response to the second user operation, the electronic device can add pictures to the at least one moment picture. For the display method after adding the moment pictures, specific reference can be made to the description of Figures 13 - 15 in the previous embodiments, which will not be elaborated here.
[0270] In some embodiments, the order of sequentially displaying the at least one selected picture is determined according to the score value of each picture, and the score value is obtained by the electronic device using a computer vision algorithm based on the first type of picture attributes.
[0271] It should be understood that as described in step 1602 above, the electronic device calculates the score value of each picture using a computer vision algorithm according to the evaluation dimension of the picture. Exemplarily, the electronic device can display the at least one selected picture in sequence in descending order of the score value; it can also display the at least one selected picture in sequence in ascending order of the score value.
[0272] In some embodiments, when all of the at least one selected picture is from the same album, the display order of the at least one selected picture is the same as the arrangement order of each selected picture in the album.
[0273] It should be understood that when the first display frame is displayed at the first position and the at least one selected picture cannot be determined according to the first type of picture attribute, if the electronic device uses the pictures in any album as the at least one selected picture, then it will be the case that all of the at least one selected picture is from the same album. Or, the at least one selected picture determined by the electronic device through the computer vision algorithm just comes from the same album.
[0274] In some embodiments, the order of sequentially displaying the at least one selected picture is determined according to the creation time of each picture. Exemplarily, the electronic device can sequentially display the at least one selected picture in descending order of the creation time of the pictures, that is, the pictures closer to the present are displayed first. Since recent memories are clearer than previous memories, it is convenient for users to recall recent events in a timely manner.
[0275] In the embodiments of the present application, the understanding of earlier and later for multiple times is as follows: the closer to the present, the later; the farther from the present, the earlier. For example, if the current time is December 10, 2021, for the times of August 10, 2021 and December 15, 2020, August 10, 2021 is later than December 15, 2020, and the sorting from later to earlier is August 10, 2021, December 15, 2020. It should be understood that the rest of the times can be analogized and will not be elaborated hereinafter; it should also be understood that the above compares the times of year, month and day, and the hour, minute and second can also be added for comparison according to the actual situation, and the comparison method is similar to the above, which will not be elaborated here.
[0276] Exemplarily, the electronic device can sequentially display the at least one selected picture in ascending order of the creation time of the pictures, that is, the pictures with a longer time interval from the present are displayed first. It can be understood that the memories associated with the pictures with a longer time interval from the present are more blurred. Through the above method, the long-term memories of the user can be timely evoked to relive the good times.
[0277] In some embodiments, the similarity between any two selected pictures is less than or equal to the first similarity, so as to reduce the repeated display of similar pictures and improve the user experience.
[0278] It should be understood that in this embodiment, the first similarity can be determined according to the actual situation, and different values can be adaptively selected as the first similarity when different criteria are used to measure the similarity. The present application does not make any limitation in this regard.
[0279] It can be understood that the similarity (which can also be referred to as the matching degree) between two pictures can be determined in various ways. Exemplarily, in one possible implementation, it can be determined by histogram matching of the two pictures. For example, for image A and image B, the electronic device can calculate the histograms of the two images respectively, and then calculate the normalized correlation coefficient of the two histograms. The larger the correlation coefficient, the more similar the two pictures are. Among them, the normalized correlation coefficient can be the Bhattacharyya distance, the histogram intersection distance, etc.
[0280] In another possible implementation, it can be determined by matrix decomposition of the pictures. It can be understood that an image itself is a matrix, and mathematical matrix decomposition can be relied on to obtain the robust features representing the matrix element values and distributions in the matrix to calculate the similarity of the images. For example, the electronic device can perform matrix decomposition on the pictures using non-negative matrix factorization (NMF), singular value decomposition (SVD), etc., and then determine the similarity.
[0281] Optionally, in yet another possible implementation, if the time interval between the creation times of any two pictures is less than a time threshold, the above two pictures can be considered similar pictures. For example, during the process of a user using a camera to take pictures, continuously pressing the shutter quickly multiple times may result in a very small time interval between the creation times of the taken pictures. In the above case, it can be considered that the user is taking pictures of the same scene and the taken pictures are similar.
[0282] It should be understood that in this embodiment, the above time threshold can be determined according to the actual situation and can be 1 second, 1.5 seconds, 2 seconds, etc. The present application does not limit this.
[0283] The above introduces the picture display method provided by the embodiments of the present application. Next, the electronic device involved in the embodiments of the present application will be introduced.
[0284] Please refer to Figure 17 , Figure 17 which is a schematic structural diagram of an electronic device 100 provided by the embodiments of the present application.
[0285] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0286] In some embodiments, the internal memory 121 may be used to store pictures.
[0287] Understandably, the structure illustrated in the embodiments of this application does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than those illustrated, or combine certain components, or split certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0288] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.
[0289] Among them, the controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching and executing instructions.
[0290] A memory can also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can save the instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can directly call it from the said memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0291] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0292] The I2C interface is a two-way synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple groups of I2C buses. The processor 110 can be respectively coupled to the touch sensor 180K, charger, flashlight, camera 193, etc. through different I2C bus interfaces. For example: the processor 110 can be coupled to the touch sensor 180K through the I2C interface, enabling the processor 110 to communicate with the touch sensor 180K through the I2C bus interface to implement the touch function of the electronic device 100.
[0293] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple groups of I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to implement the function of answering a call through a Bluetooth headset.
[0294] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to implement the function of answering a call through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0295] The UART interface is a general-purpose serial data bus for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 110 and the wireless communication module 160. For example: The processor 110 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to implement the function of playing music through a Bluetooth headset.
[0296] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the electronic device 100.
[0297] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0298] The USB interface 130 is an interface that conforms to the USB standard specification. Specifically, it can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transfer data between the electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices, etc.
[0299] Understandably, the interface connection relationships shown in the embodiments of the present application are only illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0300] The charging management module 140 is used to receive a charging input from a charger. Among them, the charger can be a wireless charger or a wired charger. In some embodiments of wired charging, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130. In some embodiments of wireless charging, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device through the power management module 141.
[0301] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives the inputs from the battery 142 and / or the charging management module 140 and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as the battery capacity, the number of battery cycles, and the battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.
[0302] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor, etc.
[0303] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example: The antenna 1 can be multiplexed as the diversity antenna of the wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0304] The mobile communication module 150 may provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 may receive electromagnetic waves through the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves through the antenna 1 for radiation. In some embodiments, at least some functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be disposed in the same device.
[0305] The modulation and demodulation processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. Subsequently, the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, receiver 170B, etc.), or displays a picture or video through the display screen 194. In some embodiments, the modulation and demodulation processor may be an independent device. In other embodiments, the modulation and demodulation processor may be independent of the processor 110 and disposed in the same device as the mobile communication module 150 or other functional modules.
[0306] The wireless communication module 160 may provide solutions for wireless communications applied to the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite systems (GNSSs), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering processing on the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 may also receive signals to be sent from the processor 110, perform frequency modulation and amplification on them, and convert them into electromagnetic waves through the antenna 2 for radiation.
[0307] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with a network and other devices via wireless communication technologies. The wireless communication technologies may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).
[0308] Electronic device 100 implements a display function through a GPU, display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, connected to display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.
[0309] The display screen 194 is used to display pictures, videos, etc. The display screen 194 includes a display panel. The display panel can adopt a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.
[0310] In some embodiments, the display screen 194 can display pictures.
[0311] The electronic device 100 can implement the acquisition function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor, etc., to implement the image acquisition module in the HAL layer of the embodiments of the present application.
[0312] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light passes through the lens and is transmitted to the camera photosensitive element. The optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into a visible picture or video. The ISP can also perform algorithm optimization on the noise, brightness, and skin color of the picture. The ISP can also optimize parameters such as the exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0313] The camera 193 is used to capture static pictures or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital picture or video signal. The ISP outputs the digital picture or video signal to the DSP for processing. The DSP converts the digital picture or video signal into a standard RGB, YUV, etc. format of picture or video signal. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0314] The digital signal processor is used to process digital signals. In addition to being able to process digital pictures or video signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.
[0315] The video codec is used to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple coding formats, such as: Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0316] The NPU is a neural-network (NN) computing processor. By learning from the structure of biological neural networks, such as learning from the transmission mode between human brain neurons, it can quickly process the input information and can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as: image recognition, face recognition, speech recognition, text understanding, etc.
[0317] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to achieve the data storage function. For example, files such as music and videos are saved in the external memory card.
[0318] The internal memory 121 can be used to store computer-executable program code, and the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the picture or video playback function, etc.). The data storage area can store the data created during the use of the electronic device 100 (such as audio data, phone book, etc.). In addition, the internal memory 121 can include high-speed random access memory and can also include non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0319] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor, etc. For example, music playback, recording, etc.
[0320] The audio module 170 is used to convert digital audio information into an analog audio signal for output, and is also used to convert an analog audio input into a digital audio signal. In some embodiments, the audio module 170 may be disposed in the processor 110, or some functional modules of the audio module 170 may be disposed in the processor 110.
[0321] The speaker 170A, also known as the "loudspeaker", is used to convert an audio electrical signal into a sound signal.
[0322] The receiver 170B, also known as the "earpiece", is used to convert an audio electrical signal into a sound signal. When the electronic device 100 answers a call or a voice message, the voice can be listened to by bringing the receiver 170B close to the human ear.
[0323] The microphone 170C, also known as the "microphone" or "transmitter", is used to convert a sound signal into an electrical signal. When making a call or sending a voice message, the user can speak by bringing the mouth close to the microphone 170C to input the sound signal into the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In some other embodiments, the electronic device 100 may be provided with two microphones 170C, which can not only collect sound signals but also implement a noise reduction function. In some other embodiments, the electronic device 100 may also be provided with three, four or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and implement a directional recording function, etc.
[0324] The headphone jack 170D is used to connect a wired headphone. The headphone jack 170D may be a USB interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0325] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor may include at least two parallel plates having conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, the instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.
[0326] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake during shooting. Exemplarily, when the shutter is pressed, the gyroscope sensor 180B detects the angle of jitter of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and enables the lens to offset the jitter of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenarios.
[0327] The barometric pressure sensor 180C is used to measure barometric pressure. In some embodiments, the electronic device 100 calculates the altitude according to the barometric pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.
[0328] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D. Furthermore, according to the detected opening and closing state of the leather case or the opening and closing state of the flip, features such as automatic flip unlocking are set.
[0329] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.
[0330] A distance sensor 180F is used to measure distance. The electronic device 100 can measure distance through infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.
[0331] The proximity light sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The light-emitting diode may be an infrared light-emitting diode. The electronic device 100 emits infrared light outward through the light-emitting diode. The electronic device 100 uses the photodiode to detect the infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect when the user holds the electronic device 100 close to the ear for a call, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used for automatic unlocking and locking of the holster mode and pocket mode.
[0332] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in the pocket to prevent accidental touch.
[0333] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to achieve fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc.
[0334] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In some other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by low temperature. In some other embodiments, when the temperature is lower than yet another threshold, the electronic device 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.
[0335] The touch sensor 180K, also known as the "touch panel". The touch sensor 180K can be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also known as the "touch screen". The touch sensor 180K is used to detect touch operations acting thereon or nearby. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In some other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, at a different position from where the display screen 194 is located.
[0336] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals of the vibrating bone mass of the human vocal part. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure pulsation signals. In some embodiments, the bone conduction sensor 180M can also be disposed in the earphone to form a bone conduction earphone. The audio module 170 can parse out voice signals based on the vibration signals of the vibrating bone mass of the vocal part acquired by the bone conduction sensor 180M to implement the voice function. The application processor can parse out heart rate information based on the blood pressure pulsation signals acquired by the bone conduction sensor 180M to implement the heart rate detection function.
[0337] The button 190 includes a power-on button, volume buttons, etc. The button 190 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive button inputs and generate key signal inputs related to the user settings and function control of the electronic device 100.
[0338] The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playing, etc.) can correspond to different vibration feedback effects. Touch operations acting on different regions of the display screen 194, the motor 191 can also correspond to different vibration feedback effects. Different application scenarios (such as: time reminder, receiving information, alarm clock, game, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0339] The indicator 192 can be an indicator light and can be used to indicate the charging state, power change, and can also be used to indicate messages, missed calls, notifications, etc.
[0340] The SIM card interface 195 is used to connect to a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact with and separation from the electronic device 100. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0341] In some embodiments, the processor 110 can call computer instructions stored in the internal memory 121 to obtain multiple pictures from the internal memory 121 or through the external memory interface 120; then determine selected pictures from the multiple pictures according to the first type of picture attributes; or determine moment pictures from the multiple pictures according to the second type of picture attributes.
[0342] The processor 110 can call computer instructions stored in the internal memory 121 to determine the creation time of the selected pictures or the moment pictures, and display the selected pictures or the moment pictures on the display screen 194 according to the sequence of the creation time.
[0343] The processor 110 can call computer instructions stored in the internal memory 121 to determine the score value of the selected pictures or the moment pictures, and display the selected pictures or the moment pictures on the display screen 194 according to the level of the score value.
[0344] The software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. In the embodiments of this application, the Android system with a layered architecture is taken as an example to exemplarily illustrate the software structure of the electronic device 100.
[0345] Please refer to Figure 18 , Figure 18 which is a software structure block diagram of an electronic device 100 provided by the embodiments of this application.
[0346] The layered architecture divides software into several layers, and each layer has clear roles and divisions of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0347] The application layer may include a series of application packages.
[0348] As Figure 18 shown, the application packages may include applications such as the camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.
[0349] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications in the application layer. The application framework layer includes some predefined functions.
[0350] As Figure 18 shown, the application framework layer may include the window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0351] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0352] The content provider is used to store and obtain data, and make this data accessible to applications. The data may include videos, images, audio, dialed and answered calls, browsing history and bookmarks, phone book, etc.
[0353] The view system includes visible controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a short message notification icon may include a view for displaying text and a view for displaying pictures.
[0354] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of call states (including connection, disconnection, etc.).
[0355] The resource manager provides various resources for applications, such as localized strings, icons, pictures, layout files, video files, etc.
[0356] The notification manager enables an application to display notification information in the status bar. It can be used to convey messages of the notification type, and can automatically disappear after a short stay without user interaction. For example, the notification manager is used to inform that a download is completed, a message reminder, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or a scroll bar text, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialogue window. For example, it prompts text information in the status bar, emits a prompt tone, the electronic device vibrates, the indicator light flashes, etc.
[0357] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for the scheduling and management of the Android system.
[0358] The core libraries consist of two parts: one part is the functional functions that the Java language needs to call, and the other part is the core libraries of Android.
[0359] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as the management of object life cycles, stack management, thread management, security and exception management, and garbage collection.
[0360] The system libraries can include multiple functional modules. For example: surface manager, Media Libraries, 3D graphics processing library (such as: OpenGL ES), 2D graphics engine (such as: SGL), etc.
[0361] The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
[0362] The media libraries support the playback and recording of a variety of common audio and video formats, as well as static image files, etc. The media libraries can support a variety of audio and video coding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0363] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.
[0364] The 2D graphics engine is a drawing engine for 2D drawing.
[0365] The kernel layer is the layer between the hardware and the software. The kernel layer includes at least a display driver, a camera driver, an audio driver, and a sensor driver.
[0366] In some embodiments, the sensor driver is used to generate an event in response to a user operation to trigger the camera application in the application layer to take a picture.
[0367] In some embodiments, the sensor driver is used to generate an event in response to a user operation to trigger the window manager in the application framework layer to determine a display frame for displaying a picture according to the user operation.
[0368] In the embodiments of the present application, the application framework layer may further include a picture display module. The sensor driver is used to generate an event in response to a user operation to trigger the picture display module to obtain multiple pictures, and determine a selected picture that meets the first type of picture attributes, or a moment picture that meets the second type of picture attributes from the multiple pictures;
[0369] The picture display module is further used to determine the creation time of the selected picture or the creation time of the moment picture, and sort the selected pictures or the selected pictures according to the creation time of the pictures.
[0370] The picture display module is further used to determine the score value of the selected picture or the score value of the moment picture, and sort the selected pictures or the selected pictures according to the score value of the pictures.
[0371] The sensor driver is further used to generate an event in response to a user operation to trigger the picture display module to determine the pictures added by the user to at least one selected picture or at least one moment picture.
[0372] In some embodiments, the picture display module can trigger a two-dimensional graphics engine or a three-dimensional graphics processing library to render the picture, and trigger the display driver in the kernel layer to display the picture.
[0373] It can be understood that in some embodiments, the picture display module may also be in other levels of the hierarchical architecture, such as the application layer, etc., which is not limited here.
[0374] As used in the above embodiments, depending on the context, the term "when..." can be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...". Similarly, depending on the context, the phrase "when determining..." or "if detecting (the stated condition or event)" can be interpreted to mean "if determining..." or "in response to determining..." or "when detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)".
[0375] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present application are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center by wire (such as coaxial cable, optical fiber, digital subscriber line) or wirelessly (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more integrated available media. The available medium may be a magnetic medium (such as a floppy disk, hard disk, magnetic tape), an optical medium (such as a DVD), or a semiconductor medium (such as a solid-state drive), etc.
[0376] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware with a computer program. The program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above method embodiments. The foregoing storage medium includes various media that can store program codes, such as ROM or random access memory RAM, magnetic disks, or optical discs.
Claims
1. A method for displaying pictures, characterized in that, The method includes: In response to a first operation, a first card is displayed on the desktop of the electronic device; a first picture is displayed within the first card, and the first picture is one picture among a first type of pictures, and the first type of pictures is pictures determined from the album of the electronic device according to first type of picture attributes; When it is detected that there are recommended second type of pictures, in response to the recommendation, after the first picture is displayed, the second type of pictures and the category identifier of the second type of pictures are displayed in the first card; wherein, the second type of pictures is pictures determined from the album of the electronic device according to second type of picture attributes; After the last picture among the second type of pictures is displayed, the pictures after the first picture among the first type of pictures are continued to be displayed.
2. The method according to claim 1, characterized in that The first type of picture attributes includes any one or more of the following: pixel of the picture, clarity of the picture, color saturation of the picture, composition of the picture, recognition degree of the picture subject, recognition degree of the category of the picture subject; the second type of picture attributes includes time information and / or location information of the picture.
3. The method according to claim 1 or 2, characterized in that, Before it is detected that there are recommended second type of pictures, the method further includes: Determining the second type of pictures according to the second type of picture attributes; the second type of pictures includes any one of a first subclass of pictures that meet a first condition, a second subclass of pictures that meet a second condition, and a third subclass of pictures that meet a third condition; the first condition is that the time difference between the creation time of the picture and the current time is less than or equal to a first threshold; the second condition is that the time difference between the creation time of the picture and a first time is less than or equal to a second threshold, and the first time and the current time belong to the same day of different years; the third condition is that the shooting location of the picture is the same as the current location of the electronic device.
4. The method according to claim 3, characterized in that, In the case where the second type of pictures is the second subclass of pictures, before the last picture among the second type of pictures is displayed, the method further includes: When the second picture among the second subclass of pictures is displayed and it is detected that there are recommended first subclass of pictures, in response to the recommendation, after the second picture is displayed, the first subclass of pictures and the category identifier of the first subclass of pictures are displayed in the first card; After the last picture among the first subclass of pictures is displayed, the pictures after the second picture among the second subclass of pictures and the category identifier of the pictures are continued to be displayed; The "after the last picture among the second type of pictures is displayed, the pictures after the first picture among the first type of pictures are continued to be displayed" includes: After the last picture among the second subclass of pictures is displayed, the pictures after the first picture among the first type of pictures are continued to be displayed.
5. The method according to claim 3, wherein In the case where the second type of pictures is the third subclass of pictures, before the last picture among the second type of pictures is displayed, the method further includes: When the second picture among the third subclass of pictures is displayed and it is detected that there are recommended first subclass of pictures, in response to the recommendation, after the second picture is displayed, the first subclass of pictures and the category identifier of the first subclass of pictures are displayed in the first card; After displaying the last picture in the first subclass of pictures, continue to display the pictures after the second picture in the third subclass of pictures and the category identifier of the pictures; After displaying the last picture in the second category of pictures, continue to display the pictures after the first picture in the first category of pictures, including: After displaying the last picture in the third subclass of pictures, continue to display the pictures after the first picture in the first category of pictures.
6. The method according to claim 3, characterized in that When the second category of pictures is the second subclass of pictures, before displaying the last picture in the second category of pictures, the method further includes: When detecting the recommended third subclass of pictures while displaying the second picture in the second subclass of pictures, after displaying the last picture in the second subclass of pictures, display the third subclass of pictures and the category identifier of the pictures in the first card; After displaying the last picture in the second category of pictures, continue to display the pictures after the first picture in the first category of pictures, including: After displaying the last picture in the third subclass of pictures, continue to display the pictures after the first picture in the first category of pictures.
7. The method according to claim 3, wherein When the second category of pictures is the third subclass of pictures, before displaying the last picture in the second category of pictures, the method further includes: When detecting the recommended second subclass of pictures while displaying the second picture in the third subclass of pictures, after displaying the last picture in the third subclass of pictures, display the second subclass of pictures and the category identifier of the pictures in the first card; After displaying the last picture in the second category of pictures, continue to display the pictures after the first picture in the first category of pictures, including: After displaying the last picture in the second subclass of pictures, continue to display the pictures after the first picture in the first category of pictures.
8. The method according to claim 4 or 5, characterized in that When detecting the recommended second category of pictures, in response to the recommendation, after displaying the first picture, display the second category of pictures and the category identifier of the second category of pictures in the first card, including: When simultaneously detecting the recommended second subclass of pictures and the third subclass of pictures, in response to the recommendation, display the second subclass of pictures and the category identifier of the pictures in the first card, and after displaying the last picture in the second subclass of pictures, display the third subclass of pictures and the category identifier of the pictures.
9. The method according to claim 1, characterized in that, Displaying the second category of pictures and the category identifier of the second category of pictures in the first card includes: When displaying the second picture in the second category of pictures, in response to the second operation, determine the new pictures added to the second category of pictures; After displaying the second picture, display the new pictures and the category identifier of the pictures in the first card; After displaying the new pictures, continue to display the pictures after the second picture in the second category of pictures.
10. The method according to claim 3, wherein After determining the second type of pictures according to the attributes of the second type of pictures and before detecting that there are recommended second type of pictures, the method further includes: In response to a second operation, determining new pictures to be added to the second type of pictures; Redetermining the second type of pictures according to the new pictures and the attributes of the second type of pictures; the second type of pictures includes the new pictures.
11. The method according to claim 1, characterized in that, After displaying the first picture, the method further includes: Detecting the changed first type of pictures and determining the display position of the next picture of the first picture among the first type of pictures; Displaying the picture located at the display position in the changed first type of pictures.
12. The method according to claim 1, wherein After displaying the first picture, the method further includes: Detecting the changed first type of pictures and determining the pictures that have been displayed, where the pictures that have been displayed are the pictures among the first type of pictures whose display positions are before the first picture; Using, among the changed first type of pictures, the pictures other than the pictures that have been displayed as the pictures after the first picture among the first type of pictures for display.
13. The method according to any one of claims 1 to 10, characterized in that, The similarity between any two pictures among the first type of pictures or any two pictures among the second type of pictures is less than or equal to a first similarity.
14. An electronic device, characterized in that, The electronic device includes: one or more processors and a memory; the memory is coupled to the one or more processors, and the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to cause the electronic device and the display to cooperate to execute the method according to any one of claims 1-13.
15. A chip, characterized in that, The chip is applied to an electronic device, the chip includes one or more processors, and the processors are used to call computer instructions to cause the electronic device and the display to cooperate to execute the method according to any one of claims 1-13.
16. A computer program product comprising instructions, characterized in that, When the computer program product runs on an electronic device, it causes the electronic device and the display to cooperate to execute the method according to any one of claims 1-13.
17. A computer-readable storage medium, comprising instructions, characterized in that, When the instructions run on an electronic device, it causes the electronic device to cooperate with the display to execute the method according to any one of claims 1-13.
Citation Information
Patent Citations
Photograph display method and system
CN106599067A
Interest point image recommendation method and device
CN110209916A