Display method and related device

Abstract

The invention provides a display method and a related device, which are applied to electronic equipment, and the method comprises the following steps: responding to a condition that a screen of the electronic equipment is a folding screen and the folding screen is in a semi-folding state, displaying wallpaper on the folding screen, the wallpaper comprising first display content or second display content, the first display content is the display content corresponding to the current time of the electronic equipment, the second display content comprises a first object or a second object, the first object corresponds to a pre-acquired first face image, the second object corresponds to a pre-acquired second face image, and the first face image and the second face image express different emotions. Under the condition that the electronic equipment enters the standby mode, the wallpaper is still displayed on the folding screen. Visibly, the electronic equipment can display the corresponding content based on the current time or the emotion which can be obtained by the face image, and display is kept even in a standby state in the semi-folding state, so that the purpose of improving the display function is achieved.

Description

Technical Field

[0001] The present application relates to the field of electronic information technology, and in particular to a display method and related devices. Background Art

[0002] With the development of electronic information technology, the forms of electronic devices are becoming more and more diverse. Electronic devices with foldable screens are a common type of device.

[0003] How to improve the display function of electronic devices based on folding screens is a problem that needs to be solved at present. Summary of the invention

[0004] The present application provides a display method and related devices to improve the display function of an electronic device. The disclosed technical solutions are as follows:

[0005] In the first aspect, the present application provides a display method, which is applied to an electronic device, including: in response to the screen of the electronic device being a folding screen, and the folding screen being in a semi-folded state, a wallpaper is displayed on the folding screen, the wallpaper includes a first display content or a second display content, the first display content is the display content corresponding to the current time of the electronic device, the second display content includes a first object or a second object, the first object corresponds to a pre-acquired first face image, the second object corresponds to a pre-acquired second face image, the first face image and the second face image express different emotions, and when the electronic device enters standby mode, the wallpaper is still displayed on the folding screen. It can be seen that the electronic device can display corresponding content based on the current time or the emotion that can be obtained from the face image, and keep displaying even in standby in the semi-folded state, thereby achieving the purpose of improving the display function.

[0006] In some implementations, the wallpaper acquisition process includes: in response to the current time matching the pre-configured time information, using the first display content corresponding to the time information as the wallpaper. An example of the time information is information representing a holiday, birthday, or anniversary. Using the first display content corresponding to the real-time information as the wallpaper, for displaying relevant content on a special date or holiday set by the user, etc., to further improve the display function and provide a better user experience.

[0007] In some implementations, the wallpaper acquisition process further includes: in response to the current time not matching the time information, using the second display content corresponding to the pre-acquired mood information as the wallpaper, the mood information is acquired based on the sensor information and / or the information acquired by the preset application, and the sensor information and the information acquired by the preset application include the first face image or the second face image. Acquiring the mood information based on the face image and displaying the content corresponding to the mood information is conducive to providing display content that is more in line with the user's emotions, further improving the display function, and providing a better user experience.

[0008] In some implementations, the wallpaper further includes a third display content, which is different from the first display content and the second display content, and the wallpaper acquisition process further includes: in response to the electronic device not being within a preset first fence (such as a portrait fence), using the third display content as the wallpaper. The first fence can be pre-set, which is conducive to shielding scenes that are not suitable for displaying display content corresponding to time information such as holidays and birthdays or mood information, improving the flexibility of display, and further improving the display function.

[0009] In some implementations, using the third display content as wallpaper includes: the electronic device uses the display content corresponding to the second fence as wallpaper within a preset second fence (such as a city fence). An example of the second fence is a city or region fence, which can be preset to facilitate displaying content related to the city or region, further improving the display function.

[0010] In some implementations, it also includes: in response to the folding screen being in a folded state or an unfolded state, displaying wallpaper on the folding screen, and turning off the folding screen when the electronic device enters a standby mode to save resources.

[0011] In some implementations, the first object or the second object has the function of displaying an interactive effect in response to a touch operation, so as to further obtain a better user experience.

[0012] In some implementations, it also includes: when the folding screen displays the wallpaper, playing the sound effects corresponding to the wallpaper to further obtain a better user experience.

[0013] In some implementations, the method further includes: in response to the screen of the electronic device being a non-folding screen, displaying wallpaper on the screen, and turning off the screen when the electronic device enters a standby mode to save resources.

[0014] The second aspect of the present application provides an electronic device, including: one or more processors, a memory and a touch screen, the memory is used to store program code; the processor is used to run the program code, so that the electronic device implements the display method provided by the first aspect of the present application.

[0015] The third aspect of the present application provides a computer-readable storage medium having instructions stored thereon. When the instructions are executed on an electronic device, the electronic device executes the display method provided in the first aspect of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 is a flow chart of a display method provided by an embodiment of the present application;

[0018] Figure 2 These are example diagrams of three unfolding forms of the folding screen;

[0019] Figure 3 This is an example diagram of a display effect of the display method provided in an embodiment of the present application;

[0020] Figure 4 This is another example diagram of the display effect of the display method provided in the embodiment of the present application;

[0021] Figure 5 This is another example diagram of the display effect of the display method provided in the embodiment of the present application;

[0022] Figure 6 This is another example diagram of the display effect of the display method provided in the embodiment of the present application;

[0023] Figure 7 is a structural example diagram of an electronic device provided in an embodiment of the present application;

[0024] Figure 8 This is an example diagram of a software framework running in an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The terms "first", "second", "third", etc. in the specification, claims and drawings of this application are used to distinguish different objects rather than to limit a specific order.

[0026] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0027] Displaying wallpaper is an important display function of electronic devices. In some implementations, users select wallpaper and can also set display parameters such as wallpaper change time or frequency. The electronic device displays the wallpaper based on the display parameters configured by the user and the pre-selected ratio.

[0028] The display method of this type of wallpaper is relatively simple and not smart enough, so there is still room for improvement in the display function of wallpaper.

[0029] In order to improve the display function of wallpaper of an electronic device and obtain a better user experience, an embodiment of the present application provides a display method. The display method is applied to an electronic device with a folding screen, and can also be applied to an electronic device with a non-folding screen.

[0030] In the embodiments of the present application, the improvement of the display function is mainly reflected in two aspects: first, the display content is selected based on the user's portrait information, so that the display content is more suitable for the user. Second, the display of the display content is combined with the folding screen product form to provide a more novel wallpaper display mode.

[0031] Figure 1 The display method disclosed in the embodiment of the present application comprises the following steps:

[0032] S11. Obtaining portrait information and location information.

[0033] The portrait information includes at least one of time information and mood information.

[0034] The time information represents some time pre-configured by the user, such as the anniversary of joining the company, birthday, and holidays.

[0035] In some implementations, time information is obtained based on an application running in an electronic device. The application provides the user with the function of entering time. That is, the user enters time information such as anniversaries, birthdays, and holidays based on the application. In other implementations, the electronic device obtains time information based on information stored in the electronic device, and the time information includes but is not limited to: wedding anniversaries, employment anniversaries, holidays in the location of the electronic device, birthdays of parents or children, and birthdays of friends. For example, a wedding anniversary is obtained based on a schedule stored in the notepad of the electronic device, and another example is obtained based on a calendar application (Application, APP).

[0036] Mood information can be understood as information that represents the user's subjective feelings such as mood and emotions. Mood information can also be called emotional information, etc.

[0037] In some implementations, mood information is obtained based on an application running in an electronic device. The application provides the user with the function of entering facial images and / or mood tags. That is, the user enters the user's facial image based on the application, and can also enter the mood tag corresponding to the facial image. For example, a user enters a smiley face image in the Most Beautiful Smile APP, or a user enters a smiley face image and the corresponding mood tag "happy" in the Most Beautiful Smile APP, and the electronic device obtains the user's mood information based on the information of the application, for example. The electronic device uses the facial image and / or mood tag obtained based on the application running in the electronic device as mood information, or processes the facial image and / or mood tag obtained by the application and uses the processing result as a mood tag.

[0038] In other implementations, the electronic device obtains mood information based on data collected by various sensors, including but not limited to at least one of the following: an image sensor, a sound sensor, and an acceleration sensor.

[0039] Image sensors, such as cameras, collect facial images of users in certain scenarios, such as face unlocking. It is understandable that facial images collected under different emotions are different, that is, the emotions expressed by facial images are different, so mood (also called emotion) information can be obtained based on the facial images obtained during the face unlocking process.

[0040] In order to make the acquired mood information closer to the user's actual mood, in addition to the image sensor, the basis for acquiring mood information can also include data collected by other sensors. Sound sensors such as microphones collect sound information such as the voice of the phone owner recognized and collected through AI. Acceleration sensors collect acceleration information of electronic devices.

[0041] In some implementations, the electronic device processes the data collected by the sensor to obtain mood information.

[0042] Some examples of processing the data collected by sensors include, but are not limited to:

[0043] 1. Obtain facial emotion scores by recognizing facial images.

[0044] 2. By analyzing the owner's voice, the sound analysis result is laughter or crying, and combined with the decibel of the sound, the voice emotion score is obtained.

[0045] 3. By analyzing the acceleration information, the action type is identified. An example of an action type is clapping the table with a large degree of floating. The action emotion score is obtained based on the action type.

[0046] Based on at least one of the scores obtained in steps 1, 2, and 3, the mood information is obtained.

[0047] It is understandable that the mood information can be obtained based on data collected by the application or the sensor alone, or based on data collected by the application and the sensor. An example of mood information is a mood score, for example, a mood score of 80 points indicates that the user is in a good mood.

[0048] The location information of the electronic device represents the current location of the electronic device. In some implementations, the location information of the electronic device is obtained through a location sensor configured on the electronic device.

[0049] S12: Determine whether the current time matches the time information. If yes, execute S13; if no, execute S14.

[0050] One implementation of matching the current time with the time information is that the current time is the time indicated by the time information, for example, the time information indicates that it is New Year's Day, and today's date recorded in the electronic device is New Year's Day. One implementation of matching the current time with the time information is that the interval between the current time and the time indicated by the time information meets a preset duration, for example, the time information indicates the anniversary of joining the job, and the current time is the day before the anniversary of joining the job, which meets the preset duration of 24 hours.

[0051] If the current time matches the time information, then in order to highlight the time indicated by the time information, the content related to the time information is displayed first, that is, S13 is executed. If the current time does not match the time information, then the relevant content based on the user's mood information is displayed first, that is, S14 is executed.

[0052] It is understandable that it is possible that the portrait information does not include time information, and the execution result of S12 is no, that is, the current time does not match the time information.

[0053] S13: Determine that the display information is the display content corresponding to the time information (referred to as the first display content for short).

[0054] The display information can be understood as information used to display wallpaper. The display information is the display content corresponding to the time information, that is, the wallpaper is the display content corresponding to the time information.

[0055] The content corresponding to the time information can be understood as the pre-configured display content corresponding to the time information, for example, the display content corresponding to New Year's Day is as follows: Figure 3 shown.

[0056] After S13, S15 is executed.

[0057] S14: Determine that the display information is the display content corresponding to the mood information (referred to as the second display content for short).

[0058] That is, the wallpaper is determined to be the display content corresponding to the mood information.

[0059] In some implementations, if the mood information indicates that the user is in a good mood, the displayed content is determined to be a digital person. Figure 4 For example, the digital human can produce interactive display effects in response to the user's touch. For example, when the user looks at the digital human on the screen, the digital human's eyeballs move along with the user's eyeballs.

[0060] In other implementations, if the mood information indicates that the user is in a bad mood, the displayed content is determined to be a cute pet. Figure 5 For example, a cute pet can produce an interactive display effect in response to the user's touch. For example, when the user clicks on the cute pet, the cute pet displays the effect of being patted on the head. The cute pet can also have a soothing effect on the user.

[0061] It can be understood that the content corresponding to the time information and the content corresponding to the mood information are collectively referred to as the display content corresponding to the portrait information.

[0062] After S13, S15 is also executed.

[0063] S15. Based on the location information of the electronic device and the pre-set portrait fence information, determine whether the electronic device is within the fence range indicated by the portrait fence information.

[0064] The location information of the electronic device represents the current location of the electronic device. The image fence information represents the location range, and in some implementations, it is pre-configured by the user. For example, the image fence information is a fence including the user's residence.

[0065] If it is determined that the electronic device is within the fence range indicated by the portrait fence information, execute S17; if it is determined that the electronic device is not within the fence range indicated by the portrait fence information, execute S16.

[0066] S16: Determine that the displayed information is a wallpaper that is unrelated to the portrait information.

[0067] The pre-configured wallpaper is different from the display content corresponding to the portrait information. In the case where the display content corresponding to the portrait information is the display content corresponding to the time information, the pre-configured wallpaper is a wallpaper different from the display content corresponding to the time information, that is, the display content corresponding to the time information such as an anniversary is not displayed. In the case where the display content corresponding to the portrait information is the display content corresponding to the mood information, the pre-configured wallpaper is a wallpaper different from the display content corresponding to the mood information, that is, the display content corresponding to the mood information is not displayed.

[0068] The purpose of S15-S16 is to set a fence for displaying corresponding content based on the portrait information. If the electronic device is within the fence, the display content corresponding to the portrait information is displayed. If the electronic device is not within the fence, the display content corresponding to the portrait information is not displayed. As mentioned above, the display content corresponding to the portrait information is the display content corresponding to special times such as anniversaries or the user's mood, which is relatively private or personalized display content. Therefore, in some scenarios such as business meetings, users may not want to display it. Therefore, S15-S16 can make the display content closer to the user's needs, and provide users with the possibility of shielding the display content corresponding to the portrait information in certain scenarios.

[0069] In some implementations, wallpapers unrelated to portrait information are pre-configured by the user in the electronic device, and different fence information can correspond to different wallpapers. For example, the display fence of the cute pet corresponding to a bad mood is the fence where the user's address is located. If the electronic device is not in the fence, it means that the user is not at home, but is more likely to be in the office. In this case, the wallpaper corresponding to the fence that is unrelated to a bad mood is a clock to fit the office scene. For another example, the display fence of the company logo corresponding to the anniversary of joining the company is the office. If the electronic device is not in the fence, it means that the user is not in the office but is more likely to be at home. In this case, the wallpaper corresponding to the fence that is unrelated to the anniversary of joining the company is a digital person or cute pet corresponding to the mood information.

[0070] In some other implementations, the user sets the wallpaper based on the application. For example, the user selects at least one wallpaper based on the wallpaper APP, and the electronic device uses the wallpaper set by the user based on the application as the wallpaper unrelated to the portrait information. It is understandable that the application is used to set the displayed wallpaper based on the setting rules. The setting rules include but are not limited to: wallpapers corresponding to different times, such as every day.

[0071] In some other implementations, the wallpaper that is not related to the portrait information is the display content corresponding to the city fence, and the city fence defines the city or region where the electronic device is located. The user can set the resident city or region, the tourist city, or the business trip city or region as the city fence in advance. In this case, if the electronic device is not in the portrait fence, it is determined whether the electronic device is in the city fence. If so, the display content corresponding to the city fence is displayed. The display content corresponding to the city fence includes but is not limited to: city-related cards or wallpapers, such as city travel information cards, or city scenery wallpapers, etc.

[0072] It is understandable that S15-S16 are optional steps and may not be performed.

[0073] S17. Determine whether the screen of the electronic device is a foldable screen. If yes, execute S18; if no, execute S20.

[0074] Because the application scenario of the process provided in this embodiment is a folding screen, the judgment result is yes. The purpose of this step is to enable the method provided in this embodiment to be applicable to electronic devices with non-folding screens, so that electronic devices with non-folding screens also have the function of displaying content corresponding to the portrait information.

[0075] S18. Determine whether the folding screen is in a semi-folded state. If yes, execute S19; if not, execute S20.

[0076] Based on the relative position of the two folding areas, the folding screen can be divided into: Figure 2 The forms shown are respectively a folded state, a semi-folded state (also called a semi-unfolded state) and an unfolded state. Among them, the folded state means that the two areas of the folding screen are completely overlapped, that is, the angle between the two areas of the folding screen is 0 degrees, and the unfolded state means that the two areas of the folding screen are in the same plane, that is, the angle between the two areas of the folding screen is 180 degrees. The semi-folded state means that the angle between the two areas of the folding screen is between 0 degrees and 180 degrees (excluding 0 degrees and 180 degrees). The relative position of the screen and keyboard is similar to that of a book unfolded or a notebook opened. That is, the two areas of the folding screen

[0077] It can be understood that the folding screen can be folded inward (the display screen is folded into the inside of the electronic device) or outward (the display screen surrounds the electronic device), so the semi-folded state can be presented inward or outward folding. Figure 2 The book state shown, Figure 3 and Figure 4 The figures shown are all in the semi-folded state (also called micro-notebook state) when folded inwards. Figure 5 Shown is a semi-folded state in an outward folded condition.

[0078] In some implementations, whether the folding screen is in a semi-folded state is determined based on an angle between two regions of the screen of the electronic device where the folding occurs. For example, if the angle between the two regions where the screen is folded occurs within a preset range, then the folding screen is determined to be in a semi-folded state.

[0079] The folding screen in the semi-folded state lays the foundation for some special display effects. For example, for the display content of greeting cards corresponding to festivals, the micro notebook state can lay the foundation for the three-dimensional display of greeting cards. Therefore, if the judgment result of S18 is yes, execute S19.

[0080] S19: maintaining the display mode, displaying the content corresponding to the portrait information or the wallpaper unrelated to the portrait information.

[0081] The hold display mode is a mode in which, when the electronic device is in standby mode, the display content corresponding to the portrait information or the wallpaper unrelated to the portrait information is still displayed.

[0082] It is understandable that after the electronic device enters the standby mode, in order to save power, the electronic device usually turns off the screen. In this step, in order to more fully display the display content corresponding to the portrait information, or to increase the fun of standby in the semi-folded state, after the electronic device enters the standby mode, the screen is turned off (which can be understood as the backlight is turned off) while still displaying the display content corresponding to the portrait information or wallpaper unrelated to the portrait information.

[0083] In some implementations, based on S13 and S15, it is determined that the display information is the display content corresponding to the time information, and based on the electronic device being in a semi-folded state, the display mode is maintained to display the display content corresponding to the time information. Figure 3 For example, if the display content corresponding to the time information is a greeting card corresponding to New Year's Day, the display mode is maintained to display the greeting card. In order to obtain a better user experience, patterns and texts are displayed in the two relatively folded areas of the folding screen, and a three-dimensional stereoscopic image is presented based on the semi-folded state of the folding screen ( Figure 3 In the standby mode of the mobile phone, the greeting card corresponding to the New Year's Day is still displayed to render a more intense atmosphere of the specific time.

[0084] In some other implementations, based on S14 and S15, it is determined that the display information is the display content corresponding to the mood information. Figure 4 For example, if the display content corresponding to the mood information is a digital person corresponding to a good mood, the display mode is maintained and the digital person is displayed. Figure 5 For example, if the display content corresponding to the mood information is a cute pet corresponding to a bad mood, the cute pet will be displayed in the maintained display mode.

[0085] As mentioned above, the digital person or cute pet also has an interactive effect of following the touch. In the standby mode of the mobile phone, the digital person or cute pet is still displayed to obtain a better user experience.

[0086] In some other implementations, if it is determined based on S15 and S16 that the display information is a wallpaper such as a clock that is unrelated to the portrait information, the clock is displayed in the maintained display mode to provide a more novel display method in the semi-folded state.

[0087] It is understandable that the electronic device may not be in standby mode when executing S19. In this case, maintaining the display mode means displaying the content corresponding to the portrait information or the wallpaper unrelated to the portrait information. Assuming that the electronic device is not in standby mode but in a certain desktop display state, and based on the above steps, it is determined that the wallpaper is a greeting card corresponding to New Year's Day, then Figure 6 For example, the wallpaper of the desktop of the electronic device is displayed as a greeting card corresponding to New Year's Day. It is possible that icons of application programs placed on the desktop are also displayed on the wallpaper of the currently displayed desktop.

[0088] exist Figure 6 In the state of the electronic device shown, the user may be able to click on the application icon on the desktop to run an application. During the running of the application, the interface displayed by the application is overlaid on the New Year's greeting card displayed on the desktop. When the electronic device is not in standby mode, it is possible that the electronic device switches to standby mode. In this case, the wallpaper corresponding to New Year's Day is still displayed on the folding screen, such as Figure 3 As shown, the wallpaper corresponding to New Year's Day is kept displayed.

[0089] Understandably, Figure 3-Figure 5 In the example shown, in order to save power, the screen backlight is turned off in standby mode, that is, the display content corresponding to the portrait information is displayed in an off-screen display mode. That is, the maintained display mode in standby mode can be regarded as a way of off-screen display.

[0090] In other implementations, the backlight is not turned off, that is, the electronic device displays the display content corresponding to the portrait information in a normal display mode, such as Figure 6 For example, other functions are in standby mode.

[0091] S20: Display content corresponding to the portrait information or wallpaper unrelated to the portrait information.

[0092] In this step, because the folding screen of the electronic device is not in a semi-folded state or the screen of the electronic device is not a folding screen, in order to save power, the display mode is no longer maintained.

[0093] In some implementations, during the execution of S19 or S20, a sound effect corresponding to the displayed content is played, for example, the displayed content corresponding to a festival displays a pre-configured music clip that matches the festival.

[0094] The display method provided in this embodiment obtains display information based on the portrait information, so that corresponding content is displayed at a specific time, or content matching the user's mood is displayed. In addition, in order to highlight the display content corresponding to the portrait information, when the screen of the electronic device is in a semi-folded state, the display content corresponding to the portrait information is maintained, thereby obtaining a better user experience.

[0095] Furthermore, whether to display content corresponding to the portrait information can be controlled based on the fence, thereby achieving more flexible display control.

[0096] The electronic devices applied in the embodiments of the present application include but are not limited to mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs) or dedicated cameras (such as SLR cameras, card cameras), etc. The present application does not impose any restrictions on the specific types of the electronic devices.

[0097] Figure 7 The structure of the electronic device is exemplarily shown.

[0098] The electronic device 100 may include a processor 110 , an internal memory 120 , a display screen 130 , and a sensor 140 .

[0099] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0100] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an AO gesture detection unit, etc. Among them, different processing units may be independent devices or integrated into one or more processors.

[0101] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0102] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0103] The electronic device 100 implements the display function through a GPU, a display screen 130, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 130 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0104] The display screen 130 is used to display images, videos, etc.

[0105] The sensor 140 includes an image sensor, a sound sensor, an acceleration sensor, a position sensor, a proximity light sensor, an ambient light sensor, and the like.

[0106] The internal memory 120 may be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 120 and / or the instructions stored in the memory provided in the processor.

[0107] In an embodiment of the present application, the processor 110 in the electronic device 100 can obtain display information based on data collected by the sensor, and send the display information to the GPU. The GPU renders the display information to achieve the purpose of displaying the display on the screen.

[0108] In some implementations, a software framework runs on the processor to Figure 8 For example, the software framework includes: an application layer, an application framework layer, a system library, a hardware abstraction layer (HAL), and other layers under the HAL.

[0109] The application layer runs applications such as expression entry (also known as the most beautiful smile), call, and camera, etc. Expression entry is used to receive images such as photos input by users, and can also receive mood tags corresponding to the images input by users.

[0110] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 8 As shown, the application framework layer runs face recognition and belongs to the intelligent perception service ( Figure 8 Some services (not shown) and a display control module.

[0111] Face recognition is used to identify faces in images.

[0112] Intelligent perception service is used to perceive the characteristics of human face and voice, such as Figure 8 As shown, some services belonging to the intelligent perception service include but are not limited to: mouth corner curvature perception, smile detection, eye curvature perception and sound perception. Mouth corner curvature perception is used to obtain the curvature angle data of the mouth corner from a face. Smile detection is used to obtain the smile detection result from a face. Eye curvature perception is used to obtain the curvature angle data of the eye from a face. Sound perception is used to extract sound features.

[0113] The display control module is used to implement the function of obtaining display information described in the embodiments of the present application.

[0114] The system library can include multiple functional modules. Figure 8 As shown, the functional modules include a display module, an angle calculation module, a surface manager, a three-dimensional graphics processing library (eg, OpenGL ES), a two-dimensional graphics engine (eg, SGL), and the like.

[0115] HAL provides interface services with hardware devices, such as Figure 8 As shown, the interface services with the hardware device include: Sound Service, Always-on (AO) Service, and Camera HAL. AO Service is used to implement the screen display function of the electronic device in standby mode (which can be understood as off screen).

[0116] Other layers below the HAL, such as the smart sensor hub and / or the kernel layer, are used to run some drivers. The drivers include at least the camera driver, AO driver, sound sensor driver, accelerometer driver, position sensor driver, proximity light sensor driver, and ambient light sensor driver.

[0117] based on Figure 8 The display method implemented by the software framework shown includes:

[0118] Based on the expression entry APP, the user enters some pre-configured time, such as the anniversary of joining the company, birthday, and holidays, as well as the face image. The entered face image may have a mood tag entered together, or it may only enter the face image. The expression entry APP can also extract the mood tag from the face image. The expression entry APP sends the face image and mood tag to the display control module.

[0119] Sensors such as image sensors, sound sensors, and accelerometers collect data. The corresponding driver of the sensor transmits the data collected by the sensor to the corresponding module in the upper layer. For example, the sound sensor driver transmits sound data to the sound service, the camera sensor transmits image data to the camera HAL, and the accelerometer transmits acceleration data to the display control module.

[0120] The module in HAL that receives the data transmitted by the driver transmits the received data and / or the processing results of the received data to the corresponding module in the application framework layer. For example, the sound service transmits sound data and / or the processing results of sound data to the sound perception. The camera HAL transmits image data to the face recognition, mouth corner curvature perception, smile detection, and eye curvature perception.

[0121] The face recognition in the application framework layer identifies the face from the image, and calls the mouth corner curvature perception, smile detection, and eye curvature perception to further obtain the face recognition result (including the emotion recognition result). The display control module responds to the trigger instruction, such as the trigger instruction issued periodically, or the trigger instruction transmitted by the expression recording APP, and obtains the mood information based on the face recognition result, the sound information transmitted by the sound service, etc. As mentioned above, the display control module can also obtain time information from the expression recording APP, and obtain position information from the position sensor driver. Based on this, the display control module obtains the portrait information, which can be specifically seen in S11, and obtains the display information based on the steps shown in S12-S16.

[0122] The display module obtains display information from the display control module, obtains the angle result by calling the angle calculation module, and determines whether the folding screen is in a semi-folded state based on the angle result.

[0123] The display module maintains the display mode based on the judgment result that the folding screen of the electronic device is in a semi-folded state, and displays the display content corresponding to the portrait information or the wallpaper unrelated to the portrait information. In some implementations, the display module calls the corresponding chip by calling the three-dimensional image processing library, the two-dimensional graphics engine, the AO Service, and the AO driver, etc., to realize the rendering and display of the display content corresponding to the portrait information or the wallpaper unrelated to the portrait information.

Claims

1. A display method, characterized in that: Applied in an electronic device, the method comprises: In response to the screen of the electronic device being a folding screen, and the folding screen being in a semi-folded state, the wallpaper displayed on the folding screen includes first display content or second display content, the first display content is display content corresponding to the current time of the electronic device, the second display content includes a first object or a second object, the first object corresponds to a pre-acquired first face image, the second object corresponds to a pre-acquired second face image, and the first face image and the second face image express different emotions; When the electronic device enters the standby mode, the wallpaper is still displayed on the folding screen.

2. The method according to claim 1, characterized in that The wallpaper acquisition process includes: In response to the current time matching the pre-configured time information, the first display content corresponding to the time information is used as the wallpaper.

3. The method according to claim 2, characterized in that The wallpaper acquisition process also includes: In response to the current time not matching the time information, the second display content corresponding to the pre-acquired mood information is used as the wallpaper, the mood information is acquired based on sensor information and / or information acquired by a preset application, and the sensor information and the information acquired by the preset application include the first facial image or the second facial image.

4. The method according to claim 2 or 3, characterized in that: The wallpaper further includes a third display content, and the third display content is different from the first display content and the second display content; The wallpaper acquisition process also includes: In response to the electronic device being not within a preset first fence, the third display content is used as the wallpaper.

5. The method according to claim 4, characterized in that The using the third display content as the wallpaper includes: The electronic device uses the display content corresponding to the second preset fence as the wallpaper within the second preset fence.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: In response to the folding screen being in a folded state or an unfolded state, the wallpaper is displayed on the folding screen, and when the electronic device enters a standby mode, the folding screen is turned off.

7. The method according to any one of claims 1 to 6, characterized in that: The first object or the second object has a function of displaying an interactive effect in response to a touch operation.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: While the folding screen displays the wallpaper, a sound effect corresponding to the wallpaper is played.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: In response to the screen of the electronic device being a non-folding screen, the wallpaper is displayed on the screen, and when the electronic device enters a standby mode, the screen is turned off.

10. An electronic device, characterized in that: The electronic device comprises: one or more processors, a memory and a touch screen; the memory is used to store program code; the processor is used to run the program code, so that the electronic device implements the display method according to any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that: Instructions are stored thereon, and when the instructions are executed on an electronic device, the electronic device executes the display method as claimed in any one of claims 1 to 9.

Images