Display method and related equipment

Abstract

The invention discloses a display method and related equipment, which are applied to electronic equipment, a folding screen and a camera, and the folding screen can be folded along a folding edge to form a first screen and a second screen; the method comprises the steps that the folding screen in a first form displays a first user interface; receiving a first operation acting on the system camera control; in response to the first operation, starting the system camera; detecting whether the folding screen is switched to a second form or not; if yes, the first screen of the folding screen in the second form displays a second user interface, and the second screen displays a third user interface; receiving a second operation acting on the first target makeup control; and in response to the second operation, updating the facial makeup image of the first user displayed in the first preview display area based on makeup effect parameters corresponding to the first target makeup control. By adopting the embodiment of the invention, the immersive makeup experience of the user in the virtual makeup process can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of terminal devices, and in particular to a display method and related devices. Background Art

[0002] With the continuous development of the functions of foldable mobile phones, the beauty and makeup needs of more and more core female users in the stand-state scenario have received widespread attention. By using the foldable device as a virtual makeup box, the user's makeup and beauty pictures are displayed in real time, allowing users to adjust their makeup in time according to their preferences, so that they can easily experience the fun of beauty in a virtual environment. Furthermore, in the process of users using virtual makeup boxes for beauty, how to provide users with a new interactive service with a more ritual sense, so as to enhance the user's immersive beauty experience in the virtual makeup process, is the direction of our efforts. Summary of the invention

[0003] The embodiments of the present application disclose a display method and related equipment, which can provide a new interactive service with a greater sense of ritual, so as to further enhance the user's immersive beauty experience during the virtual makeup process.

[0004] In order to achieve the above technical objectives, the embodiments of the present application provide the following technical solutions:

[0005] In a first aspect, the present application provides a display method, characterized in that it is applied to an electronic device, the electronic device comprising a folding screen and a camera, the folding screen being foldable along a folding edge to form a first screen and a second screen; the method comprising: the folding screen in a first form displays a first user interface; the first user interface comprises a system camera control, the first form being a form in which the angle between the first screen and the second screen is within a range from a first preset angle to 180°; receiving a first operation acting on the system camera control; in response to the first operation, starting the system camera; detecting whether the folding screen is switched to a second form, the second form being a form in which the angle between the first screen and the second screen is within a range from a first preset angle to the first preset angle. Assume that the second preset angle is less than the first preset angle; if so, the first screen of the folding screen in the second form displays a second user interface, and the second screen displays a third user interface; the second user interface includes a first preview display area, and the first preview display area is used to display a first user face makeup image generated based on the user face image currently captured by the camera, and the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of simulated makeup controls; receive a second operation acting on a first target makeup control; in response to the second operation, update the first user face makeup image displayed in the first preview display area based on the makeup effect parameters corresponding to the first target makeup control.

[0006] The embodiment of the present application can present an application interface that simulates a real makeup box when it is detected that the electronic device is in a stand state (that is, the second form), and can provide users with a new interactive experience to enhance the user's sense of ritual and immersive experience in the virtual makeup process. Specifically, the folding screen of the electronic device can be folded along the folding edge to form a first screen and a second screen. When the folding screen is in a first form (also called a straight plate form), that is, when the angle between the first screen and the second screen is in the range of a first preset angle to 180° (including the first preset angle and 180°), a first user interface including a system camera control can be displayed; further, after starting the system camera application, the electronic device can detect whether the folding screen is switched to a second form (also called a bracket form) in which the angle between the first screen and the second screen is in the range of a second preset angle to a first preset angle (including the second preset angle and excluding the first preset angle). If so, the first screen of the folding screen in the second form displays a second user interface including a first preview display area, and the second screen displays a third user interface including a virtual makeup tool; wherein the first preview display area can be used to display a first user face makeup image generated based on the user face image currently captured by the camera, and the virtual makeup tool may include multiple simulated makeup controls; further, after receiving a second operation acting on the first target makeup control, the first user face makeup image displayed in the first preview display area is updated based on the makeup effect parameters corresponding to the first target makeup control. Through the embodiments of the present application, the folding screen of the electronic device can form different shapes at different angles, thereby presenting different user interfaces. When the folding screen is in a straight state (i.e., the first form), the folding screen of the electronic device presents a straight user interface (e.g., the first user interface) for user convenience; after the system camera is started, when the electronic device detects that the folding screen is in a bracket state (i.e., the second form), the first screen and the second screen of the folding screen present an application interface simulating a real makeup box, wherein the third user interface displayed on the second screen includes a virtual makeup tool that simulates the appearance and function of a real makeup tool, and the second user interface displayed on the first screen can be based on the user's operation (e.g., the second operation acting on the first target makeup control), and the preview image of the corresponding beauty effect (i.e., the first user's facial makeup image displayed in the first preview display area) can be updated in real time, so that the user can more intuitively understand the beauty function of the virtual makeup tool, so that the makeup effect can be selected and adjusted more conveniently and quickly according to personal preferences, and at the same time provide users with a new interactive service with a more ritual sense, and provide users with a feeling closer to the actual makeup process, thereby enhancing the user's immersive beauty experience in the virtual makeup process.In addition, compared with the smart makeup box application that relies on the design of the application side in the prior art, it is subject to the permission control of the operating system or the device manufacturer, and may need to open the corresponding interface and / or permission to obtain the relevant data of the folding screen status, so that it is impossible to obtain the same control permission of the camera, sensor and other hardware as the system camera application, which makes it difficult to achieve the same response speed and performance as the system camera. The embodiment of the present application is a folding makeup box experience upgraded based on the beauty and makeup characteristics of the system camera. Therefore, through the embodiment of the present application, the user does not need to install or switch to other applications to achieve the effect of virtual makeup. At the same time, the system camera has the permission and ability to directly obtain the folding screen state parameters. The hardware and software on the electronic device can be better compatible. When the folding screen is converted to the stand state (that is, the second form), a faster response speed can be achieved, so that a simulated interactive interface adapted to the stand state folding screen is presented more efficiently. At the same time, the camera, sensor and image processing engine of the electronic device can be more fully utilized, reducing the shooting delay while providing more efficient and higher-quality beauty effects, thereby enhancing the user's beauty experience.

[0007] In a possible implementation, the third user interface also includes a shooting control; the method also includes: receiving a third operation acting on the shooting control; and in response to the third operation, saving the makeup-wearing facial image of the first user currently displayed in the first preview display area.

[0008] In an embodiment of the present application, when the folding screen of the electronic device is in the second form (also called the stand form), that is, when the angle between the first screen and the second screen is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the third user interface displayed on the second screen of the folding screen also includes a shooting control. Further, after receiving the third operation acting on the shooting control, the electronic device can save the makeup-wearing image of the first user's face currently displayed in the first preview display area (that is, the first preview display area in the second user interface displayed on the first screen of the folding screen), so that the user can timely capture and save satisfactory images during the virtual makeup process, and can also further edit and adjust the saved images later to enhance the user's usage experience.

[0009] In a possible implementation, the first preset angle is greater than or equal to 150° and less than 180°; the second preset angle is greater than or equal to 10° and less than or equal to 15°.

[0010] In the embodiment of the present application, the first preset angle can be any angle greater than or equal to 150° and less than 180, and the second preset angle can be any angle greater than or equal to 10° and less than or equal to 15°, so that the electronic device can accurately judge the shape of the folding screen of the current electronic device according to the angle between the first screen and the second screen of the folding screen, thereby presenting a user interface that is more in line with the user's operating habits to enhance the user experience. Exemplarily, when the electronic device detects that the folding screen is in a first form (also called a straight-board state) in which the angle between the first screen and the second screen is within a range from a first preset angle to 180° (including the first preset angle and 180°), the folding screen can be unfolded to present a larger user interface (such as the first user interface), so as to facilitate the user to use the application of the electronic device in the straight-board state; accordingly, after the system camera is started, when the electronic device detects that the folding screen is in a second form (also called a bracket state) in which the angle between the first screen and the second screen is within a range from a second preset angle to a first preset angle (including the second preset angle and excluding the first preset angle), the first screen and the second screen of the folding screen can be split-screen to present an application interface simulating a real makeup box, providing the user with an interactive experience that is closer to the real makeup process, making it more convenient and quick for the user to use the virtual makeup function to perform beauty makeup, while enhancing the user's immersive experience during the virtual makeup process.

[0011] In one possible implementation, the method also includes: in response to the first operation, the folding screen in the first form displays a fourth user interface; the fourth user interface includes a second preview display area, and the second preview display area is used to display the user's facial image currently captured by the camera.

[0012] In the embodiment of the present application, after receiving the first operation acting on the system camera control, the folding screen in the first form (also called the straight state), that is, the folding screen with the angle between the first screen and the second screen in the range of the first preset angle to 180° (including the first preset angle and 180°), displays a fourth user interface including a second preview display area, and the second preview display area can be used to display the user's facial image currently captured by the camera. Through the embodiment of the present application, the folding screen in the straight state (that is, the first form) can present a straight-state system camera interaction interface (that is, the fourth user interface), so that the user can preview the user's facial image currently captured by the camera in real time through the second preview display area, so as to view a real and natural selfie image in real time. In addition, since the area of ​​the second preview display area is significantly larger than the first preview display area, it can provide users with a larger visual area and better visual effects to enhance the user's experience of using the system camera in the straight state. Furthermore, users can independently choose whether to turn on the beauty and makeup function according to their preferences and needs (for example, operating the beauty and makeup controls of the fourth user interface or bending the folding screen inward to the second form), thereby improving the flexibility of users in using the beauty and makeup function and adapting to different social or photo-taking occasions.

[0013] In one possible implementation, the virtual makeup tool is used to adjust the virtual makeup effect of the first user's facial makeup image; the makeup control includes one or more of a color display control, a shape display control, and a color adjustment control; the color display control is used to preview the color of the corresponding virtual makeup, the shape display control is used to preview the corresponding makeup style, and the parameter adjustment control is used to adjust the corresponding makeup effect parameters.

[0014] In the embodiment of the present application, the virtual makeup effect of the first user's facial makeup image displayed in the first preview display area can be adjusted through the virtual makeup tool, so that the user can easily and quickly try different makeup without real makeup. Further, the virtual makeup tool includes a plurality of skeuomorphic makeup controls, each of which includes one or more of a color display control, a shape display control, and a color adjustment control. Among them, the color display control can be used to preview the color of the corresponding virtual makeup, so that the user can more intuitively preview the color of the corresponding virtual makeup (such as lipstick, eye shadow, blush, etc.), so that the user can choose the appropriate makeup color according to his or her preferences or occasions; the shape display control can be used to preview the corresponding makeup style, so that the user can see the style (such as the shape of the eye makeup, the shape of the lip makeup, etc.) of the corresponding virtual makeup (such as eye makeup, lip makeup, etc.) before adjustment, so that the user can choose the appropriate makeup style according to his or her preferences or occasions; the parameter adjustment control can be used to adjust the corresponding makeup effect parameters (such as parameters such as transparency), so that the user can finely adjust the makeup effect to enhance the user's beauty experience during the virtual makeup process. Through the embodiments of the present application, users can preview and adjust the color, style and various parameters of makeup in real time through diversified makeup controls, so that users can more conveniently and flexibly find makeup that suits them during the virtual makeup process. While meeting the user's customized virtual makeup needs, it can also provide the user with a feeling that is closer to using real makeup tools to enhance the user's immersive virtual makeup experience.

[0015] In a possible implementation, the type of makeup control may include one or more of a lipstick control, an eyeshadow control, a blush control, an eyelash control, an eyebrow control, and a cosmetic contact lens control; wherein the color display control corresponding to the lipstick control is a lipstick icon control simulating the appearance of a lipstick, which is used to preview the lipstick color of the virtual makeup; the shape display control corresponding to the lipstick control is a lip makeup icon control simulating the shape of lip makeup, which is used to preview the lip makeup style of the virtual makeup; or, the color display control corresponding to the eyeshadow control is an eyeshadow icon control simulating the appearance of an eyeshadow palette, which is used to preview the eyeshadow color of the virtual makeup; the shape display control corresponding to the eyeshadow control is an eye makeup icon control simulating the shape of eye makeup, which is used to preview the eye makeup style of the virtual makeup; or, the color display control corresponding to the blush control is a blush icon control simulating the appearance of a blush palette, which is used to preview the blush color of the virtual makeup; the shape display control corresponding to the blush control is The control element is a blush makeup icon control simulating the shape of blush, which is used to preview the blush style of virtual makeup; or the color display control corresponding to the eyelash control is a mascara icon control simulating the appearance of mascara, which is used to preview the eyelash color of virtual makeup; the shape display control corresponding to the eyelash control is an eyelash icon control simulating the shape of eyelashes, which is used to preview the eyelash style of virtual makeup; or the color display control corresponding to the eyebrow control is an eyebrow pencil icon control simulating the appearance of an eyebrow pencil, which is used to preview the eyebrow color of virtual makeup; the shape display control corresponding to the eyebrow control is an eyebrow makeup icon control simulating the shape of eyebrows, which is used to preview the eyebrow style of virtual makeup; or the color display control corresponding to the beauty contact lens control is a beauty contact lens icon control simulating the appearance of beauty contact lenses, which is used to preview the beauty contact lens color of virtual makeup; the shape display control corresponding to the beauty contact lens control is a beauty contact lens makeup icon control simulating the shape of beauty contact lenses, which is used to preview the beauty contact lens style of virtual makeup.

[0016] In the embodiment of the present application, the type of makeup control may include one or more of lipstick control, eye shadow control, blush control, eyelash control, eyebrow control and contact lens control, so that the user can select one or more of the controls to perform virtual makeup as needed, so as to flexibly customize his or her makeup, meet the user's personalized needs for makeup, and provide the user with an immersive beauty experience to enhance the user experience. Among them, the color display control corresponding to the lipstick control can be a lipstick icon control that simulates the appearance of lipstick, which is used to preview the lipstick color of virtual makeup, so that the user can preview the color of different lipsticks more intuitively, so as to more conveniently and quickly select the appropriate lipstick color according to his or her preferences or makeup style, and can bring the user an immersive experience closer to using real lipstick to make lip makeup; the shape display control corresponding to the lipstick control can be a lip makeup icon control that simulates the shape of lip makeup, which is used to preview the lip makeup style of virtual makeup, so that the user can know the style of lip makeup (such as lip makeup shape) in advance before adjusting, so that the user can easily try different lip makeup styles and select the most suitable lipstick color and style to achieve a satisfactory makeup effect.

[0017] Alternatively, the color display control corresponding to the eye shadow control may be an eye shadow icon control that simulates the appearance of an eye shadow palette, for previewing the eye shadow colors of virtual makeup, allowing users to preview different eye shadow colors more intuitively, and thus more conveniently and quickly select appropriate eye shadow colors according to their preferences or makeup style, while providing users with an immersive experience closer to using a real eye shadow palette to apply eye makeup; the shape display control corresponding to the eye shadow control may be an eye makeup icon control that simulates the shape of eye makeup, for previewing the eye makeup style of virtual makeup, allowing users to understand the style of eye makeup (such as the shape of eye shadow, etc.) in advance before adjusting it, so that users can easily try different styles of eye makeup styles and select the most appropriate eye shadow color and style to achieve a satisfactory makeup effect.

[0018] Alternatively, the color display control corresponding to the blush control can be a blush icon control that simulates the appearance of a blush palette, which is used to preview the blush color of virtual makeup, allowing users to preview different blush colors more intuitively, and thus choose the appropriate blush color more conveniently and quickly according to their preferences or makeup style, while giving users an immersive experience closer to using a real blush palette to apply blush makeup; the shape display control corresponding to the blush control can be a blush makeup icon control that simulates the shape of the blush, which is used to preview the blush style of virtual makeup, allowing users to understand the style of the blush makeup (such as the shape of the blush, etc.) in advance before adjusting it, so that users can easily try different styles of blush makeup and choose the most suitable blush color and style to achieve a satisfactory makeup effect.

[0019] Alternatively, the color display control corresponding to the eyelash control may be a mascara icon control that simulates the appearance of mascara, for previewing the eyelash color of virtual makeup, allowing the user to preview the colors of different mascaras more intuitively, and thus more conveniently and quickly select a suitable eyelash color according to their preferences or makeup style, while providing the user with an immersive experience closer to applying eyelashes with real mascara; the shape display control corresponding to the eyelash control may be an eyelash icon control that simulates the shape of eyelashes, for previewing the eyelash style of virtual makeup, allowing the user to understand the style of the eyelashes (e.g., the shape of the eyelashes, etc.) in advance before adjusting them, so that the user can easily try different styles of eyelash styles and select the most suitable eyelash color and style to achieve a satisfactory makeup effect.

[0020] Alternatively, the color display control corresponding to the eyebrow control may be an eyebrow pencil icon control that simulates the appearance of an eyebrow pencil, for previewing the eyebrow color of virtual makeup, allowing the user to preview the colors of different eyebrow pencils more intuitively, and thus more conveniently and quickly select the appropriate eyebrow pencil color according to their preferences or makeup style, while giving the user an immersive experience closer to using a real eyebrow pencil to draw their eyebrows; the shape display control corresponding to the eyebrow control may be an eyebrow makeup icon control that simulates the shape of the eyebrows, for previewing the eyebrow style of virtual makeup, allowing the user to understand the style of the eyebrows (such as the shape of the eyebrows, etc.) in advance before adjusting them, so that the user can easily try different styles of eyebrow styles and select the most appropriate eyebrow color and style to achieve a satisfactory makeup effect.

[0021] Alternatively, the color display control corresponding to the contact lens control can be a contact lens icon control that simulates the appearance of contact lenses, which is used to preview the contact lens colors of virtual makeup, allowing users to preview different contact lens colors more intuitively, and thus choose suitable contact lens colors more conveniently and quickly according to their preferences or makeup style, while giving users an immersive experience closer to using real contact lenses; the shape display control corresponding to the contact lens control can be a contact lens makeup icon control that simulates the shape of contact lenses, which is used to preview the contact lens styles of virtual makeup, allowing users to understand the styles of contact lenses (such as the colors of contact lenses, etc.) in advance before adjusting them, so that users can easily try different styles of contact lenses and choose the most suitable contact lens color and style to achieve a satisfactory makeup effect.

[0022] In a possible implementation, the method further includes: receiving a fourth operation acting on a target part in the makeup-wearing image of the first user's face, the fourth operation comprising an outward expansion operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen; in response to the fourth operation, the first preview display area displays an enlarged makeup-wearing image of the target part.

[0023] In an embodiment of the present application, the electronic device can receive a user's double-finger expansion operation on the first screen or a double-click operation of the finger on the first screen (that is, the fourth operation) for a target part in the makeup-wearing image of the first user's face, and display the enlarged image of the target part with makeup in the first preview display area in the second user interface displayed on the first screen, so that the user can select the target part of interest or that needs to be adjusted through gesture operation, and quickly and accurately view the enlarged image of the target part with makeup, while realizing real-time preview of the adjustment effect of the makeup effect on the target part, which helps the user to view the makeup details when fine-tuning the makeup, thereby more intuitively and efficiently adjusting the virtual makeup effect to enhance the user experience.

[0024] In a possible implementation, the method further includes: if it is detected that the target part in the user facial image is blocked by a target object, the target part in the first user facial makeup image displays an image of the target object.

[0025] In an embodiment of the present application, when the electronic device detects that a target part in an image of a user's face is blocked by an object, the target part in the image of the first user's face with makeup displayed in the first preview display area displays the image of the target object, so that during the virtual makeup process, the part of the image of the first user's face with makeup previewed in the first preview display area that is blocked by the target object will not show the virtual makeup effect, thereby improving the realism of the virtual makeup and enhancing the user's sense of reality and immersive experience in the virtual makeup process; at the same time, the part of the first user's face with makeup that is not blocked by the target object will not lose the preview effect of the overall makeup, so that the user's virtual makeup process will not be affected when part of the face is blocked, thereby improving the user's experience in the virtual makeup process.

[0026] In one possible implementation, the method also includes: the second screen of the folding screen in the second form displays a fifth user interface, the fifth user interface including custom makeup controls; receiving a fifth operation for the custom makeup controls; and in response to the fifth operation, the second screen displays the third user interface.

[0027] In the embodiment of the present application, the folding screen of the electronic device is in the second form (also called the stand state), that is, when the angle between the first screen and the second screen is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the second screen displays the fifth user interface including the custom makeup control; further, after the electronic device receives the fifth operation for the custom makeup control, the second screen displays the third user interface including the virtual makeup tool. Through the embodiment of the present application, when the folding screen is in the second form (also called the stand state), the user can use the custom makeup control in the second screen to make the second screen of the folding screen display the third user interface including the virtual makeup tool, thereby simplifying the cumbersome operation process and improving efficiency. At the same time, the user can also adjust and set the custom makeup parameters more conveniently and quickly through the skeuomorphic interactive interface that simulates the real makeup box, so as to enhance the user's experience of setting personalized makeup in the virtual makeup process.

[0028] In one possible implementation, the third user interface also includes a makeup saving control; the method also includes: receiving a sixth operation for the makeup saving control; in response to the sixth operation, saving the makeup effect parameters corresponding to the makeup-wearing image of the first user's face currently displayed in the first preview display area as the target custom makeup.

[0029] In an embodiment of the present application, the second screen of the folding screen displays a third user interface including virtual makeup tools, and may also include a makeup saving control. When the electronic device receives a sixth operation for the makeup saving control, the makeup effect parameters corresponding to the makeup-wearing image of the first user's face currently displayed in the first preview display area (that is, the first preview display area in the second user interface displayed on the first screen of the folding screen) can be saved as the target custom makeup, so that the user can use the makeup saving control to retain the makeup effect parameters corresponding to the current favorite makeup during the virtual makeup process as the target custom makeup, so that the user can quickly apply the pre-set makeup effect the next time he needs to experience the same makeup effect, thereby meeting the user's needs for customized makeup and enhancing the user's experience.

[0030] In a possible implementation, the first user interface also includes a gallery control; the method further includes: receiving a seventh operation for the gallery control; in response to the seventh operation, the folding screen in the first form displays a sixth user interface; the sixth user interface includes an album display area, the album display area is used to display thumbnails of stored images; receiving an eighth operation for thumbnails of user facial images to be processed; in response to the eighth operation, the folding screen in the first form displays a seventh user interface; the seventh user interface includes a third preview display area, the third preview display area is used to display the user facial image to be processed; detecting the folding screen Whether to switch to the second form; if so, the first screen of the folding screen in the second form displays an eighth user interface, and the second screen displays a ninth user interface; the eighth user interface includes a fourth preview display area, and the fourth preview display area is used to display a second user facial makeup image generated based on the user facial image to be processed; the ninth user interface includes the virtual makeup tool, and the virtual makeup tool includes a plurality of materialized makeup controls; receiving a ninth operation acting on a second target makeup control; in response to the ninth operation, updating the second user facial makeup image displayed in the fourth preview display area based on the makeup effect parameters corresponding to the second target makeup control.

[0031] In the embodiment of the present application, the first user interface displayed on the folding screen of the electronic device may also include a gallery control. During the operation of the gallery application, when it is detected that the electronic device is in a stand state (that is, the second form), the electronic device can present an application interface that simulates a real makeup box, so that the user can use a method that is closer to actual makeup to adjust the makeup effects of the stored facial image, providing the user with a new interactive experience, thereby enhancing the user's sense of ritual and immersive experience in the process of adjusting the facial makeup of the image in the later stage. Specifically, when the electronic device receives the seventh operation for the gallery control, the folding screen in the first form (also called the straight board state), that is, the folding screen with an angle between the first screen and the second screen in the range of the first preset angle to 180° (including the first preset angle and 180°), displays a sixth user interface including an album display area for displaying thumbnails of stored images. Further, after the electronic device receives the eighth operation for the thumbnail of the user's facial image to be processed, the folding screen in the first form (also called the straight board state) displays a seventh user interface including a third preview display area for displaying the user's facial image to be processed. Furthermore, the electronic device can determine whether to present an application interface simulating a real makeup box by detecting whether the folding screen is switched to a second form (also called a bracket state) in which the angle between the first screen and the second screen is within the range of the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle). If it is detected that the folding screen is switched to the second form (also called the bracket state), the first screen of the folding screen in the second form displays an eighth user interface including a fourth preview display area, and the second screen displays a ninth user interface including a virtual makeup tool, wherein the fourth preview display area can be used to display a second user face makeup image generated after adjusting the makeup effect parameters based on the user face image to be processed, and the virtual makeup tool may include a plurality of skeuomorphic makeup controls. Then, after receiving the ninth operation acting on the second target makeup control, the second user face makeup image displayed in the fourth preview display area is updated based on the makeup effect parameters corresponding to the second target makeup control. Through the embodiment of the present application, the folding screen of the electronic device can form different forms at different angles, thereby presenting different user interfaces.When the folding screen is in the straight state (i.e., the first state), the folding screen of the electronic device presents a straight-state user interface (e.g., the first user interface) for user convenience; after starting the gallery application, when the electronic device detects that the folding screen is in the bracket state (i.e., the second state), the first screen and the second screen of the folding screen present an application interface simulating a real makeup box, wherein the ninth user interface displayed on the second screen includes a virtual makeup tool that simulates the appearance and function of a real makeup tool, and the eighth user interface displayed on the first screen can display a second user face makeup image generated based on the user face image to be processed, and at the same time respond to the user's operation The user can then perform an operation (for example, the ninth operation for the second target makeup control) and update the preview image after adjusting the beauty makeup effect (that is, the second user's facial makeup image displayed in the fourth preview display area) based on the makeup effect parameters corresponding to the second target makeup control in real time, so that the user can more intuitively understand the beauty makeup function of the virtual makeup tool when using the gallery application to adjust the makeup effect for the stored facial image, so that the user can more conveniently and quickly select and adjust the makeup effect according to personal preference, and at the same time provide the user with an interactive experience that is closer to the actual makeup process, thereby enhancing the user's immersive beauty makeup experience in the process of performing virtual makeup on the stored facial image. In addition, compared with the smart makeup box application that relies on the design of the application side in the prior art, it is subject to the permission control of the operating system or the device manufacturer, and may need to open the corresponding interface and / or permission to obtain the relevant data of the folding screen state, so it is difficult to achieve the same response speed and performance as the gallery application. In the embodiment of the present application, since the gallery application has the permission and ability to directly obtain the folding screen state parameters, it can achieve a faster response speed when the folding screen is converted to the bracket state (that is, the second form), so as to more efficiently present a simulated interactive interface adapted to the bracket state folding screen. At the same time, the beauty and makeup algorithm of the folding makeup box of the embodiment of the present application is designed in the gallery application, so that the user does not need to install or switch to other applications to adjust the beauty and makeup effects of the stored facial images, providing a more convenient and fast user experience while consuming less computing resources to maintain a more stable application performance and a faster response speed; it can also make fuller use of intelligent recognition technology and beauty and makeup algorithms to more accurately identify and adjust individual features such as faces and facial features, which can ensure more efficient and high-quality beauty and makeup effects, thereby enhancing the user's experience of virtual makeup for stored facial images.

[0032] In one possible implementation, the eighth user interface also includes an image saving control; the method also includes: receiving a tenth operation for the image saving control; and in response to the tenth operation, saving the second user's facial makeup image currently displayed in the fourth preview display area.

[0033] In an embodiment of the present application, when the folding screen of the electronic device is in the second form (also called the stand form), that is, when the angle between the first screen and the second screen is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the eighth user interface displayed on the first screen of the folding screen also includes an image saving control. Further, after receiving the tenth operation acting on the image saving control, the electronic device can save the second user's facial makeup image currently displayed in the fourth preview display area (that is, the fourth preview display area in the eighth user interface displayed on the first screen of the folding screen), so that the user can save the satisfactory facial image after adjusting the virtual makeup effect, so that subsequent users can view or share their satisfactory images, so as to enhance the user's customized beauty experience.

[0034] In a second aspect, the present application provides a display device, which is applied to an electronic device, wherein the electronic device includes a folding screen and a camera, wherein the folding screen can be folded along a folding edge to form a first screen and a second screen; and the display device may include:

[0035] A first display unit, configured to display a first user interface on the folding screen in a first form; the first user interface includes a system camera control, and the first form is a form in which the angle between the first screen and the second screen is within a range from a first preset angle to 180°;

[0036] A first receiving unit, configured to receive a first operation acting on the system camera control;

[0037] a starting unit, configured to start the system camera in response to the first operation;

[0038] a first detection unit, used to detect whether the folding screen is switched to a second state, where the second state is a state in which the angle between the first screen and the second screen is within a range from a second preset angle to the first preset angle, and the second preset angle is smaller than the first preset angle;

[0039] a second display unit, for displaying a second user interface on the first screen of the folding screen in the second form, and displaying a third user interface on the second screen; the second user interface includes a first preview display area, the first preview display area is used to display a first user face makeup image generated based on the user face image currently captured by the camera, the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls;

[0040] A second receiving unit, configured to receive a second operation acting on the first target makeup control;

[0041] The first updating unit is configured to update the makeup-wearing facial image of the first user displayed in the first preview display area based on the makeup effect parameters corresponding to the first target makeup control in response to the second operation.

[0042] In a possible implementation manner, the third user interface further includes a shooting control; and the device further includes:

[0043] A third receiving unit, configured to receive a third operation acting on the shooting control;

[0044] The first saving unit is used to save the makeup-wearing facial image of the first user currently displayed in the first preview display area in response to the third operation.

[0045] In a possible implementation, the first preset angle is greater than or equal to 150° and less than 180°; the second preset angle is greater than or equal to 10° and less than or equal to 15°.

[0046] In a possible implementation manner, the device further includes:

[0047] A third display unit is used to display a fourth user interface on the folding screen in the first form in response to the first operation; the fourth user interface includes a second preview display area, and the second preview display area is used to display the user's facial image currently captured by the camera.

[0048] In one possible implementation, the virtual makeup tool is used to adjust the virtual makeup effect of the first user's facial makeup image; the makeup control includes one or more of a color display control, a shape display control, and a color adjustment control; the color display control is used to preview the color of the corresponding virtual makeup, the shape display control is used to preview the corresponding makeup style, and the parameter adjustment control is used to adjust the corresponding makeup effect parameters.

[0049] In a possible implementation, the type of the makeup control includes one or more of a lipstick control, an eye shadow control, a blush control, an eyelash control, an eyebrow control, and a cosmetic contact lens control; wherein the color display control corresponding to the lipstick control is a lipstick icon control simulating the appearance of lipstick, which is used to preview the lipstick color of virtual makeup; the shape display control corresponding to the lipstick control is a lip makeup icon control simulating the shape of lip makeup, which is used to preview the lip makeup style of virtual makeup;

[0050] Alternatively, the color display control corresponding to the eye shadow control is an eye shadow icon control simulating the appearance of an eye shadow palette, which is used to preview the eye shadow color of virtual makeup; the shape display control corresponding to the eye shadow control is an eye makeup icon control simulating the shape of eye makeup, which is used to preview the eye makeup style of virtual makeup;

[0051] Alternatively, the color display control corresponding to the blush control is a blush icon control simulating the appearance of a blush palette, which is used to preview the blush color of virtual makeup; the shape display control corresponding to the blush control is a blush makeup icon control simulating the shape of blush, which is used to preview the blush style of virtual makeup;

[0052] Alternatively, the color display control corresponding to the eyelash control is a mascara icon control that simulates the appearance of mascara, which is used to preview the color of the eyelashes in virtual makeup; the shape display control corresponding to the eyelash control is an eyelash icon control that simulates the shape of the eyelashes, which is used to preview the style of the eyelashes in virtual makeup;

[0053] Alternatively, the color display control corresponding to the eyebrow control is an eyebrow pencil icon control that simulates the appearance of an eyebrow pencil, which is used to preview the eyebrow color of virtual makeup; the shape display control corresponding to the eyebrow control is an eyebrow makeup icon control that simulates the shape of an eyebrow, which is used to preview the eyebrow style of virtual makeup;

[0054] Alternatively, the color display control corresponding to the beauty contact lens control is a beauty contact lens icon control that simulates the appearance of beauty contact lenses, which is used to preview the beauty contact lens color of virtual makeup; the shape display control corresponding to the beauty contact lens control is a beauty contact lens makeup icon control that simulates the shape of beauty contact lenses, which is used to preview the beauty contact lens style of virtual makeup.

[0055] In a possible implementation manner, the device further includes:

[0056] a fourth receiving unit, configured to receive a fourth operation applied to a target part of the makeup-wearing face image of the first user, wherein the fourth operation includes an outward expansion operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen;

[0057] The fourth display unit is used to: in response to the fourth operation, display the enlarged image of the target part with makeup in the first preview display area.

[0058] In a possible implementation manner, the device further includes:

[0059] The fifth display unit is used to display the image of the target object at the target part in the first user's facial makeup image if it is detected that the target part in the user's facial image is blocked by the target object.

[0060] In a possible implementation manner, the device further includes:

[0061] A sixth display unit, configured to display a fifth user interface on the second screen of the folding screen in the second form, wherein the fifth user interface includes a custom makeup control;

[0062] a fifth receiving unit, configured to receive a fifth operation for the custom makeup control;

[0063] A seventh display unit is configured to cause the second screen to display the third user interface in response to the fifth operation.

[0064] In a possible implementation, the third user interface further includes a makeup saving control; and the device further includes:

[0065] A sixth receiving unit, configured to receive a sixth operation on the makeup saving control;

[0066] The second saving unit is used to save the makeup effect parameters corresponding to the makeup-wearing image of the first user's face currently displayed in the first preview display area as a target custom makeup in response to the sixth operation.

[0067] In a possible implementation manner, the first user interface further includes a gallery control; and the device further includes:

[0068] A seventh receiving unit, configured to receive a seventh operation for the gallery control;

[0069] an eighth display unit, configured to, in response to the seventh operation, display a sixth user interface on the folding screen in the first form; the sixth user interface comprising an album display area, the album display area being configured to display thumbnails of stored images;

[0070] an eighth receiving unit, configured to receive an eighth operation on the thumbnail of the user's facial image to be processed;

[0071] a ninth display unit, configured to, in response to the eighth operation, display a seventh user interface on the folding screen in the first form; the seventh user interface includes a third preview display area, and the third preview display area is configured to display the user facial image to be processed;

[0072] A second detection unit, used to detect whether the folding screen is switched to the second form;

[0073] a tenth display unit, configured to: if the first screen of the folding screen in the second form displays an eighth user interface, and the second screen displays a ninth user interface; the eighth user interface includes a fourth preview display area, and the fourth preview display area is used to display a second user face makeup image generated based on the user face image to be processed; the ninth user interface includes the virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls;

[0074] a ninth receiving unit, configured to receive a ninth operation acting on the second target makeup control;

[0075] The second updating unit is used to update the makeup-wearing facial image of the second user displayed in the fourth preview display area based on the makeup effect parameter corresponding to the second target makeup control.

[0076] In a possible implementation manner, the eighth user interface further includes an image saving control; and the device further includes:

[0077] a tenth receiving unit, configured to receive a tenth operation on the image saving control;

[0078] The third saving unit is used to save the makeup-wearing facial image of the second user currently displayed in the fourth preview display area in response to the tenth operation.

[0079] In a third aspect, the present application provides an electronic device, which may include a folding screen and a camera, wherein the folding screen can be folded along a folding edge to form a first screen and a second screen; the electronic device also includes a memory and a processor, wherein the memory is used to store computer programs and various data, and the processor is used to call the computer program stored in the memory so that the electronic device executes the method in any possible implementation of the first aspect above.

[0080] In a fourth aspect, the present application provides a computer-readable storage medium storing a computer program, which, when executed by a processor, implements a method in any possible implementation of the first aspect.

[0081] In a fifth aspect, an embodiment of the present application provides a computer program, which may include instructions. When the computer program is run on a computer, the computer executes a method in any possible implementation of the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0082] Figure 1 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0083] Figure 2 It is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application.

[0084] Figure 3 This is an example diagram of the morphological structure of the folding screen of the electronic device 100 provided in an embodiment of the present application.

[0085] Figure 4 This is an example flow chart of an image processing pathway provided in an embodiment of the present application.

[0086] Figure 5 This is an example flow chart of a display method provided in an embodiment of the present application.

[0087] Figure 6 This is an example flow chart of another display method provided in an embodiment of the present application.

[0088] Figure 7A-7C This is a schematic diagram of a user interface of an electronic device using an application display method provided in an embodiment of the present application.

[0089] Fig. 8A This is a user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is a lipstick control.

[0090] Figure 8B This is a user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is an eye shadow control.

[0091] Figure 8C This is a user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is a blush control.

[0092] Fig.8D This is a user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is an eyelash control.

[0093] Fig. 8E This is a user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is an eyebrow control.

[0094] Figure 8F This is a user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is a cosmetic contact lens control.

[0095] Figure 9A-9E This is a schematic diagram of a user interface of an electronic device using an application display method provided in an embodiment of the present application.

[0096] Fig.10 It is a flow chart of a display method based on a gallery application provided in an embodiment of the present application.

[0097] Fig.11 This is a schematic diagram of a user interface of an electronic device using another application display method provided in an embodiment of the present application.

[0098] Fig.12 It is a structural schematic diagram of a display device provided in an embodiment of the present application.

[0099] Fig.13 It is a schematic diagram of the hardware structure of another electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0100] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application.

[0101] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the embodiments of the present application. As used in the specification and the appended claims of the embodiments of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the embodiments of the present application refers to and includes any or all possible combinations of one or more listed items.

[0102] The terms "first", "second", "third" and "fourth" etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0103] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0104] The term "user interface (UI)" in the following embodiments of the present application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device, and finally presented as content that can be recognized by the user. The commonly used form of user interface is a graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0105] In order to facilitate understanding of the embodiments of the present application, an exemplary electronic device provided in the embodiments of the present application is first introduced.

[0106] See also Figure 1 , Figure 1 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. The electronic device 100 is a smart terminal device and can be of various types. The embodiment of the present application does not limit its specific type. For example, the electronic device can be a mobile phone, and can also include a tablet computer, a desktop computer, a desktop computer with a touch-sensitive surface or a touch panel, a laptop computer (laptop), a handheld computer, a notebook computer, a smart screen, a wearable device (such as a smart watch, a smart bracelet, etc.), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a car computer, a smart headset, a game console, and can also be an Internet of Things (IOT) device or a smart home device such as a smart water heater, a smart lamp, a smart air conditioner, etc. Please refer to Figure 1 , the following combination Figure 1 The components of the electronic device 100 are described in detail:

[0107] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a touch device 180I, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0108] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0109] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0110] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuits sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0111] The integrated circuit I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple groups of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example: the processor 110 can be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 communicates with the touch sensor 180K through the I2C bus interface to realize the touch function of the electronic device 100.

[0112] The integrated circuit has a built-in audio I2S interface that can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 may be coupled to the audio module 170 via the I2S bus to achieve communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 may transmit an audio signal to the wireless communication module 160 via the I2S interface to achieve the function of answering a call via a Bluetooth headset.

[0113] The pulse code modulation PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via a PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface to realize the function of answering calls through a Bluetooth headset. Among them, both the I2S interface and the PCM interface can be used for audio communication.

[0114] The universal asynchronous receiver / transmitter UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit an audio signal to the wireless communication module 160 through the UART interface to realize the function of playing music through a Bluetooth headset.

[0115] The mobile industry processor interface MIPI interface can be used to connect the processor 110 with peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to realize the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the electronic device 100.

[0116] The general purpose input and output GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the camera 193, the display 194, the wireless communication module 160, the audio module 170, the sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0117] The universal serial bus (USB) interface 130 is an interface that complies with the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The universal serial bus (USB) interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect headphones to play audio through the headphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0118] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0119] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via a universal serial bus (USB) interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input via a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0120] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0121] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0122] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0123] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0124] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0125] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0126] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TDSCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0127] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0128] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. In an embodiment of the present application, the display screen 194 may include a display and a touch panel (TP). The display is used to output display content to the user, and the touch panel is used to receive touch events input by the user on the display screen 194. In the embodiment of the present application, the display screen 194 may be a foldable display screen, and its folding form may include different folding forms such as an up and down folding form or a left and right folding form, which is not limited in the embodiment of the present application.

[0129] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0130] The ISP is used to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise and brightness of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0131] Camera 193 is used to capture static images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1. In one example, the camera 193 may include a wide-angle camera, a photographic camera, a 3D depth camera (e.g., a structured light camera, a time-of-flight depth (flignt, ToF) camera), a telephoto camera, etc. In some embodiments, the camera 193 may include a front camera and a rear camera. In an embodiment of the present application, the camera 193 (e.g., a front camera) can be used to capture a user's facial image.

[0132] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0133] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0134] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0135] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0136] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0137] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0138] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0139] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0140] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0141] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0142] The earphone interface 170D is used to connect a wired earphone and can be a universal serial bus (USB) interface 130, or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0143] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0144] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0145] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0146] The magnetic sensor 180D includes a Hall sensor, a magnetometer, etc. The Hall sensor can detect the direction of the magnetic field; the magnetometer is used to measure the magnitude and direction of the magnetic field. The magnetometer can measure the strength of the ambient magnetic field. For example, the magnetometer can be used to measure the magnetic field strength and then obtain the azimuth information of the carrier of the magnetometer.

[0147] The acceleration sensor 180E can detect the magnitude of acceleration in various directions (generally three axes) of the electronic device 100. When the electronic device 100 is stationary, the magnitude and direction of gravity acceleration can be detected.

[0148] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0149] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0150] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0151] The touch control device 180I can be used to detect the touch position of the user. In some embodiments, the touch control device 180I can detect the touch point of the user on the electronic device 100, and then determine the user's gripping posture according to the touch position using a preset gripping algorithm.

[0152] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0153] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0154] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0155] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0156] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate a signal input related to the user settings and function control of the electronic device 100.

[0157] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0158] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0159] The user identification module (SIM) card interface 195 is used to connect the SIM card. The SIM card can be connected to and separated from the electronic device 100 by inserting the user identification module (SIM) card interface 195 or pulling it out from the SIM card interface 195. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The user identification module (SIM) card interface 195 can support Nano SIM card, Micro SIM card, SIM card, etc. The same user identification module (SIM) card interface 195 can be inserted with multiple cards at the same time. The types of the multiple cards can be the same or different. The user identification module (SIM) card interface 195 can also be compatible with different types of SIM cards. The user identification module (SIM) card interface 195 can also be compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0160] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0161] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the layered architecture as an example to exemplify the software structure of the electronic device 100. Figure 2 It is a software structure block diagram of an electronic device 100 provided in an embodiment of the present application.

[0162] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the electronic device 100 may include an application layer, an application framework layer, an Android runtime and a system library, and a kernel layer.

[0163] The application layer can include a series of application packages.

[0164] like Figure 2 As shown, the application layer may include applications such as camera, smart makeup box, makeup area layout display, makeup palette layout display, makeup mode switching control, curing and magnification control, makeup mirror fill light control, makeup extraction control, gallery, etc. Among them, the camera is used to control and manage the camera on the electronic device 100 to perform basic shooting and image processing; the smart makeup box is used to provide virtual makeup functions; the makeup palette layout display is used to control the layout of the makeup auxiliary information of the smart makeup box on the display screen; the makeup extraction control is used to analyze the collected user facial image and obtain makeup parameters; the makeup area layout display is used to simulate makeup processing on the user facial image to form a user facial makeup image; the makeup mode switching control is used to control the electronic device to switch the display mode; the curing and magnification control module is used to perform image curing display on the dynamic display content of the display interface of the makeup application, and is also used to control the electronic device to magnify the display content of the makeup application display interface. The makeup mirror fill light control is used to control the display of the fill light effect in the peripheral area of ​​the electronic device display screen. The gallery is used to manage and view images or videos stored on the electronic device 100.

[0165] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 2As shown, the application framework layer may include an event distribution management service, a power management service (powermanagerservice, PMS), a timing management service (alarm manager service, AMS), a window management service (windowmanager service, WMS), a content provider, a view system, a phone manager, a resource manager, a notification manager, etc., and the embodiment of the present application does not impose any restrictions on this. Among them, the event distribution management service is used to distribute events to applications. The power management service can be used to control the lighting or extinguishing of the screen of the electronic device 100. The timing management service is used to manage timers, alarms, etc. The window management service is used to manage window programs. The window management service can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data, and make these data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, the display interface including the SMS notification icon may include a view for displaying text and a view for displaying pictures. The phone manager is used to provide communication functions for the electronic device 100. For example, the management of call status (including connected, hung up, etc.). The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, the electronic device vibrates, the indicator light flashes, etc.

[0166] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system. The core library contains two parts: one is the function that the Java language needs to call, and the other is the Android core library.

[0167] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0168] The system library can include multiple functional modules, such as sensor services, surface manager, media libraries, gesture recognition engine, face recognition engine, graphics processing engine, graphics tracking engine, natural language recognition engine, etc.

[0169] The sensor service is used to store and process sensor-related data. For example, it provides the output data of each sensor and performs fusion processing on the output data of multiple sensors. The surface manager is used to manage the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The gesture recognition engine is used to process gesture recognition related processes. The face recognition engine is used to process face recognition related data and processes. The graphics processing engine is a drawing engine used for graphics and image processing. The graphics tracking engine is used to process graphics and image tracking related processes. The natural language recognition engine is used to support speech recognition, semantic recognition and other processes.

[0170] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0171] In an embodiment of the present application, the audio driver is used to upload the voice received by the microphone of the electronic device to the natural language recognition engine. The natural language recognition engine performs semantic recognition to determine the semantics of the acquired voice; generates corresponding events according to the semantics of the voice, and reports the events to the event distribution management service. For example, if the natural language recognition engine determines that the semantics of the voice is "switch makeup mode", it will generate a mode switching event; if it determines that the semantics of the voice is "fixed", it will generate a solidification event; if it determines that the semantics of the voice is "enlarge", it will generate a center amplification event; if it determines that the semantics of the voice is "enlarge the mouth", it will generate a tracking amplification event.

[0172] The camera driver is used to upload the user's facial image captured by the electronic device's camera to the face recognition engine. The face recognition engine recognizes the expression of the user's facial image; generates corresponding events based on the expression of the user's facial image, and reports the event to the event distribution management service. For example, if the face recognition engine determines that the expression obtained is a "smiley face", a solidified event is generated.

[0173] The camera driver can also be used to upload the user's hand image captured by the camera of the electronic device to the gesture recognition engine. The gesture recognition engine recognizes the gesture corresponding to the user's hand image; generates corresponding events based on the gesture of the user's hand image, and reports the events to the event distribution management service. For example, if the gesture recognition engine determines that the acquired gesture is a "heart gesture", it generates a solidification event; if it determines that the acquired gesture is a zoom gesture, it generates a center zoom event.

[0174] The sensor of the electronic device detects the user's operation on the screen and notifies the sensor service through the sensor driver. The sensor service determines the user's operation gesture on the screen, generates corresponding events according to the current process, and reports the event to the event distribution management service. For example, if the sensor service determines that it detects the user's right sliding operation on the screen, it generates a mode switching event; if it determines that it detects the user's tapping on the screen, it generates a center zoom event; if it determines that it detects the user's clicking on the zoom button, it generates a center zoom event; if it determines that it detects the user's double-finger expansion operation, it generates a tracking zoom event.

[0175] The event distribution management service distributes each event to the corresponding module of the application layer. For example, the mode switching event is distributed to the makeup mode switching control module; the solidification event, center magnification event, tracking magnification event, etc. are distributed to the solidification and magnification control module.

[0176] The above describes the hardware structure and software structure of the electronic device 100. Figure 3 The morphological structure of the folding screen of the electronic device 100 using the display method provided in the embodiment of the present application is introduced. The embodiment of the present application is introduced by taking an electronic device with a vertically folding folding screen as an example. It can be understood that in some other embodiments, the display method provided in the embodiment of the present application can also be applied to folding electronic devices with other folding methods (such as horizontal folding methods).

[0177] The electronic device 100 with a foldable screen can be folded along one or more folding axes. For example, see Figure 3 , Figure 3 This is an example diagram of the morphological structure of the folding screen of the electronic device 100 provided in the embodiment of the present application. Figure 3 As shown in (A) in the figure, the folding screen 31 of the electronic device 100 is unfolded to present a straight-bar state (also referred to as a straight-bar state, unfolded state). The folding screen 31 in the straight-bar state (i.e., the first state) can be used as a whole to display a user interface in the straight-bar state, for example, the first user interface can be displayed, so that the user can use the electronic device 100 in the straight-bar state. Furthermore, the user can fold the folding screen 31 of the electronic device 100 along the folding axis. Figure 3As shown in (B), when the user folds the folding screen 31 of the electronic device 100 along the folding axis MN, the folding screen 31 of the electronic device 100 is divided into two display screens along the folding axis MN, namely, the first screen 32 and the second screen 33. In the embodiment of the present application, the first screen 32 and the second screen 33 formed after folding can be displayed as two independent display screens. For example, the user interface displayed on the first screen 32 can be called the second user interface, and the user interface displayed on the second screen 33 can be called the third user interface. The second user interface and the third user interface are respectively located on both sides of the folding axis MN, and the areas of the second user interface and the third user interface can be the same or different. The first screen 32 and the second screen 33 may form an angle α. When the angle α is greater than or equal to the first preset angle and less than or equal to 180°, the folding screen 31 of the electronic device 100 still presents a straight board form (also called a straight board state, an unfolded state), which is the first form; when the angle α is greater than or equal to the second preset angle and less than the first preset angle, the folding screen 31 of the electronic device 100 bends to present a bracket form (also called a bracket state, a bent state), which is the second form; when the angle α is less than the second preset angle, the folding screen 31 of the electronic device 100 begins to present a folded form (also called a folded state, a closed state). Furthermore, the user can continue to fold the electronic device 100 along the folding axis MN, such as Figure 3 As shown in (C) in FIG. 1 , until the angle α between the first screen 32 and the second screen 33 is 0°, the folding screen 31 of the electronic device 100 is in a folded state (also called a folded state or a closed state).

[0178] It should be noted that the angle α between the first screen 32 and the second screen 33 can be in the range of 0° to 180°, and different angles of the angle α correspond to different forms of the electronic device 100. In some embodiments, when the angle α between the first screen 32 and the second screen 33 is any angle in the range from the first preset angle to 180° (including the first preset angle and 180°), the folding screen 31 of the electronic device 100 is in a straight plate form (also called a straight plate state, an unfolded state), that is, the first form. When the angle α between the first screen 32 and the second screen 33 is any angle in the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), and the second preset angle is less than the first preset angle, the folding screen 31 of the electronic device 100 is in a bracket form (also called a bracket state, a bent state), that is, the second form. When the included angle α between the first screen 32 and the second screen 33 is any angle within the range of 0° to a second preset angle (including 0° and excluding the second preset angle), the folding screen 31 of the electronic device 100 is in a folded state (also called a folded state or a closed state).

[0179] Among them, the first preset angle may be greater than or equal to 150° and less than 180°; the second preset angle may be greater than or equal to 10° and less than or equal to 15°. In some embodiments, the first preset angle may be 170°. The second preset angle may be 10°, which is not limited in the embodiments of the present application. It can be understood that when the folding screen 31 of the electronic device 100 is in the second form (also called the bracket state, the bent state), that is, when the angle α between the first screen 32 and the second screen 33 is in the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the electronic device 100 can be independently suspended on a plane without a bracket or user holding, which can free the user's hands and facilitate the user to operate the electronic device 100.

[0180] It should be noted that the first screen 32 and the second screen 33 may have other names, for example, the first screen 32 is called the A screen of the electronic device 100, and the second screen 33 is called the B screen of the electronic device 100; or, the first screen 32 is called the upper screen of the electronic device 100, and the second screen 33 is called the lower screen of the electronic device 100; the embodiment of the present application is not limited to this. In the embodiment of the present application, the two areas formed by folding the folding screen 31 along the folding axis MN are called the first screen and the second screen. It can be understood that the first screen and the second screen belong to different areas of the same folding screen. It can be understood that the folding axis in the embodiment of the present application is only for the convenience of understanding. The folding axis can also be called a folding belt or a dividing line or a dividing belt, etc., which is not limited in the embodiment of the present application.

[0181] For example, see Figure 4 , Figure 4 is an example flow chart of an image processing path provided by an embodiment of the present application. Figure 4As shown in the figure, after obtaining the original image, the bit depth (Bits Per Sample, BPS) of the original image is processed first. The bit depth of the original image determines the amount of color information contained in each pixel, so a higher bit depth can provide richer color details; then the original image is processed with High Dynamic Range (HDR), by merging images of different exposures to show a wider range of brightness. This helps to preserve the details in the image and provide a more natural visual effect under different lighting conditions. The original image is further converted from RAW format to YUV color space (also known as Raw2yuv processing), and this conversion is usually accompanied by processing such as de-mosaicing and noise reduction to improve the quality of the image. Then face super-resolution processing (also known as FaceSR) is performed, and the resolution of the face part is improved through image processing algorithms, thereby enhancing details and clarity, and then color correction and adjustment are performed through a three-dimensional lookup table (3DLUT) to adjust the color, contrast and other properties of the image to achieve a specific appearance effect. Furthermore, the image is beautified (also known as Beauty) by adjusting factors such as skin texture and smoothness through a beauty algorithm to enhance the appearance of the person's photo. The depth of field processing (also known as Bokeh) is further used to adjust the aperture size and lens focal length to blur the background of the image to highlight the subject. Then, the image is corrected for portrait distortion, and the deformation of the person caused by the camera lens is corrected through an algorithm to ensure that the proportion and appearance of the person in the image remain authentic. Finally, the image is encoded in JPEG format to reduce the size of the image file while maintaining a relatively high visual quality. It can be understood that the embodiment of the present application only exemplarily introduces a possible process of an image processing pathway. In some possible embodiments, the image processing process may also include other more / fewer steps, which are not limited by the embodiment of the present application.

[0182] Combined with the above description of the hardware structure and software structure of the electronic device 100, and Figure 3 The relevant description of the morphological structure of the folding screen of the electronic device 100 further introduces the display method provided in the embodiment of the present application.

[0183] For example, see Figure 5 , Figure 5 This is a flow chart of a display method provided in an embodiment of the present application. The method can be applied to the above Figure 1 The hardware structure of the electronic device 100 and Figure 2 The software structure of the electronic device 100, and Figure 3In the morphological structure of the folding screen of the electronic device 100 in the embodiment. Exemplarily, the electronic device 100 may include a folding screen 31 and a camera (which may be one or more front cameras or one or more rear cameras, which is not limited in the embodiment of the present application), and the folding screen 31 may be folded along the folding edge to form a first screen 32 and a second screen 33; the following description is carried out with the electronic device 100 as the execution subject.

[0184] Step S501: The folding screen in the first form displays a first user interface.

[0185] Specifically, the first user interface may include a system camera control, and the first form is a form in which the angle between the first screen and the second screen is in a range from a first preset angle to 180°. Exemplarily, when the folding screen 31 of the electronic device 100 is in a first form (also called a straight-plate form), that is, when the angle α between the first screen 32 and the second screen 33 is in a range from a first preset angle to 180° (including the first preset angle and 180°), the first user interface including the system camera control may be displayed.

[0186] Step S502: receiving a first operation acting on a system camera control.

[0187] Exemplarily, the electronic device receives an operation of a user clicking on a system camera control (i.e., a first operation), thereby starting the system camera. It is understandable that the first operation may also be other operation modes that can start the system camera application, such as the electronic device detecting a voice "open the system camera" or pressing one or more of the volume buttons, etc., which is not limited in the embodiments of the present application.

[0188] Step S503: In response to the first operation, start the system camera.

[0189] Specifically, in response to the operation of clicking the system camera control (ie, the first operation), the electronic device starts the system camera application, so that the electronic device can present the display interface of the system camera for the user to take pictures or perform virtual makeup.

[0190] Optionally, in response to the first operation, the folding screen in the first form displays a fourth user interface.

[0191] Specifically, the fourth user interface may include a second preview display area, and the second preview display area is used to display the user's facial image currently collected by the camera. Exemplarily, after receiving the first operation acting on the system camera control, the folding screen 31 in the first form (also called the straight state), that is, the folding screen 31 with the angle α between the first screen 32 and the second screen 33 in the range of the first preset angle to 180° (including the first preset angle and 180°), displays a fourth user interface including a second preview display area, and the second preview display area can be used to display the user's facial image currently collected by the camera. Therefore, the folding screen 31 in the straight state (that is, the first form) can present a straight state system camera interaction interface (that is, the fourth user interface), so that the user can preview the user's facial image currently collected by the camera in real time through the second preview display area, so as to view a real and natural selfie image in real time. In addition, since the area of ​​the second preview display area is significantly larger than the first preview display area, a larger visual area and better visual effects can be provided to the user, so as to enhance the user's experience of using the system camera in the straight state. Furthermore, users can independently choose whether to turn on the beauty and makeup function according to their preferences and needs (for example, operating the beauty and makeup controls of the fourth user interface or bending the folding screen inward to the second form), thereby improving the flexibility of users in using the beauty and makeup function and adapting to different social or photo-taking occasions.

[0192] It should be noted that when steps S502-S503 are performed when the folding screen is in the first form (also called the straight state), that is, when the angle between the first screen and the second screen is within the range of the first preset angle to 180° (including the first preset angle and 180°), and the electronic device maintains the first state for at least the first time (such as 1s), the folding screen in the first form in the embodiment of the present application will display the fourth user interface. In some embodiments, the first operation that can be used to start the system camera in steps S502-S503 can also be performed when the folding screen is in the second form (also called the bracket state), and the embodiment of the present application does not specifically limit this.

[0193] Step S504: Detect whether the folding screen is switched to the second form.

[0194] Specifically, the second form is a form in which the angle between the first screen and the second screen is within the range from the second preset angle to the first preset angle, and the second preset angle is smaller than the first preset angle. Exemplarily, after starting the system camera application, the electronic device 100 can detect the angle α between the first screen 32 and the second screen 33 through one or more sensors, and further determine whether the folding screen 31 is switched to the second form (also called the stand state) through the angle α, that is, the angle α between the first screen 32 and the second screen 33 is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), thereby determining whether to display a user interface that is more in line with the stand form to enhance the user experience.

[0195] In a possible implementation, the first preset angle is greater than or equal to 150° and less than 180°; the second preset angle is greater than or equal to 10° and less than or equal to 15°.

[0196] Specifically, the first preset angle can be any angle greater than or equal to 150° and less than 180 (for example, 170°); the second preset angle can be any angle greater than or equal to 10° and less than or equal to 15° (for example, 10°), so that the electronic device can accurately judge the shape of the folding screen of the current electronic device based on the angle between the first screen and the second screen of the folding screen, thereby presenting a user interface that is more in line with the user's operating habits to enhance the user experience. Exemplarily, when the electronic device 100 detects that the angle between the first screen 32 and the second screen 33 of the folding screen 31 is 175°, within the range of the first preset angle to 180° (including the first preset angle and 180°), it is determined that the folding screen 31 is in the first form (also called the straight state), and the folding screen 31 can present a larger user interface (such as the first user interface), which is convenient for the user to use the application of the electronic device in the straight state; accordingly, after the system camera is started, when the electronic device 100 detects that the angle between the first screen 32 and the second screen 33 of the folding screen 31 is 75°, within the range of the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), it is determined that the folding screen 31 is in the second form (also called the bracket state), and the first screen 32 and the second screen 33 of the folding screen 31 can present an application interface simulating a real makeup box in split screen, providing users with an interactive experience that is closer to the real makeup process, making it more convenient and quick for users to use the virtual makeup function to perform beauty operations, while enhancing the user's immersive experience during the virtual makeup process. It can be understood that the specific value of the angle between the first screen and the second screen used to determine the folding screen shape depends on the design choices and technical implementations of the mobile phone manufacturer. Therefore, the judgment criteria for different folding screen electronic devices may be different, and the embodiments of the present application do not make specific limitations on this.

[0197] Step S505: If yes, the first screen of the folding screen in the second form displays the second user interface, and the second screen displays the third user interface.

[0198] Specifically, the second user interface includes a first preview display area, the first preview display area is used to display a first user face makeup image generated based on the user face image currently captured by the camera, and the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of simulated makeup controls. In some embodiments, please refer to Figure 2 , the front camera of the electronic device collects the user's facial image, and the user's facial image is transmitted to the graphics processing engine through the camera driver. The graphics processing engine uses an augmented reality technology algorithm to simulate makeup processing on the user's facial image currently collected by the camera to form a user's facial makeup image (that is, the first user's facial makeup image), and at the same time, the smart makeup box module controls the user's facial makeup image to be displayed on the first screen. Exemplarily, when the electronic device 100 detects that the folding screen 31 is switched to the second form (also called the bracket state), the first screen 32 of the folding screen 31 in the second form displays a second user interface including a first preview display area, and the second screen 33 displays a third user interface including virtual makeup tools, thereby presenting an application interface that simulates a real makeup box, which can provide users with a new interactive experience to enhance the user's sense of ritual and immersive experience in the virtual makeup process.

[0199] In one possible implementation, the virtual makeup tool is used to adjust the virtual makeup effect of the first user's facial makeup image; the makeup control includes one or more of a color display control, a shape display control, and a color adjustment control; the color display control is used to preview the color of the corresponding virtual makeup, the shape display control is used to preview the corresponding makeup style, and the parameter adjustment control is used to adjust the corresponding makeup effect parameters.

[0200] Specifically, the virtual makeup tool can be used to adjust the virtual makeup effect of the first user's facial makeup image displayed in the first preview display area, so that the user can easily and quickly try different makeup without real makeup. Further, the virtual makeup tool includes a plurality of skeuomorphic makeup controls, each of which includes one or more of a color display control, a shape display control, and a color adjustment control. Among them, the color display control can be used to preview the color of the corresponding virtual makeup, so that the user can more intuitively preview the color of the corresponding virtual makeup (such as lipstick, eye shadow, blush, etc.), so that the user can choose the appropriate makeup color according to his or her preferences or occasions; the shape display control can be used to preview the corresponding makeup style, so that the user can see the style (such as the shape of the eye makeup, the shape of the lip makeup, etc.) of the corresponding virtual makeup (such as eye makeup, lip makeup, etc.) before adjustment, so that the user can choose the appropriate makeup style according to his or her preferences or occasions; the parameter adjustment control can be used to adjust the corresponding makeup effect parameters (such as parameters such as transparency), so that the user can make fine adjustments to the makeup effect to enhance the user's beauty experience during the virtual makeup process. Through the embodiments of the present application, users can preview and adjust the color, style and various parameters of makeup in real time through diversified makeup controls, so that users can more conveniently and flexibly find makeup that suits them during the virtual makeup process. While meeting the user's customized virtual makeup needs, it can also provide the user with a feeling that is closer to using real makeup tools to enhance the user's immersive virtual makeup experience.

[0201] In a possible implementation, the type of makeup control may include one or more of a lipstick control, an eyeshadow control, a blush control, an eyelash control, an eyebrow control, and a cosmetic contact lens control; wherein the color display control corresponding to the lipstick control is a lipstick icon control simulating the appearance of a lipstick, which is used to preview the lipstick color of the virtual makeup; the shape display control corresponding to the lipstick control is a lip makeup icon control simulating the shape of lip makeup, which is used to preview the lip makeup style of the virtual makeup; or, the color display control corresponding to the eyeshadow control is an eyeshadow icon control simulating the appearance of an eyeshadow palette, which is used to preview the eyeshadow color of the virtual makeup; the shape display control corresponding to the eyeshadow control is an eye makeup icon control simulating the shape of eye makeup, which is used to preview the eye makeup style of the virtual makeup; or, the color display control corresponding to the blush control is a blush icon control simulating the appearance of a blush palette, which is used to preview the blush color of the virtual makeup; the shape display control corresponding to the blush control is The control element is a blush makeup icon control simulating the shape of blush, which is used to preview the blush style of virtual makeup; or the color display control corresponding to the eyelash control is a mascara icon control simulating the appearance of mascara, which is used to preview the eyelash color of virtual makeup; the shape display control corresponding to the eyelash control is an eyelash icon control simulating the shape of eyelashes, which is used to preview the eyelash style of virtual makeup; or the color display control corresponding to the eyebrow control is an eyebrow pencil icon control simulating the appearance of an eyebrow pencil, which is used to preview the eyebrow color of virtual makeup; the shape display control corresponding to the eyebrow control is an eyebrow makeup icon control simulating the shape of eyebrows, which is used to preview the eyebrow style of virtual makeup; or the color display control corresponding to the beauty contact lens control is a beauty contact lens icon control simulating the appearance of beauty contact lenses, which is used to preview the beauty contact lens color of virtual makeup; the shape display control corresponding to the beauty contact lens control is a beauty contact lens makeup icon control simulating the shape of beauty contact lenses, which is used to preview the beauty contact lens style of virtual makeup.

[0202] Specifically, the type of makeup control may include one or more of lipstick control, eye shadow control, blush control, eyelash control, eyebrow control and contact lens control, so that users can select one or more of the controls to perform virtual makeup as needed, so as to flexibly customize their own makeup, meet the personalized needs of users for makeup, and provide users with an immersive beauty experience to enhance the user experience. Among them, the color display control corresponding to the lipstick control can be a lipstick icon control that simulates the appearance of lipstick, which is used to preview the lipstick color of virtual makeup, so that users can preview the colors of different lipsticks more intuitively, so as to more conveniently and quickly select the appropriate lipstick color according to their preferences or makeup style, and can bring users an immersive experience closer to using real lipstick to make lip makeup; the shape display control corresponding to the lipstick control can be a lip makeup icon control that simulates the shape of lip makeup, which is used to preview the lip makeup style of virtual makeup, so that users can know the style of lip makeup (such as lip makeup shape) in advance before adjusting, so that users can easily try different lip makeup styles and select the most suitable lipstick color and style to achieve a satisfactory makeup effect.

[0203] Alternatively, the color display control corresponding to the eye shadow control may be an eye shadow icon control that simulates the appearance of an eye shadow palette, for previewing the eye shadow colors of virtual makeup, allowing users to preview different eye shadow colors more intuitively, and thus more conveniently and quickly select appropriate eye shadow colors according to their preferences or makeup style, while providing users with an immersive experience closer to using a real eye shadow palette to apply eye makeup; the shape display control corresponding to the eye shadow control may be an eye makeup icon control that simulates the shape of eye makeup, for previewing the eye makeup style of virtual makeup, allowing users to understand the style of eye makeup (such as the shape of eye shadow, etc.) in advance before adjusting it, so that users can easily try different styles of eye makeup styles and select the most appropriate eye shadow color and style to achieve a satisfactory makeup effect.

[0204] Alternatively, the color display control corresponding to the blush control can be a blush icon control that simulates the appearance of a blush palette, which is used to preview the blush color of virtual makeup, allowing users to preview different blush colors more intuitively, and thus choose the appropriate blush color more conveniently and quickly according to their preferences or makeup style, while giving users an immersive experience closer to using a real blush palette to apply blush makeup; the shape display control corresponding to the blush control can be a blush makeup icon control that simulates the shape of the blush, which is used to preview the blush style of virtual makeup, allowing users to understand the style of the blush makeup (such as the shape of the blush, etc.) in advance before adjusting it, so that users can easily try different styles of blush makeup and choose the most suitable blush color and style to achieve a satisfactory makeup effect.

[0205] Alternatively, the color display control corresponding to the eyelash control may be a mascara icon control that simulates the appearance of mascara, for previewing the eyelash color of virtual makeup, allowing the user to preview the colors of different mascaras more intuitively, and thus more conveniently and quickly select a suitable eyelash color according to their preferences or makeup style, while providing the user with an immersive experience closer to applying eyelashes with real mascara; the shape display control corresponding to the eyelash control may be an eyelash icon control that simulates the shape of eyelashes, for previewing the eyelash style of virtual makeup, allowing the user to understand the style of the eyelashes (e.g., the shape of the eyelashes, etc.) in advance before adjusting them, so that the user can easily try different styles of eyelash styles and select the most suitable eyelash color and style to achieve a satisfactory makeup effect.

[0206] Alternatively, the color display control corresponding to the eyebrow control may be an eyebrow pencil icon control that simulates the appearance of an eyebrow pencil, for previewing the eyebrow color of virtual makeup, allowing the user to preview the colors of different eyebrow pencils more intuitively, and thus more conveniently and quickly select the appropriate eyebrow pencil color according to their preferences or makeup style, while giving the user an immersive experience closer to using a real eyebrow pencil to draw their eyebrows; the shape display control corresponding to the eyebrow control may be an eyebrow makeup icon control that simulates the shape of the eyebrows, for previewing the eyebrow style of virtual makeup, allowing the user to understand the style of the eyebrows (such as the shape of the eyebrows, etc.) in advance before adjusting them, so that the user can easily try different styles of eyebrow styles and select the most appropriate eyebrow color and style to achieve a satisfactory makeup effect.

[0207] Alternatively, the color display control corresponding to the contact lens control can be a contact lens icon control that simulates the appearance of contact lenses, which is used to preview the contact lens colors of virtual makeup, allowing users to preview different contact lens colors more intuitively, and thus choose suitable contact lens colors more conveniently and quickly according to their preferences or makeup style, while giving users an immersive experience closer to using real contact lenses; the shape display control corresponding to the contact lens control can be a contact lens makeup icon control that simulates the shape of contact lenses, which is used to preview the contact lens styles of virtual makeup, allowing users to understand the styles of contact lenses (such as the colors of contact lenses, etc.) in advance before adjusting them, so that users can easily try different styles of contact lenses and choose the most suitable contact lens color and style to achieve a satisfactory makeup effect.

[0208] Optionally, the second screen of the folding screen in the second form displays a fifth user interface, wherein the fifth user interface includes custom makeup controls; receives a fifth operation for the custom makeup controls; and in response to the fifth operation, the second screen displays the third user interface.

[0209] Specifically, the folding screen 31 of the electronic device is in the second form (also called the support state), that is, when the angle between the first screen 32 and the second screen 33 is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the second screen 33 displays the fifth user interface including the custom makeup control; further, after the electronic device receives the fifth operation for the custom makeup control, the second screen 33 displays the third user interface including the virtual makeup tool. Through the embodiment of the present application, when the folding screen 31 is in the second form (also called the support state), the user can use the custom makeup control in the second screen 33 to make the second screen 33 of the folding screen 31 display the third user interface including the virtual makeup tool, thereby simplifying the cumbersome operation process and improving efficiency. At the same time, the user can also adjust and set the custom makeup parameters more conveniently and quickly through the skeuomorphic interactive interface that simulates the real makeup box, so as to enhance the user's experience of setting personalized makeup in the virtual makeup process.

[0210] Step S506: receiving a second operation acting on the first target makeup control.

[0211] Exemplarily, the electronic device 100 receives an operation (i.e., the first operation) of a user clicking on a first target makeup control (e.g., a lipstick control) to adjust the corresponding makeup effect. It is understandable that the second operation may also be other operation modes acting on the first target makeup control, such as the electronic device detecting a voice "switch the lipstick to orange", or the user's finger hovering above the camera to draw one or more of the first graphics, etc., which is not limited in the embodiments of the present application.

[0212] Step S507: in response to the second operation, the makeup-wearing facial image of the first user displayed in the first preview display area is updated based on the makeup effect parameter corresponding to the first target makeup control.

[0213] Exemplarily, after the electronic device 100 receives the second operation acting on the first target makeup control (such as a lipstick control), in response to the second operation, the first user's facial makeup image displayed in the first preview display area is updated based on the makeup effect parameters corresponding to the first target makeup control, so that the user can preview the latest adjusted makeup effect in real time through the first preview display area during the virtual makeup process, so that the user can more conveniently and quickly select and adjust the makeup effect according to personal preferences. At the same time, a new interactive service with a stronger sense of ritual is provided to the user, providing the user with a feeling closer to the actual makeup process, thereby enhancing the user's immersive beauty experience during the virtual makeup process.

[0214] Optionally, the electronic device can also receive a fourth operation acting on a target part in the makeup-wearing image of the first user's face, the fourth operation comprising an outward expansion operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen; in response to the fourth operation, the first preview display area displays an enlarged makeup-wearing image of the target part.

[0215] For example, the electronic device 100 can receive a user's double-finger expansion operation on the first screen 32 or a double-click operation on the first screen (i.e., the fourth operation) for a target part in the first user's facial makeup image, and display the enlarged image of the target part with makeup in the first preview display area of ​​the second user interface displayed on the first screen 32, so that the user can select the target part of interest or need to be adjusted through gesture operation, and quickly and accurately view the enlarged image of the target part with makeup, and realize real-time preview of the adjustment effect of the makeup effect of the target part, which helps the user to view the makeup details when fine-tuning the makeup, so as to adjust the virtual makeup effect more intuitively and efficiently, so as to enhance the user's experience. It should be noted that the fourth operation can also be other operations acting on the target part in the first user's facial makeup image, which is not limited in the embodiments of the present application.

[0216] Optionally, if it is detected that the target part in the user facial image is blocked by a target object, the target part in the first user facial makeup image displays the image of the target object.

[0217] Exemplarily, when the electronic device 100 detects that a target part in the user's facial image is blocked by an object, the target part in the first preview display area displayed in the first user's facial makeup image displays the image of the target object, so that during the user's virtual makeup process, the part of the first user's facial makeup image previewed in the first preview display area that is blocked by the target object will not show the virtual makeup effect, thereby improving the realism of the virtual makeup and enhancing the user's sense of reality and immersive experience in the virtual makeup process; at the same time, the part of the first user's facial makeup image that is not blocked by the target object will not lose the preview effect of the overall makeup, so that the user's virtual makeup process will not be affected when part of the face is blocked, thereby improving the user's experience in the virtual makeup process.

[0218] Optionally, the third user interface also includes a shooting control; receiving a third operation acting on the shooting control; and in response to the third operation, saving the makeup-wearing facial image of the first user currently displayed in the first preview display area.

[0219] Exemplarily, when the folding screen 31 of the electronic device is in the second form (also called the stand form), that is, the angle α between the first screen 32 and the second screen 33 is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the third user interface displayed by the second screen 33 of the folding screen 31 also includes a shooting control. Further, after receiving the third operation acting on the shooting control, the electronic device can save the makeup image of the first user's face currently displayed in the first preview display area (that is, the first preview display area in the second user interface displayed by the first screen 32 of the folding screen), so that the user can timely capture and save a satisfactory image during the virtual makeup process, and can also further edit and adjust the saved image later to enhance the user's experience. In addition, compared with the smart makeup box application that relies on the design of the application side in the prior art, it is subject to the permission control of the operating system or the device manufacturer, and may need to open the corresponding interface and / or permission to obtain the relevant data of the folding screen status. Therefore, it is impossible to obtain the same control authority of the camera, sensor and other hardware as the system camera application, which makes it difficult to achieve the same response speed and performance as the system camera. The embodiment of the present application is a folding makeup box experience upgraded based on the beauty and makeup characteristics of the system camera. Therefore, through the embodiment of the present application, the user does not need to install or switch to other applications to achieve the effect of virtual makeup. At the same time, the system camera has the permission and ability to directly obtain the folding screen state parameters. The hardware and software on the electronic device can be better compatible. When the folding screen is converted to the stand state (that is, the second form), a faster response speed can be achieved, and a simulated interactive interface adapted to the stand state folding screen can be presented more efficiently. At the same time, the camera, sensor and image processing engine of the electronic device can be more fully utilized, reducing the shooting delay while providing more efficient and higher-quality beauty effects, thereby enhancing the user's beauty experience.

[0220] Optionally, the third user interface may also include a makeup saving control; receive a sixth operation for the makeup saving control; and in response to the sixth operation, save the makeup effect parameters corresponding to the first user's facial makeup image currently displayed in the first preview display area as the target custom makeup.

[0221] Specifically, the third user interface including the virtual makeup tool displayed on the second screen of the folding screen may also include a makeup saving control. Exemplarily, when the electronic device 100 receives the sixth operation for the makeup saving control, the makeup effect parameters corresponding to the makeup image of the first user's face currently displayed in the first preview display area (that is, the first preview display area in the second user interface displayed on the first screen 32 of the folding screen 31) may be saved as the target custom makeup, so that the user can use the makeup saving control to retain the makeup effect parameters corresponding to the current favorite makeup during the virtual makeup process as the target custom makeup, so that the user can quickly apply the pre-set makeup effect when he needs to experience the same makeup effect next time, thereby meeting the user's needs for customized makeup and improving the user's experience.

[0222] For example, see Figure 6 , Figure 6 This is a flowchart of another display method provided in an embodiment of the present application, which can be applied to the above Figure 1 The hardware structure of the electronic device 100 and Figure 2 The software structure of the electronic device 100, and Figure 3 In the morphological structure of the folding screen of the electronic device 100. Exemplarily, the electronic device 100 includes a folding screen 31 and a camera (which may be one or more front cameras or one or more rear cameras, which is not limited in the embodiment of the present application), and the folding screen 31 can be folded along the folding edge to form a first screen 32 and a second screen 33; the method may specifically include the following steps S601-S618.

[0223] Step S601: The folding screen in the first form displays a first user interface.

[0224] For a detailed description of steps S601 to S603, please refer to the above Figure 5 The description of steps S501 to S503 in the above description will not be repeated here. The first user interface may include a system camera control, and the first form is a form in which the angle between the first screen and the second screen is within a range from a first preset angle to 180 degrees.

[0225] For example, Fig. 7A Schematic diagram of a user interface of an electronic device using a display method provided in an embodiment of the present application. Fig. 7AAs shown, the user opens the folding screen 31 of the electronic device in the first form (also called the straight plate form) (that is, the angle between the first screen and the second screen is in the range of the first preset angle to 180°, which may include the first preset angle and 180°), so that the folding screen 31 of the electronic device displays the user interface 71 (that is, the first user interface), which can also be called the desktop of the electronic device. In the user interface 71, at least one application icon may be included, for example, weather, calendar, mail, settings, application store, camera 7011 (that is, system camera control), gallery 7012, phone, information, contacts, etc. Among them, the application icon and the name and position of the corresponding application can be adjusted according to the user's preferences, and the embodiment of the present application is not limited to this.

[0226] It should be noted that Fig. 7A The interface diagram of the electronic device shown is an exemplary display of the embodiment of the present application. The interface diagram of the electronic device may also be in other styles, and the embodiment of the present application is not limited to this.

[0227] Step S602: receiving a first operation acting on a system camera control.

[0228] Step S603: In response to the first operation, start the system camera.

[0229] Step S604: In response to the first operation, the folding screen in the first form displays a fourth user interface.

[0230] Among them, the fourth user interface may include a second preview display area, and the second preview display area is used to display the user's facial image currently captured by the camera.

[0231] For a detailed description of step S604, please refer to the above Figure 5 The relevant description of step S503 in will not be repeated here.

[0232] For example, see Figure 7B , Figure 7B is a user interface diagram of an electronic device using an application display method provided in an embodiment of the present application. The electronic device can respond to a user clicking on Fig. 7A The camera 7011 control in the folding screen 31 is operated (that is, the first operation), the system camera is started, and the folding screen 31 is displayed as follows Figure 7BThe user interface 72 shown (also known as the fourth user interface). A preview display box 702 and at least one interactive control (such as a shooting control, a camera conversion control, an album control, etc.) are displayed in the user interface 72, wherein the preview display box 702 can display the user's facial image currently captured by the camera of the electronic device. In addition to the above interactive controls, the user interface 72 may also include controls such as "beautification" and "beauty" 7021, wherein the "beautification" control is used to turn on the beauty mode, so that the preview display box 702 can display the user's facial beauty image generated based on the user's facial image currently captured by the camera; the "beauty" 7021 control is used to turn on the beauty mode, so that the preview display box 702 can display the user's facial makeup image generated based on the user's facial image currently captured by the camera (that is, the first user's facial makeup image). At the same time, the user interface 72 can also display some controls for adjusting the makeup effect of the user's facial makeup image, such as recommended makeup controls of different styles such as clear, Japanese, and Hong Kong style, and corresponding parameter adjustment controls for adjusting the overall makeup effect, as well as custom makeup controls, etc. It should be noted that Figure 7B The user interface, interactive controls, and operation methods described are merely exemplary and not limiting. In other embodiments, the user interface and / or interactive controls may also present other styles, and their specific functions and quantities are not limited.

[0233] Step S605: Detect whether the folding screen is switched to the second form.

[0234] Among them, the second form is a form in which the angle between the first screen and the second screen is within the range of the second preset angle to the first preset angle, and the second preset angle is smaller than the first preset angle.

[0235] Step S606: If yes, the first screen of the foldable screen in the second state displays the second user interface.

[0236] Among them, the second user interface includes a first preview display area, and the first preview display area is used to display a first user facial makeup image generated based on the user facial image currently captured by the camera.

[0237] Step S607: the second screen of the folding screen in the second form displays a fifth user interface.

[0238] Wherein, the fifth user interface includes custom makeup controls.

[0239] For example, see Figure 7C , Figure 7C1 is a user interface diagram of an electronic device using a display method provided in an embodiment of the present application. After the system camera is started, when the electronic device detects that the folding screen 31 is in the second state (also called the stand state), that is, when the angle α between the first screen 32 and the second screen 33 is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 can be displayed as follows: Figure 7C The user interface 74 (also known as the second user interface) shown in FIG. 1 may display the following information on the second screen: Figure 7C The user interface 75 (also the fifth user interface) shown in FIG. 7 is a user interface 74 (also the second user interface). The user interface 74 (also the second user interface) includes a preview box 704 (also the first preview display area), which can display a user's facial makeup image generated based on the user's facial image currently captured by the camera; the user interface 75 (also the fifth user interface) can display at least one control for adjusting the makeup effect of the user's facial makeup image, such as recommended makeup controls of different styles such as "clear", "Japanese", and "Hong Kong style" and corresponding parameter adjustment controls for adjusting the overall makeup effect, as well as a custom makeup control 7051. When the user completes the setting through the custom makeup control 7051 and chooses to save the custom makeup, the user interface 75 (also the fifth user interface) can also display the custom makeup control corresponding to the custom makeup saved by the user, so that the preview box 704 in the user interface 74 (also the second user interface) can display the user's facial custom makeup image generated based on the makeup effect parameters corresponding to the custom makeup control. It should be noted that the embodiment of the present application only exemplarily introduces an exemplary display of a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device may also be in other styles and may include more / fewer interactive controls, which is not limited by the embodiment of the present application.

[0240] Step S608: receiving a fifth operation for the customized makeup control.

[0241] Step S609: In response to the fifth operation, the second screen displays the third user interface.

[0242] Among them, the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of simulated makeup controls.

[0243] For example, see Figure 8A-8F , Figure 8A-8F 1 is a user interface diagram of a virtual makeup box that may be presented when the folding screen of some electronic devices provided in the embodiment of the present application is in the second form. Figure 8A-8FThe user interface diagram of the electronic device shown is only an exemplary display of an embodiment of the present application. The interface diagram of the electronic device may also be in other styles. The number and specific functions of the controls displayed in the above user interface are merely exemplary descriptions and do not constitute a specific limitation on the display method provided in the embodiment of the present application.

[0244] For example, see Fig. 8A , Fig. 8A A user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is a lipstick control. Fig. 8A As shown, the electronic device can respond to the user clicking Figure 7C , and the currently selected virtual makeup tool skeuomorphic makeup control is a lipstick control, the folding screen 31 is in the second form (also called the stand form), that is, the angle α between the first screen 32 and the second screen 33 is in the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 displays the user interface 81 (also the second user interface), and the second screen 33 displays the user interface 82 (also the third user interface). Among them, the user interface 81 includes a display frame 801 (also the first preview display area), which can be used to display the first user face makeup image generated based on the user face image currently captured by the camera; the user interface 82 includes a plurality of skeuomorphic lipstick controls, which may include but are not limited to one or more of a color display control, a shape display control, and a color adjustment control. Exemplarily, the lipstick icon control 8021 that simulates the appearance of a bean paste pink lipstick is one of the color display controls of the lipstick control, which can be used to preview the color of the lipstick for virtual makeup, allowing users to preview the color of the lipstick for virtual makeup more intuitively, so that they can choose the appropriate lipstick color more conveniently and quickly according to their own preferences or makeup style, while giving users an immersive experience closer to using real lipstick to apply lip makeup; the lip makeup icon control 8031 ​​that simulates the shape of bitten lip makeup is one of the shape display controls of the lipstick control, which can be used to preview the lip makeup style (such as lip makeup shape) of virtual makeup, so that users can easily try different lip makeup styles and choose the most suitable lipstick color and style to achieve a satisfactory makeup effect; the parameter adjustment control 8041 can be used to adjust the makeup effect parameters (such as parameters such as transparency) corresponding to the lipstick control selected by the user, so that users can make fine adjustments to the lip makeup effect to enhance the user's beauty experience during the virtual makeup process.

[0245] For example, see Figure 8B , Figure 8B A user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is an eye shadow control. Figure 8B As shown, the electronic device can respond to the user clicking Figure 7C , and the currently selected virtual makeup tool in the virtual makeup tool is an eye shadow control, the folding screen 31 is in the second form (also called the stand form), that is, the angle between the first screen 32 and the second screen 33 is in the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 displays the user interface 81 (also the second user interface), and the second screen 33 displays the user interface 83 (also the third user interface). Among them, the user interface 81 includes a display frame 801 (also the first preview display area), which can be used to display the first user face makeup image generated based on the user face image currently captured by the camera; the user interface 83 includes a plurality of skeuomorphic eye shadow controls, which may include but are not limited to one or more of a color display control, a shape display control, and a color adjustment control. Exemplarily, the eyeshadow icon control 8051 that simulates the appearance of a brown eyeshadow palette is one of the color display controls of the eyeshadow control, which can be used to preview the eyeshadow color of virtual makeup, allowing users to preview the color of the eyeshadow of virtual makeup more intuitively, so that they can more conveniently and quickly choose the appropriate eyeshadow color number according to their own preferences or makeup style, while giving users an immersive experience closer to using a real eyeshadow palette to apply eye makeup; the eye makeup icon control 8061 that simulates the shape of deep eye makeup is one of the shape display controls of the eyeshadow control, which can be used to preview the eye makeup style of virtual makeup (such as deep eye makeup), so that users can easily try different eye makeup styles and choose the most suitable eyeshadow color and style to achieve a satisfactory makeup effect; the parameter adjustment control 8071 can be used to adjust the makeup effect parameters (such as parameters such as transparency) corresponding to the eye shadow control selected by the user, so that users can make fine adjustments to the eye makeup effect to enhance the user's beauty experience during the virtual makeup process.

[0246] For example, see Figure 8C , Figure 8C A user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is a blush control. Figure 8C As shown, the electronic device can respond to the user clicking Figure 7C, and the currently selected virtual makeup tool in the virtual makeup tool is a blush control. The folding screen 31 is an electronic device in the second form (also called the stand form), that is, the angle between the first screen 32 and the second screen 33 is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle). The first screen 32 displays the user interface 81 (also the second user interface), and the second screen 33 displays the user interface 84 (also the third user interface). The user interface 81 includes a display frame 801 (also the first preview display area), which can be used to display the first user's facial makeup image generated based on the user's facial image currently captured by the camera; the user interface 84 includes a plurality of skeuomorphic blush controls, which may include but are not limited to one or more of a color display control, a shape display control, and a color adjustment control. Exemplarily, the blush icon control 8081 simulating the appearance of an apricot blush palette is one of the color display controls of the blush control, which can be used to preview the blush color of virtual makeup, allowing users to preview the color of the blush of virtual makeup more intuitively, so that they can choose the appropriate blush color number more conveniently and quickly according to their preferences or makeup style, while giving users an immersive experience closer to using a real blush palette to apply blush makeup; the blush makeup icon control 8091 simulating the shape of sunburn blush makeup is one of the shape display controls of the blush control, which can be used to preview the blush makeup style of virtual makeup (such as sunburn-shaped blush makeup), so that users can easily try different blush makeup styles and choose the most suitable blush color and style to achieve a satisfactory makeup effect; the parameter adjustment control 8101 can be used to adjust the makeup effect parameters (such as parameters such as transparency) corresponding to the blush control selected by the user, so that users can make fine adjustments to the blush makeup effect to enhance the user's beauty experience during the virtual makeup process.

[0247] For example, see Fig.8D , Fig.8D A user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is an eyelash control. Fig.8D As shown, the electronic device can respond to the user clicking Figure 7C, and the currently selected virtual makeup tool is an eyelash control, the folding screen 31 is an electronic device in the second form (also called the stand state), that is, the angle between the first screen 32 and the second screen 33 is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 displays the user interface 81 (also the second user interface), and the second screen 33 displays the user interface 85 (also the third user interface). The user interface 81 includes a display frame 801 (also the first preview display area), which can be used to display the first user face makeup image generated based on the user face image currently captured by the camera; the user interface 85 includes a plurality of skeuomorphic eyelash controls, which can include but are not limited to one or more of a color display control, a shape display control, and a color adjustment control. Exemplarily, the mascara icon control 8111 simulating the appearance of black mascara is one of the color display controls of the eyelash control, which can be used to preview the mascara color of virtual makeup, so that the user can preview the color of the eyelashes of virtual makeup more intuitively, so that according to their own preferences or makeup style, they can more conveniently and quickly choose the appropriate eyelash color, while giving the user an immersive experience closer to using real mascara to make up; the eyelash icon control 8121 simulating the shape of natural eyelashes is one of the shape display controls of the eyelash control, which can be used to preview the eyelash style of virtual makeup (such as natural eyelash style), so that the user can easily try different eyelash styles and choose the most suitable eyelash color and style to achieve a satisfactory makeup effect; the parameter adjustment control 8131 can be used to adjust the makeup effect parameters (such as parameters such as transparency) corresponding to the eyelash control selected by the user, so that the user can make fine adjustments to the eyelash effect to enhance the user's beauty experience during the virtual makeup process.

[0248] For example, see Fig. 8E , Fig. 8E A user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is an eyebrow control. Fig. 8E As shown, the electronic device can respond to the user clicking Figure 7C, and the currently selected virtual makeup tool in the virtual makeup tool is an eyebrow control, the folding screen 31 is in the second form (also called the support state), that is, the angle between the first screen 32 and the second screen 33 is in the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 displays the user interface 81 (also the second user interface), and the second screen 33 displays the user interface 86 (also the third user interface). Among them, the user interface 81 includes a display frame 801 (also the first preview display area), which can be used to display the first user face makeup image generated based on the user face image currently captured by the camera; the user interface 86 includes a plurality of skeuomorphic eyebrow controls, which may include but are not limited to one or more of a color display control, a shape display control, and a color adjustment control. Exemplarily, the eyebrow pencil icon control 8141 that simulates the appearance of a gray eyebrow pencil is one of the color display controls of the eyebrow control, which can be used to preview the eyebrow pencil color of virtual makeup, allowing users to preview the color of the eyebrows of virtual makeup more intuitively, so that they can choose the appropriate eyebrow color more conveniently and quickly according to their own preferences or makeup style, while giving users an immersive experience closer to using a real eyebrow pencil for makeup; the eyebrow makeup icon control 8151 that simulates the shape of wild eyebrows is one of the shape display controls of the eyebrow control, which can be used to preview the eyebrow styles of virtual makeup (such as eyebrow makeup styles with wild eyebrow shapes), so that users can easily try different eyebrow styles and choose the most suitable eyebrow color and style to achieve a satisfactory makeup effect; the parameter adjustment control 8161 can be used to adjust the makeup effect parameters (such as parameters such as transparency) corresponding to the eyebrow control selected by the user, so that users can make fine adjustments to the eyebrow makeup effect to enhance the user's beauty experience during the virtual makeup process.

[0249] For example, see Figure 8F , Figure 8F A user interface diagram of a virtual makeup box provided in an embodiment of the present application, in which the makeup control is a cosmetic contact lens control. Figure 8F As shown, the electronic device can respond to the user clicking Figure 7C, and the currently selected virtual makeup tool in the virtual makeup tool is a beauty contact lens control, the folding screen 31 is an electronic device in the second form (also called the stand state), that is, the angle between the first screen 32 and the second screen 33 is within the range of the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 displays the user interface 81 (also the second user interface), and the second screen 33 displays the user interface 87 (also the third user interface). Among them, the user interface 81 includes a display frame 801 (also the first preview display area), which can be used to display the first user face makeup image generated based on the user face image currently captured by the camera; the user interface 87 includes a plurality of skeuomorphic beauty contact lens controls, which may include but are not limited to one or more of a color display control, a shape display control, and a color adjustment control. Exemplarily, the contact lens icon control 8171 that simulates the appearance of brown contact lenses is one of the color display controls of the contact lens control, which can be used to preview the contact lens color of virtual makeup, allowing users to preview the contact lens color of virtual makeup more intuitively, so that they can choose the appropriate contact lens color more conveniently and quickly according to their preferences or makeup style, while giving users an immersive experience closer to using real contact lens makeup; the contact lens makeup icon control 8181 that simulates the shape of large-diameter contact lenses is one of the form display controls of the contact lens control, which can be used to preview the contact lens style of virtual makeup (such as the contact lens style of large-diameter contact lens shape), so that users can easily try different contact lens styles and choose the most suitable contact lens color and style to achieve a satisfactory makeup effect; the parameter adjustment control 8191 can be used to adjust the makeup effect parameters (such as parameters such as transparency) corresponding to the contact lens control selected by the user, so that users can make fine adjustments to the contact lens makeup effect to enhance the user's makeup experience during virtual makeup.

[0250] For a detailed description of step S605, please refer to the above Figure 5 For detailed description of step S606-step S609, please refer to the above Figure 5 The relevant description of step S505 in the embodiment of the present application will not be repeated here. It should be noted that the steps of how to set a custom makeup when the electronic device detects that the folding screen is in the second form (also called the stand state) described in steps S606 to S609 in the embodiment of the present application are only the above Figure 5 A possible implementation of step S505 in the embodiment may also include more or fewer user interfaces in some possible embodiments, which is not limited in the embodiments of the present application.

[0251] Step S610: receiving a second operation acting on the first target makeup control.

[0252] Step S611: in response to the second operation, the makeup-wearing facial image of the first user displayed in the first preview display area is updated based on the makeup effect parameters corresponding to the first target makeup control.

[0253] For a detailed description of steps S610 and S611, please refer to the above Figure 5 The relevant descriptions of steps S506 to S507 in will not be repeated here.

[0254] For example, Fig.9A 3 is a user interface diagram of an electronic device using a display method provided in an embodiment of the present application. When a user clicks on a simulated makeup control in the user interface 85 (i.e., the third user interface) of the second screen 33, such as the mascara icon control 8111 (i.e., the first target makeup control) simulating the appearance of black mascara in the "eyelashes" module 8020, in response to the operation (i.e., the second operation), Fig.9A As shown, the display frame 801 (that is, the first preview display area) in the user interface 81 of the first screen 32 can update the corresponding user face makeup image in real time based on the makeup effect parameters corresponding to the mascara icon control 8111 (that is, the first target makeup control). Since the mascara icon control 8111 is a color display control that simulates the shape of black mascara, the updated user face makeup image 9001 displayed in the display frame 801 (that is, the first preview display area) is the user face makeup image with the black eyelash makeup effect added. Optionally, the electronic device may also receive an operation (i.e., a second operation) of a user clicking on a makeup control such as an eyelash shape display control or a parameter adjustment control (e.g., an eyelash icon control 8121 or a parameter adjustment control 8041 that simulates the shape of natural eyelashes) in the user interface 82 of the second screen 33, so that the display frame 801 (i.e., the first preview display area) in the user interface 81 of the first screen 32 may display a corresponding makeup effect parameter corresponding to the corresponding makeup control (e.g., the eyelash icon control 8121 or the parameter adjustment control 8131) to update the corresponding user's facial makeup image in real time, so as to finely adjust the eyelash effect (e.g., eyelash shape, color depth, etc.). It is understandable that the user may also adjust the makeup effect of the user's facial makeup image displayed in the display frame 801 (i.e., the first preview display area) in the user interface 81 of the first screen 32 through other simulated makeup controls (e.g., makeup controls in different modules such as "eye shadow", "blush", and "lipstick") in the user interface 82 of the second screen 33 (i.e., the third user interface), which will not be described in detail here. The embodiment of the present application only exemplarily introduces a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device may also be in other styles and may include more / fewer makeup controls, which is not limited by the embodiment of the present application.

[0255] Step S612: receiving a fourth operation acting on a target part in the makeup-wearing face image of the first user.

[0256] The fourth operation may include an expansion operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen. It should be noted that the fourth operation may also be other operations acting on the target part of the first user's face in the makeup-wearing image, which is not limited in the embodiment of the present application.

[0257] Step S613: In response to the fourth operation, the first preview display area displays the enlarged image of the target part with makeup.

[0258] For example, see Fig. 9B , Fig. 9B : This is a user interface diagram of an electronic device that uses a display method provided in an embodiment of the present application. The first screen 32 of the electronic device displays a user interface 81 including a display frame 801 (i.e., a first preview display area). When the electronic device receives a double-click operation of a finger on the first screen or an outward expansion operation of two fingers on the first screen (i.e., a fourth operation) for the first part (e.g., the left eye) of the user's facial makeup image (i.e., the first user's facial makeup image) displayed in the display frame 801, in response to the operation, the display frame 801 in the first screen 32 (i.e., the first preview display area) can dynamically display the first part (e.g., the eye) with makeup enlarged image 9002, so that the user can carefully check the simulated makeup effect. In some embodiments, the electronic device enlarges the target part of the user's facial makeup image in a central magnification manner, so that the enlarged image 9002 of the target part is located in the display center. In addition, the magnification of the enlarged image 9002 of the target part increases with the degree of the user's double-finger outward expansion, and the embodiment of the present application is not limited to this. It will be understood that the embodiment of the present application merely exemplarily introduces a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device may be in other styles and may include more / fewer makeup controls, which is not limited in the embodiment of the present application.

[0259] Step S614: If it is detected that the target part in the user's facial image is blocked by a target object, the target part in the first user's facial makeup image displays the image of the target object.

[0260] For example, see Fig. 9C , Fig. 9C Schematic diagram of a user interface of an electronic device using a display method provided in an embodiment of the present application. Fig. 9CAs shown, in the user interface 81 displayed on the first screen 32 of the electronic device, the user's facial image in the display frame 801 (that is, the first preview display area) is partially blocked by an object (such as a mask). The electronic device performs simulated makeup processing on the part of the user's facial image that is not blocked by the object (such as a mask) to form a user's facial image 9003. Fig. 9C As shown, the user's facial image 9003 in the display frame 801 (that is, the first preview display area) only displays the simulated makeup effect in the unobstructed part, and the simulated makeup effect will not appear on the obstructed object, giving the user an immersive virtual makeup experience. It can be understood that the embodiment of the present application only exemplarily introduces a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device can also be in other styles and can also include more / fewer controls, which is not limited in the embodiment of the present application.

[0261] Step S615: receiving a third operation acting on the shooting control.

[0262] Step S616: In response to the third operation, the makeup-wearing facial image of the first user currently displayed in the first preview display area is saved.

[0263] For example, see Fig.9D , Fig.9D Schematic diagram of a user interface of an electronic device using a display method provided in an embodiment of the present application. Fig.9DAs shown, the user interface 82 displayed on the second screen 33 of the electronic device also includes a shooting control 9011. The electronic device receives the operation of the user clicking the shooting control 9011 (that is, the third operation), and in response to the operation, intercepts the current frame of the user's facial makeup image 9004 (that is, the first user's facial makeup image) displayed in the display frame 801 (that is, the first preview display area) of the user interface 81 in the first screen 32 as the first object (that is, the first user's facial makeup image currently displayed in the first preview display area). In some embodiments, the first object can also be a video, that is, the electronic device intercepts the current continuous multiple frames of the user's facial makeup image (that is, the first user's facial makeup image) displayed in the display frame 801 (that is, the first preview display area) at the first moment (after receiving the user's third operation and delaying the first time length). The user interface 91 is further displayed in the first screen 32, and the prompt information 901 is displayed in the user interface 91 to prompt the user whether to save the first object. Optionally, the prompt information 901 may also include an "OK" button 9012 and a "Cancel" button 9013. The "OK" button 9012 is used to confirm that the first object is saved to the gallery, and the "Cancel" button 9013 is used to confirm that the first object is not saved. It can be understood that the embodiment of the present application only exemplarily introduces a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device may also be in other styles and may include more / fewer controls, which is not limited in the embodiment of the present application.

[0264] Step S617: receiving a sixth operation on the makeup saving control.

[0265] Step S618: In response to the sixth operation, the makeup effect parameters corresponding to the makeup-wearing image of the first user's face currently displayed in the first preview display area are saved as the target custom makeup.

[0266] For example, see Fig.9E , Fig.9E Schematic diagram of a user interface of an electronic device using a display method provided in an embodiment of the present application. Fig.9EAs shown, the user interface 82 displayed on the second screen 33 of the electronic device also includes a makeup saving control 9014. The electronic device receives an operation (i.e., the sixth operation) of the user clicking the makeup saving control 9014, and the electronic device extracts corresponding makeup effect parameters (such as shape features, color features, and other parameters corresponding to makeup controls such as eye shadow, eyelashes, lipstick, blush, eyebrows, and beauty contact lenses) based on the user's facial makeup image 9004 (i.e., the first user's facial makeup image) displayed in the display frame 801 (i.e., the first preview display area) of the user interface 81 on the first screen 32, and packages and saves them as the first custom makeup (i.e., the target custom makeup), and further displays a user interface 92 on the first screen 32, wherein the user interface 92 displays a prompt message 902 , which is used to prompt the user whether to save the first custom makeup. Optionally, the prompt information 902 may also include an "OK" button 9015 and a "Cancel" button 9016. The "OK" button 9015 is used to confirm that the first custom makeup is saved, and the "Cancel" button 9016 is used to confirm that the first custom makeup is not saved. Accordingly, after receiving the user clicking the "OK" button 9015, a first custom makeup control 9017 is added to the user interface 75 (that is, the fifth user interface) displayed on the second screen 33, so that the user can quickly apply the pre-set makeup effect when he needs to experience the same makeup effect next time, thereby improving the user experience.

[0267] It is understandable that the embodiment of the present application only exemplarily introduces a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device may also be in other styles and may include more / fewer controls, which is not limited by the embodiment of the present application.

[0268] Specifically, the above steps S612-S613 describe how the electronic device can enlarge the first user's makeup image of the target part based on the user's operation during the virtual makeup process; step S614 describes how to display the user's first facial makeup image when it is detected that the user's face is blocked; steps S615-S616 describe how to save the currently displayed first user's facial makeup image; steps S617-S618 describe how to save the makeup effect parameters corresponding to the currently displayed first user's facial makeup image as the target custom makeup. For a detailed description of the above steps S612-S618, please refer to the above Figure 5The description of step S507 in the above is not repeated here. It is understandable that there is no clear order between step S612-step S613 and step S614 in the embodiment of the present application, that is, step S612-step S613 can be performed before or after step S614, or at the same time; there is no clear order between step S615-step S616 and step S617-step S618, that is, step S615-step S616 can be performed before or after step S617-step S618, or at the same time.

[0269] It should be noted that the description of steps S612 to S618 in the present embodiment is only for reference. Figure 5 A possible implementation of step S507 in , optionally, in some embodiments, more or fewer steps may be included, which is not limited in the embodiments of the present application.

[0270] Optionally, see Fig.10 , Fig.10 The present invention provides a flow chart of a display method based on a gallery application. Figure 1 The hardware structure of the electronic equipment and Figure 2 The software structure of the electronic equipment, and Figure 3 In the morphological structure of the folding screen of the electronic device 100. Exemplarily, the electronic device 100 includes a folding screen 31 and a camera (which may be one or more front cameras or one or more rear cameras, which is not limited in the embodiment of the present application), and the folding screen 31 can be folded along the folding edge to form a first screen 32 and a second screen 33; the method may specifically include the following steps S1001-step S1008, and may also include steps S1009-step S1010. It should be noted that the following steps S1001-step S1010 may be the above-mentioned Figure 5 Steps S501-S507 in the above example may be executed after Figure 6 The steps S601-S618 are then executed, which is not limited in the embodiment of the present application.

[0271] Step S1001: receiving the seventh operation for the gallery control.

[0272] Specifically, the first user interface displayed on the folding screen of the electronic device may also include a gallery control, and the electronic device may display the user interface of the gallery application by receiving the seventh operation for the gallery control. Exemplarily, the electronic device 100 may receive an operation of the user clicking on the gallery control (that is, the seventh operation) to display the user interface of the gallery application. It is understandable that the seventh operation may also be other operation modes acting on the gallery application, such as the electronic device detecting the voice "open the gallery", or pressing one or more of the volume buttons, etc., which is not limited in the embodiments of the present application.

[0273] Step S1002: In response to the seventh operation, the folding screen in the first form displays a sixth user interface.

[0274] Specifically, the sixth user interface includes an album display area, and the album display area is used to display thumbnails of stored images. Exemplarily, in response to the seventh operation, the folding screen 31 in the first form (also called the straight plate form), that is, the folding screen with the angle between the first screen 32 and the second screen 33 within the range of the first preset angle to 180° (including the first preset angle and 180°), can display the sixth user interface including the album display area for displaying thumbnails of stored images.

[0275] Step S1003: An eighth operation of receiving a thumbnail of the user's facial image to be processed.

[0276] Further, the electronic device 100 may receive an eighth operation on the thumbnail of the user facial image to be processed, so as to further view the user facial image to be processed selected by the user in the user interface of the gallery application.

[0277] Step S1004: In response to the eighth operation, the folding screen in the first form displays a seventh user interface.

[0278] Specifically, the seventh user interface includes a third preview display area, and the third preview display area is used to display the user facial image to be processed. Exemplarily, in response to the eighth operation, the folding screen 31 in the first form (also called the straight plate form), that is, the folding screen 31 with the angle between the first screen 32 and the second screen 33 within the range of the first preset angle to 180° (including the first preset angle and 180°), can display the seventh user interface including the third preview display area for displaying the user facial image to be processed, so that the user can view the selected user facial image to be processed.

[0279] Step S1005: Detect whether the folding screen is switched to the second form.

[0280] Specifically, the electronic device 100 can detect through one or more sensors whether the folding screen 31 is switched to a second form (also called a bracket state) in which the angle α between the first screen 32 and the second screen 33 is within a range from a second preset angle to a first preset angle (including the second preset angle and excluding the first preset angle), and determine whether to present an application interface simulating a real makeup box.

[0281] Step S1006: If so, the first screen of the folding screen in the second form displays the eighth user interface, and the second screen displays the ninth user interface.

[0282] Specifically, the eighth user interface includes a fourth preview display area, and the fourth preview display area is used to display a second user face makeup image generated based on the user face image to be processed; the ninth user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls. Exemplarily, if it is detected that the folding screen 31 is switched to the second form (also called the stand state), the first screen 32 of the folding screen 31 in the second form displays the eighth user interface including the fourth preview display area, and the second screen 33 displays the ninth user interface including the virtual makeup tool, so that when it is detected that the folding screen 31 is switched to the second form (also called the stand state), the gallery application can present an application interface that simulates a real makeup box to provide users with a new interactive experience, thereby enhancing the user's sense of ritual and immersive experience in the virtual makeup process.

[0283] In a possible implementation, the virtual makeup tool is used to adjust the virtual makeup effect of the first user's facial makeup image; the makeup control includes one or more of a color display control, a shape display control, and a color adjustment control.

[0284] In another possible implementation, the type of makeup control may include one or more of a lipstick control, an eye shadow control, a blush control, an eyelash control, an eyebrow control, and a cosmetic contact lens control.

[0285] Specifically, for the description of the color display control, shape display control, and color adjustment control corresponding to each makeup control (such as a lipstick control), please refer to the above Figure 5 The description of step S505 in this embodiment of the present application will not be repeated here.

[0286] Step S1007: receiving a ninth operation acting on the second target makeup control.

[0287] For example, the electronic device 100 may receive an operation (i.e., the ninth operation) of a user clicking on a second target makeup control (e.g., a lipstick icon control) to adjust the corresponding makeup effect. It is understandable that the ninth operation may also be other operation modes acting on the second target makeup control, such as the electronic device 100 detecting a voice "switch the lipstick to orange", or the user's finger hovering above the camera to draw one or more of the first graphics, etc., which is not limited in the embodiments of the present application.

[0288] Step S1008: In response to the ninth operation, the makeup-wearing facial image of the second user displayed in the fourth preview display area is updated based on the makeup effect parameters corresponding to the second target makeup control.

[0289] Specifically, after the electronic device receives the ninth operation acting on the second target makeup control (for example, the lipstick icon control), in response to the ninth operation, the second user's facial makeup image displayed in the fourth preview display area is updated based on the makeup effect parameters corresponding to the second target makeup control, so that the user can preview the latest adjusted makeup effect in real time through the fourth preview display area during the virtual makeup process, so that the user can more conveniently and quickly select and adjust the makeup effect according to personal preference. At the same time, a new interactive service with a stronger sense of ritual is provided in the process of users using the gallery application to process images, so that users can experience a feeling closer to the actual makeup process, thereby enhancing the user's immersive beauty experience in the virtual makeup process.

[0290] Optionally, the electronic device can also receive an eleventh operation acting on a target part in the makeup-wearing image of the second user's face, the eleventh operation comprising an outward operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen; in response to the eleventh operation, the fourth preview display area displays an enlarged image of the target part with makeup.

[0291] Optionally, if it is detected that the target part in the user facial image to be processed is blocked by a target object, the target part in the second user facial makeup image displays the image of the target object.

[0292] Optionally, the eighth user interface may further include a makeup saving control; receive a twelfth operation for the makeup saving control; and in response to the twelfth operation, save the makeup effect parameters corresponding to the makeup-wearing image of the second user's face currently displayed in the fourth preview display area as a custom makeup.

[0293] Specifically, the above descriptions of how the electronic device enlarges the user's makeup image during the operation of the gallery application, how to display the user's makeup image when it is detected that the user's facial image to be processed is blocked, and how to save the custom makeup are related to the above descriptions of how the electronic device enlarges the user's makeup image during the operation of the gallery application, how to display the user's makeup image when it is detected that the user's facial image to be processed is blocked, and how to save the custom makeup. Figure 5The relevant description in step S507 is similar and will not be repeated here.

[0294] Step S1009: receiving the tenth operation for the image saving control.

[0295] Specifically, when the folding screen of the electronic device is in the second form (also called the stand state), that is, when the angle between the first screen and the second screen is within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the eighth user interface displayed on the first screen may also include an image saving control. Exemplarily, the electronic device 100 may receive an operation in which the user clicks on the image to save (that is, the tenth operation), thereby saving the currently displayed image of the second user's face with makeup. It is understandable that the tenth operation may also be other operation modes acting on the image saving control, such as the electronic device 100 detecting the voice "save photo", or pressing one or more of the volume buttons, etc., which is not limited in this embodiment of the present application.

[0296] Step S1010: In response to the tenth operation, the makeup-wearing facial image of the second user currently displayed in the fourth preview display area is saved.

[0297] Furthermore, in response to the tenth operation on the image saving control, the electronic device can save the second user's facial makeup image currently displayed in the fourth preview display area (that is, the fourth preview display area in the eighth user interface displayed on the first screen 32 of the folding screen 31), so that the user can save the satisfactory facial image after adjusting the virtual makeup effect, so that subsequent users can view or share the satisfactory images, thereby enhancing the user's customized beauty experience.

[0298] Compared with the smart makeup box application in the prior art that relies on the design of the application side, it is subject to the permission control of the operating system or the device manufacturer, and may need to open the corresponding interface and / or permission to obtain the relevant data of the folding screen status, so it is difficult to achieve the same response speed and performance as the gallery application. In the embodiment of the present application, since the gallery application has the permission and ability to directly obtain the folding screen status parameters, it can achieve a faster response speed when the folding screen is converted to the stand state (that is, the second form), thereby more efficiently presenting a simulated interactive interface adapted to the stand state folding screen. Through the embodiment of the present application, users can more intuitively understand the beauty function of the virtual makeup tool, so that they can more conveniently and quickly select and adjust the makeup effect according to their personal preferences, and at the same time provide users with an interactive experience that is closer to the actual makeup process, thereby enhancing the user's immersive beauty experience in the process of virtual makeup for stored facial images. In addition, the beauty and makeup algorithm of the folding makeup box in the embodiment of the present application is designed in the gallery application, so that the user does not need to install or switch to other applications to adjust the beauty and makeup effects of the stored facial images, providing a more convenient and quick user experience while consuming fewer computing resources to maintain more stable application performance and faster response speed; it can also make fuller use of intelligent recognition technology and beauty and makeup algorithms to more accurately identify and adjust individual features such as faces and facial features, which can ensure more efficient and higher-quality beauty and makeup effects, thereby enhancing the user's experience of virtual makeup for stored facial images.

[0299] For example, in combination Fig.10 For a description of the flowchart of the display method based on the gallery application, see Fig.11 , Fig.11 A schematic diagram of a user interface of an electronic device using another display method provided in an embodiment of the present application. Fig.11As shown, the folding screen 31 of the electronic device is in a first form (also called a straight-plate form), that is, the angle between the first screen and the second screen is in a form ranging from a first preset angle to 180°, and the user interface 71 (also the first user interface) displayed on the folding screen 31 of the electronic device may also include a gallery control 7012. The electronic device receives an operation of the user clicking the gallery control 7012 (also the seventh operation), so that the folding screen 31 further displays the user interface 111 (also the sixth user interface). In the user interface 111, an album display frame 1101 (also the album display area) for displaying thumbnails of stored images may be included. Further, an operation (that is, the eighth operation) is received in which the user clicks on the thumbnail of the first image 1112 (that is, the user facial image to be processed) in the album display box 1101. In response to the operation, the folding screen 31 can display a user interface 112 (that is, the seventh user interface) including an image preview box 1102 (that is, the third preview display area), wherein the first image 1112 (that is, the user facial image to be processed) is displayed in the image preview box 1102 for user viewing or editing.

[0300] When the electronic device detects that the folding screen 31 switches to the second form (also called the stand form), that is, the angle α between the first screen 32 and the second screen 33 is in a form within the range from the second preset angle to the first preset angle (including the second preset angle and excluding the first preset angle), the first screen 32 of the folding screen 31 in the second form (also called the stand form) displays a user interface 113 (also called the eighth user interface) including a preview display box 1103 (also called the fourth preview display area), and the preview display box 1103 displays a first image 1112 (also called the user's facial image to be processed); the second screen 33 displays a user interface 114 (also called the ninth user interface) including virtual makeup tools (such as lipstick, eye shadow, blush, eyelashes, eyebrows, beauty contact lenses and other makeup controls). Exemplarily, when the virtual makeup tool is a lipstick control, the user interface 114 (also called the ninth user interface) is as follows: Fig.11As shown, it may include but is not limited to one or more of a color display control (e.g., a lipstick icon control 1141 simulating the appearance of a bean paste pink lipstick, a shape display control (e.g., a lip makeup icon control 1142 simulating the shape of a bitten lip makeup) and a color adjustment control (e.g., a parameter adjustment control 1143). Further, when the electronic device receives an operation (i.e., a ninth operation) of a user clicking on the lipstick icon control 1141 (i.e., the second target makeup control) in the user interface 114, in response to the operation, the preview display frame 1103 (i.e., the fourth preview display area) of the first screen 32 may update the user face makeup image (i.e., the second user face makeup image) corresponding to the first image (i.e., the user face image to be processed) in real time based on the makeup effect parameters corresponding to the lipstick icon control 1141 (i.e., the second target makeup control). Since the lipstick icon control 1141 is a bean paste pink color display control, the updated user face makeup image 1104 (that is, the second user face makeup image) displayed in the preview display box 1103 (that is, the fourth preview display area) is the user face makeup image after adding bean paste pink lipstick makeup effect based on the first image. It can be understood that the embodiment of the present application only exemplarily introduces the user interface when the second target makeup control is the lipstick icon control 1141. In some embodiments, the second target makeup control can also be any makeup control in the user interface 114 (for example, color display controls, shape display controls or color adjustment controls in different modules such as "eye shadow", "blush", and "eyelashes"), so as to adjust the corresponding makeup effect to display different user interfaces, and the embodiment of the present application is not limited to this.

[0301] Further, the user interface 113 (that is, the eighth user interface) displayed on the first screen 32 may also include an image saving control 1131. When the electronic device receives an operation (that is, the tenth operation) of the user clicking on the image saving control 1131, in response to the operation, the user interface 115 is displayed on the first screen 32, and the user interface 115 displays a prompt message 1105, which is used to prompt the user whether to save the updated user face makeup image 1104 (that is, the second user face makeup image) currently displayed in the preview display box 1103 (that is, the fourth preview display area) on the first screen 32. Optionally, the prompt message 1105 may also include an "OK" button 1106 and a "Cancel" button 1107. The "OK" button 1106 is used to determine to save the updated user face makeup image 1104 (that is, the second user face makeup image) to the gallery, and the "Cancel" button 1107 is used to determine not to save the updated user face makeup image 1104 (that is, the second user face makeup image). It is understandable that the embodiment of the present application only exemplarily introduces a user interface of an electronic device. In some other embodiments, the interface diagram of the electronic device may also be in other styles and may include more / fewer controls, which is not limited by the embodiment of the present application.

[0302] See also Fig.12 , Fig.12 1 is a schematic diagram of the structure of a display device provided in an embodiment of the present application. The display device 1200 can be applied to an electronic device, the electronic device includes a folding screen and a camera, the folding screen can be folded along a folding edge to form a first screen and a second screen; the display device 1200 can include a first display unit 1201, a first receiving unit 1202, a starting unit 1203, a first detection unit 1204, a second display unit 1205, a second receiving unit 1206, and a first update unit 1207, wherein the detailed description of each unit is as follows:

[0303] A first display unit 1201 is used for displaying a first user interface on the folding screen in a first form; the first user interface includes a system camera control, and the first form is a form in which the angle between the first screen and the second screen is within a range from a first preset angle to 180°;

[0304] A first receiving unit 1202, configured to receive a first operation acting on the system camera control;

[0305] A starting unit 1203, configured to start the system camera in response to the first operation;

[0306] A first detection unit 1204 is used to detect whether the folding screen is switched to a second state, where the second state is a state where the angle between the first screen and the second screen is within a range from a second preset angle to the first preset angle, and the second preset angle is smaller than the first preset angle;

[0307] A second display unit 1205 is configured to: if the first screen of the folding screen in the second form displays a second user interface, and the second screen displays a third user interface; the second user interface includes a first preview display area, the first preview display area is used to display a first user face makeup image generated based on the user face image currently captured by the camera, and the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls;

[0308] The second receiving unit 1206 is used to receive a second operation acting on the first target makeup control;

[0309] The first updating unit 1207 is used to update the first user's facial makeup image displayed in the first preview display area based on the makeup effect parameters corresponding to the first target makeup control in response to the second operation.

[0310] In a possible implementation manner, the third user interface further includes a shooting control; and the device further includes:

[0311] A third receiving unit, configured to receive a third operation acting on the shooting control;

[0312] The first saving unit is used to save the makeup-wearing facial image of the first user currently displayed in the first preview display area in response to the third operation.

[0313] In a possible implementation, the first preset angle is greater than or equal to 150° and less than 180°; the second preset angle is greater than or equal to 12° and less than or equal to 15°.

[0314] In a possible implementation manner, the device further includes:

[0315] A third display unit is used to display a fourth user interface on the folding screen in the first form in response to the first operation; the fourth user interface includes a second preview display area, and the second preview display area is used to display the user's facial image currently captured by the camera.

[0316] In one possible implementation, the virtual makeup tool is used to adjust the virtual makeup effect of the first user's facial makeup image; the makeup control includes one or more of a color display control, a shape display control, and a color adjustment control; the color display control is used to preview the color of the corresponding virtual makeup, the shape display control is used to preview the corresponding makeup style, and the parameter adjustment control is used to adjust the corresponding makeup effect parameters.

[0317] In a possible implementation, the type of the makeup control includes one or more of a lipstick control, an eye shadow control, a blush control, an eyelash control, an eyebrow control, and a cosmetic contact lens control; wherein the color display control corresponding to the lipstick control is a lipstick icon control simulating the appearance of lipstick, which is used to preview the lipstick color of virtual makeup; the shape display control corresponding to the lipstick control is a lip makeup icon control simulating the shape of lip makeup, which is used to preview the lip makeup style of virtual makeup;

[0318] Alternatively, the color display control corresponding to the eye shadow control is an eye shadow icon control simulating the appearance of an eye shadow palette, which is used to preview the eye shadow color of virtual makeup; the shape display control corresponding to the eye shadow control is an eye makeup icon control simulating the shape of eye makeup, which is used to preview the eye makeup style of virtual makeup;

[0319] Alternatively, the color display control corresponding to the blush control is a blush icon control simulating the appearance of a blush palette, which is used to preview the blush color of virtual makeup; the shape display control corresponding to the blush control is a blush makeup icon control simulating the shape of blush, which is used to preview the blush style of virtual makeup;

[0320] Alternatively, the color display control corresponding to the eyelash control is a mascara icon control that simulates the appearance of mascara, which is used to preview the color of the eyelashes in virtual makeup; the shape display control corresponding to the eyelash control is an eyelash icon control that simulates the shape of the eyelashes, which is used to preview the style of the eyelashes in virtual makeup;

[0321] Alternatively, the color display control corresponding to the eyebrow control is an eyebrow pencil icon control that simulates the appearance of an eyebrow pencil, which is used to preview the eyebrow color of virtual makeup; the shape display control corresponding to the eyebrow control is an eyebrow makeup icon control that simulates the shape of an eyebrow, which is used to preview the eyebrow style of virtual makeup;

[0322] Alternatively, the color display control corresponding to the beauty contact lens control is a beauty contact lens icon control that simulates the appearance of beauty contact lenses, which is used to preview the beauty contact lens color of virtual makeup; the shape display control corresponding to the beauty contact lens control is a beauty contact lens makeup icon control that simulates the shape of beauty contact lenses, which is used to preview the beauty contact lens style of virtual makeup.

[0323] In a possible implementation manner, the device further includes:

[0324] a fourth receiving unit, configured to receive a fourth operation applied to a target part of the makeup-wearing face image of the first user, wherein the fourth operation includes an outward expansion operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen;

[0325] The fourth display unit is used to: in response to the fourth operation, display the enlarged image of the target part with makeup in the first preview display area.

[0326] In a possible implementation manner, the device further includes:

[0327] The fifth display unit is used to display the image of the target object at the target part in the first user's facial makeup image if it is detected that the target part in the user's facial image is blocked by the target object.

[0328] In a possible implementation manner, the device further includes:

[0329] A sixth display unit, configured to display a fifth user interface on the second screen of the folding screen in the second form, wherein the fifth user interface includes a custom makeup control;

[0330] a fifth receiving unit, configured to receive a fifth operation for the custom makeup control;

[0331] A seventh display unit is configured to cause the second screen to display the third user interface in response to the fifth operation.

[0332] In a possible implementation, the third user interface further includes a makeup saving control; and the device further includes:

[0333] A sixth receiving unit, configured to receive a sixth operation on the makeup saving control;

[0334] The second saving unit is used to save the makeup effect parameters corresponding to the makeup-wearing image of the first user's face currently displayed in the first preview display area as a target custom makeup in response to the sixth operation.

[0335] In a possible implementation manner, the first user interface further includes a gallery control; and the device further includes:

[0336] A seventh receiving unit, configured to receive a seventh operation for the gallery control;

[0337] an eighth display unit, configured to, in response to the seventh operation, display a sixth user interface on the folding screen in the first form; the sixth user interface comprising an album display area, the album display area being configured to display thumbnails of stored images;

[0338] an eighth receiving unit, configured to receive an eighth operation on the thumbnail of the user's facial image to be processed;

[0339] a ninth display unit, configured to, in response to the eighth operation, display a seventh user interface on the folding screen in the first form; the seventh user interface includes a third preview display area, and the third preview display area is configured to display the user facial image to be processed;

[0340] A second detection unit, used to detect whether the folding screen is switched to the second form;

[0341] a tenth display unit, configured to: if the first screen of the folding screen in the second form displays an eighth user interface, and the second screen displays a ninth user interface; the eighth user interface includes a fourth preview display area, and the fourth preview display area is used to display a second user face makeup image generated based on the user face image to be processed; the ninth user interface includes the virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls;

[0342] a ninth receiving unit, configured to receive a ninth operation acting on the second target makeup control;

[0343] The second updating unit is used to update the makeup-wearing facial image of the second user displayed in the fourth preview display area based on the makeup effect parameter corresponding to the second target makeup control.

[0344] In a possible implementation manner, the eighth user interface further includes an image saving control; and the device further includes:

[0345] a tenth receiving unit, configured to receive a tenth operation on the image saving control;

[0346] The third saving unit is used to save the makeup-wearing facial image of the second user currently displayed in the fourth preview display area in response to the tenth operation.

[0347] It should be noted that the functions of each unit in the display device 1200 described in the embodiment of the present application can refer to the relevant description of the above-mentioned method embodiment, and will not be repeated here. It is understandable that the device and method provided in the embodiment of the present application can be implemented in other ways. For example, the system embodiment described above is only schematic. For example, the division of the above-mentioned modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0348] See also Fig.13 , Fig.13 Schematic diagram of the hardware structure of another electronic device provided in the embodiment of the present application. Fig.13 As shown, the electronic device 1300 includes at least one processor 1301 and a memory 1302. The processor 1301 is coupled to the memory 1302. The coupling in the embodiment of the present application may be a communication connection, an electrical connection, or other forms. In addition, the electronic device 1300 provided in the embodiment of the present application may also include: a camera 1303 and at least one folding screen 1304 ( Fig.13 Only one is shown). The processor 1301, the memory 1302, the camera 1303 and the folding screen 1304 can be connected via a bus 1305. Specifically, the memory 1302 is used to store program instructions. The processor 1301 is used to call the program instructions stored in the memory 1302 so that the electronic device 1300 can perform some or all of the steps in the display method provided in the embodiment of the present application. The description of its various components and related steps can be referred to above and will not be repeated here.

[0349] It should be noted that the electronic device 1300 provided in the embodiment of the present application may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or any combination of software and hardware.

[0350] An embodiment of the present application also provides a computer-readable storage medium, wherein the computer-readable storage medium may store a program, and when the computer program is executed by a processor, it implements part or all of the steps of any one of the display methods recorded in the above method embodiments.

[0351] An embodiment of the present application also provides a computer program, which includes instructions. When the computer program is executed by a computing device, the computing device can execute part or all of the steps of any one of the above-mentioned display methods.

[0352] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0353] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0354] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, some steps may be performed in other orders or simultaneously, or some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application. It should also be noted that the features and functions of two or more devices disclosed in the present invention can be concretized in one device. Conversely, the features and functions of a device described above can be further divided into being concretized by multiple devices.

[0355] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.

[0356] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

[0357] In short, the above is only an embodiment of the technical solution of this application, and is not intended to limit the protection scope of this application. Any modification, equivalent replacement, improvement, etc. made according to the disclosure of this application shall be included in the protection scope of this application.

Claims

1. A display method, characterized in that: Applied to an electronic device, the electronic device comprises a folding screen and a camera, the folding screen can be folded along a folding edge to form a first screen and a second screen; the method comprises: The folding screen in the first form displays a first user interface; the first user interface includes a system camera control, and the first form is a form in which the angle between the first screen and the second screen is within a range from a first preset angle to 180°; receiving a first operation acting on the system camera control; In response to the first operation, starting the system camera; Detecting whether the folding screen is switched to a second form, where the second form is a form in which the angle between the first screen and the second screen is within a range from a second preset angle to the first preset angle, and the second preset angle is smaller than the first preset angle; If so, the first screen of the folding screen in the second form displays a second user interface, and the second screen displays a third user interface; the second user interface includes a first preview display area, the first preview display area is used to display a first user face makeup image generated based on the user face image currently captured by the camera, and the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls; receiving a second operation acting on the first target makeup control; In response to the second operation, the makeup-wearing facial image of the first user displayed in the first preview display area is updated based on the makeup effect parameter corresponding to the first target makeup control.

2. The method according to claim 1, characterized in that The third user interface further includes a shooting control; and the method further includes: receiving a third operation acting on the shooting control; In response to the third operation, the makeup-wearing facial image of the first user currently displayed in the first preview display area is saved.

3. The method according to claim 1 or 2, characterized in that: The first preset angle is greater than or equal to 150° and less than 180°; the second preset angle is greater than or equal to 10° and less than or equal to 15°.

4. The method according to any one of claims 1 to 3, characterized in that: The method further comprises: In response to the first operation, the folding screen in the first form displays a fourth user interface; the fourth user interface includes a second preview display area, and the second preview display area is used to display the user's facial image currently captured by the camera.

5. The method according to any one of claims 1 to 4, characterized in that: The virtual makeup tool is used to adjust the virtual makeup effect of the first user's facial makeup image; the makeup control includes one or more of a color display control, a shape display control and a color adjustment control; the color display control is used to preview the color of the corresponding virtual makeup, the shape display control is used to preview the corresponding makeup style, and the parameter adjustment control is used to adjust the corresponding makeup effect parameters.

6. The method according to claim 5, characterized in that The types of makeup controls include one or more of lipstick controls, eyeshadow controls, blush controls, eyelash controls, eyebrow controls, and cosmetic contact lens controls; wherein the color display control corresponding to the lipstick control is a lipstick icon control that simulates the appearance of lipstick, and is used to preview the lipstick color of virtual makeup; the shape display control corresponding to the lipstick control is a lip makeup icon control that simulates the shape of lip makeup, and is used to preview the lip makeup style of virtual makeup; Alternatively, the color display control corresponding to the eye shadow control is an eye shadow icon control simulating the appearance of an eye shadow palette, which is used to preview the eye shadow color of virtual makeup; the shape display control corresponding to the eye shadow control is an eye makeup icon control simulating the shape of eye makeup, which is used to preview the eye makeup style of virtual makeup; Alternatively, the color display control corresponding to the blush control is a blush icon control simulating the appearance of a blush palette, which is used to preview the blush color of virtual makeup; the shape display control corresponding to the blush control is a blush makeup icon control simulating the shape of blush, which is used to preview the blush style of virtual makeup; Alternatively, the color display control corresponding to the eyelash control is a mascara icon control that simulates the appearance of mascara, which is used to preview the color of the eyelashes in virtual makeup; the shape display control corresponding to the eyelash control is an eyelash icon control that simulates the shape of the eyelashes, which is used to preview the style of the eyelashes in virtual makeup; Alternatively, the color display control corresponding to the eyebrow control is an eyebrow pencil icon control that simulates the appearance of an eyebrow pencil, which is used to preview the eyebrow color of virtual makeup; the shape display control corresponding to the eyebrow control is an eyebrow makeup icon control that simulates the shape of an eyebrow, which is used to preview the eyebrow style of virtual makeup; Alternatively, the color display control corresponding to the beauty contact lens control is a beauty contact lens icon control that simulates the appearance of beauty contact lenses, which is used to preview the beauty contact lens color of virtual makeup; the shape display control corresponding to the beauty contact lens control is a beauty contact lens makeup icon control that simulates the shape of beauty contact lenses, which is used to preview the beauty contact lens style of virtual makeup.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: receiving a fourth operation acting on a target part of the makeup-wearing face image of the first user, the fourth operation comprising an outward expansion operation of two fingers of the user on the first screen or a double-click operation of the user's fingers on the first screen; In response to the fourth operation, the first preview display area displays the enlarged image of the target part with makeup.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: If it is detected that the target part in the user's facial image is blocked by a target object, the target part in the first user's facial makeup image displays the image of the target object.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: The second screen of the foldable screen in the second form displays a fifth user interface, and the fifth user interface includes a custom makeup control; receiving a fifth operation on the custom makeup control; In response to the fifth operation, the second screen displays the third user interface.

10. The method according to claim 9, characterized in that The third user interface also includes a makeup saving control; the method further includes: receiving a sixth operation on the makeup saving control; In response to the sixth operation, the makeup effect parameters corresponding to the makeup-wearing image of the first user's face currently displayed in the first preview display area are saved as the target custom makeup.

11. The method according to any one of claims 1 to 10, characterized in that: The first user interface also includes a gallery control; the method further includes: receiving a seventh operation on the gallery control; In response to the seventh operation, the folding screen in the first form displays a sixth user interface; the sixth user interface includes an album display area, and the album display area is used to display thumbnails of stored images; An eighth operation of receiving a thumbnail of a user's facial image to be processed; In response to the eighth operation, the folding screen in the first form displays a seventh user interface; the seventh user interface includes a third preview display area, and the third preview display area is used to display the user facial image to be processed; Detecting whether the folding screen is switched to the second form; If so, the first screen of the folding screen in the second form displays an eighth user interface, and the second screen displays a ninth user interface; the eighth user interface includes a fourth preview display area, and the fourth preview display area is used to display a second user face makeup image generated based on the user face image to be processed; the ninth user interface includes the virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls; receiving a ninth operation acting on the second target makeup control; In response to the ninth operation, the second user's facial makeup image displayed in the fourth preview display area is updated based on the makeup effect parameter corresponding to the second target makeup control.

12. The method according to claim 11, characterized in that The eighth user interface further includes an image saving control; and the method further includes: receiving a tenth operation on the image saving control; In response to the tenth operation, the makeup-wearing facial image of the second user currently displayed in the fourth preview display area is saved.

13. A display device, characterized in that: Applicable to an electronic device, the electronic device comprising a folding screen and a camera, the folding screen being foldable along a folding edge to form a first screen and a second screen; comprising: A first display unit, configured to display a first user interface on the folding screen in a first form; the first user interface includes a system camera control, and the first form is a form in which the angle between the first screen and the second screen is within a range from a first preset angle to 180°; A first receiving unit, configured to receive a first operation acting on the system camera control; a starting unit, configured to start the system camera in response to the first operation; a first detection unit, used to detect whether the folding screen is switched to a second state, where the second state is a state in which the angle between the first screen and the second screen is within a range from a second preset angle to the first preset angle, and the second preset angle is smaller than the first preset angle; a second display unit, for displaying a second user interface on the first screen of the folding screen in the second form, and displaying a third user interface on the second screen; the second user interface includes a first preview display area, the first preview display area is used to display a first user face makeup image generated based on the user face image currently captured by the camera, the third user interface includes a virtual makeup tool, and the virtual makeup tool includes a plurality of skeuomorphic makeup controls; A second receiving unit, configured to receive a second operation acting on the first target makeup control; The first updating unit is configured to update the makeup-wearing facial image of the first user displayed in the first preview display area based on the makeup effect parameters corresponding to the first target makeup control in response to the second operation.

14. An electronic device, characterized in that: The electronic device includes a folding screen and a camera, and the folding screen can be folded along a folding edge to form a first screen and a second screen; the electronic device also includes a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to execute the computer program stored in the memory, so that the electronic device executes the method described in any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

16. A computer program, characterized in that The computer program comprises instructions, and when the computer program is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 12.

Images