Man-machine interaction method of beauty makeup mirror and beauty makeup mirror

Abstract

The invention discloses a man-machine interaction method of a beauty makeup mirror and the beauty makeup mirror, and relates to the technical field of intelligent display. The man-machine interaction method of the beauty makeup mirror comprises the steps that a first interface is displayed in the beauty makeup mirror based on identity information of a target object and corresponding historical use record information, the first interface is arranged according to use habits of the target object, and then the first interface is displayed in the beauty makeup mirror according to the use habits of the target object; according to the face position information of the target object in the cosmetic mirror or the distance information of the target object and the cosmetic mirror, a second interface is displayed in the cosmetic mirror, and the component position in the second interface and the icon appearance corresponding to the component are dynamically adjusted along with the face position information or the distance information. The icon appearance comprises at least one of an icon size, an icon shape or an icon color. By executing the above operations, the flexibility and intelligence of display of the beauty mirror are improved, and the satisfaction degree of using the beauty mirror by the user is further improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent display technology, and in particular to a human-computer interaction method for a beauty mirror and a beauty mirror. Background Art

[0002] A makeup mirror is a mirror specifically used for makeup, usually with some special designs and functions to help users put on makeup better. With the development of technology, makeup mirrors with internal LCD displays provide users with more functions and convenience. Different from the singleness of traditional makeup mirrors, smart makeup mirrors integrate imaging technology and artificial intelligence to provide users with a more comprehensive experience.

[0003] The smart beauty mirror in the related art has relatively fixed display effects and interactive operations and cannot meet the needs of users. Summary of the invention

[0004] The main purpose of the embodiments of the present application is to provide a human-computer interaction method for a beauty mirror and a beauty mirror, aiming to improve the user's experience of using the beauty mirror.

[0005] To achieve the above purpose, one aspect of an embodiment of the present application provides a human-computer interaction method for a beauty mirror, comprising the following steps:

[0006] Based on the identity information of the target object and the corresponding historical usage record information, a first interface is displayed in the beauty mirror, where the first interface is laid out according to the usage habits of the target object;

[0007] A second interface is displayed in the beauty mirror according to the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, wherein the component positions in the second interface and the icon appearances corresponding to the components are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color.

[0008] In some embodiments, before displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, the method further includes:

[0009] Acquire facial information of the target object;

[0010] The identity information of the target object is determined according to the facial information.

[0011] In some embodiments, displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information includes:

[0012] Determining usage habit information of the target object based on the identity information of the target object and the corresponding historical usage record information, wherein the usage habit information includes at least one of the following: beauty information of interest, beauty type of interest, or interface layout display mode of interest;

[0013] Determine facial position information of the target object in the beauty mirror;

[0014] The usage habit information of the target object is displayed in the beauty mirror according to the facial position information.

[0015] In some embodiments, after displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, the method further includes:

[0016] Analyzing the facial information of the target object to obtain facial expression information of the target object;

[0017] Dynamically adjust the layout of components in the first interface and / or the information content displayed in the first interface according to the facial expression information.

[0018] In some embodiments, after displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, the method further includes:

[0019] Analyzing facial information of the target object to obtain skin condition information of the target object;

[0020] The information content displayed in the first interface is dynamically adjusted according to the skin status information.

[0021] In some embodiments, displaying a second interface in the beauty mirror according to the facial position information of the target object in the beauty mirror includes:

[0022] Obtaining facial coordinates of the target object in the beauty mirror and a moving trajectory of the facial coordinates;

[0023] Determine the area information of the face of the target object in the beauty mirror by using the facial coordinates and the movement trajectory of the facial coordinates to obtain the target area;

[0024] According to the target area, the second interface is displayed in the beauty mirror, wherein the component position in the second interface is located in the non-target area, and the icon appearance corresponding to the component is dynamically adjusted according to the size of the non-target area.

[0025] In some embodiments, displaying a second interface in the beauty mirror according to the distance information between the target object and the beauty mirror includes:

[0026] Acquire distance information between the target object and the beauty mirror;

[0027] Setting the appearance of an icon corresponding to the component according to the distance information, wherein the size of the icon is in inverse proportion to the distance information;

[0028] The icon appearance corresponding to the component is displayed in the second interface.

[0029] In some embodiments, obtaining the facial coordinates of the target object in the beauty mirror and the movement trajectory of the facial coordinates includes:

[0030] Determine the coordinates of the center position of the face of the target object in the beauty mirror;

[0031] When the target object moves relative to the beauty mirror, determining a coordinate offset of the center position of the face;

[0032] The movement trajectory of the facial coordinates is determined according to the coordinate offset.

[0033] In some embodiments, determining the area information of the face of the target object in the beauty mirror by using the facial coordinates and the movement trajectory of the facial coordinates to obtain the target area includes:

[0034] Dividing the display interface of the beauty mirror into a plurality of grid areas;

[0035] Determine the target area according to the grid area where the coordinates of the center position of the face are located and the grid area where the moving track of the face coordinates are located, wherein the target area includes at least one of the grid areas;

[0036] The step of displaying the second interface in the beauty mirror according to the target area includes:

[0037] Determine the grid area where the components in the second interface are located based on the grid area where the coordinates of the center position of the face are located and the grid area where the movement trajectory of the facial coordinates are located;

[0038] The component in the second interface is displayed according to the grid area where the component in the second interface is located.

[0039] To achieve the above-mentioned purpose, another aspect of an embodiment of the present application proposes a beauty mirror, which includes a memory and a processor, the memory stores a computer program, and the processor implements the human-computer interaction method of the beauty mirror when executing the computer program.

[0040] The embodiments of the present application include at least the following beneficial effects:

[0041] The present application provides a human-computer interaction method for a beauty mirror and a beauty mirror. In an embodiment of the present application, first, based on the identity information of a target object and corresponding historical usage record information, a first interface is displayed in the beauty mirror, wherein the first interface is laid out according to the usage habits of the target object, and then, based on the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, a second interface is displayed in the beauty mirror, wherein the component position in the second interface and the icon appearance corresponding to the component are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color. In the embodiment of the present application, a first interface that conforms to the target object's usage habits can be displayed according to the target object's identity information and the corresponding historical usage record information, which saves the user's time for resetting each time the beauty mirror is used and eliminates the setting operation process, thereby improving the user's usage experience. In addition, a second interface can be displayed in the beauty mirror according to the target object's facial position information in the beauty mirror or the distance information between the target object and the beauty mirror. Since the component positions in the second interface and the appearance of the icons corresponding to the components are dynamically adjusted according to the facial position information or the distance information, the flexibility and intelligence of the beauty mirror display are improved, and the user's satisfaction with the beauty mirror is further improved.

[0042] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0044] Figure 1 is a flow chart of a human-computer interaction method for a beauty mirror provided in some embodiments of the present application;

[0045] Figure 2 is a schematic diagram of interactive display of a beauty mirror provided in some embodiments of the present application;

[0046] Figure 3 is another interactive display schematic diagram of a beauty mirror provided in some embodiments of the present application;

[0047] Figure 4 This is another interactive display schematic diagram of a beauty mirror provided in some embodiments of the present application;

[0048] Figure 5 is another flow chart of the human-computer interaction method of the beauty mirror provided in some embodiments of the present application;

[0049] Figure 6 is a schematic block diagram of a module of a human-computer interaction device for a beauty mirror provided in some embodiments of the present application;

[0050] Figure 7 This is a schematic diagram of the hardware structure of a beauty mirror provided in some embodiments of the present application. DETAILED DESCRIPTION

[0051] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the reference to "embodiment" in this article means that the specific features, structures or characteristics described in conjunction with the embodiment may be included in at least one embodiment of the present application. The appearance of this phrase in various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the embodiments of the present application. They are only examples of devices and methods consistent with some aspects of the embodiments of the present application as detailed in the attached claims.

[0052] It is understood that the terms "first", "second", etc. used in this application can be used to describe various concepts in this article, but unless otherwise specified, these concepts are not limited by these terms. These terms are only used to distinguish one concept from another concept. For example, without departing from the scope of the embodiment of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the words "if" and "if" as used herein can be interpreted as "at the time of" or "when" or "in response to determination".

[0053] The terms "at least one", "multiple", "each", "any", etc. used in this application, at least one includes one, two or more, multiple includes two or more, each refers to each of the corresponding multiple, and any refers to any one of the multiple.

[0054] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0055] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application may also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present application.

[0056] In order to make the inventive concept of the present application easy to understand, before describing the embodiments of the present application in detail, the English abbreviations (terms) / related concepts involved in the embodiments of the present application are first described. The English abbreviations (terms) / related concepts involved in the embodiments of the present application are subject to the following explanations.

[0057] Beauty mirror: A beauty mirror is a mirror specially used for makeup, which usually has some special designs and functions to help users to better apply makeup. Among them, the special design and function can be equipped with LED lights, which can provide uniform and bright light to help users see clearer effects when applying makeup; adjustable brightness, the brightness of the LED lights of some beauty mirrors can be adjusted, and users can adjust the brightness as needed to adapt to different makeup environments and needs; multiple lighting modes, beauty mirrors can provide multiple lighting modes, such as natural light, cold light, warm light, etc., to simulate different natural lighting conditions, helping users choose the most suitable makeup light for themselves; magnification function, some beauty mirrors have a magnification function, which can help users observe and process facial details more carefully; smart functions: such as smart display, connecting mobile phone applications, timed reminders, music playback, etc., to provide users with a more comprehensive makeup experience.

[0058] Under the wave of digital technology consumption trends, digital empowerment has penetrated into various fields. With the continuous development of artificial intelligence technology, face recognition technology has been widely used in various fields, including security monitoring, face payment, smart access control, etc. In the beauty industry, beauty mirrors based on face recognition technology have also become possible.

[0059] The emergence of smart makeup mirrors indicates that the traditional makeup mirror industry is facing a new transformation. Traditional makeup mirrors have a single function and can only provide image reflection. With the development of technology, makeup mirrors with internal LCD screen displays have gradually appeared, providing users with more functions and convenience. Unlike the single traditional beauty mirror, the smart makeup mirror combines imaging technology and artificial intelligence to provide users with a more comprehensive user experience. Smart beauty mirrors use AI algorithms to generate skin analysis reports and makeup technique recommendations for users. Users interact with the interface and content through the touch screen inside the mirror, realizing that a single device can complete the entire makeup learning process from watching tutorials to learning techniques to looking at the results in the mirror, greatly improving user efficiency.

[0060] However, the display and interactive operation effects of the mirror-like LCD screens on the market are always unsatisfactory. The layout of the content area of ​​the interactive interface information is not clear, the obstruction affects the mirror view, the interface is not friendly enough, the user experience is not convenient enough, etc. The overall design is not based on the user experience.

[0061] In view of this, the present application proposes a human-computer interaction method and a beauty mirror for a beauty mirror. In an embodiment of the present application, first, based on the identity information of the target object and the corresponding historical usage record information, a first interface is displayed in the beauty mirror, wherein the first interface is laid out according to the usage habits of the target object, and then, based on the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, a second interface is displayed in the beauty mirror, wherein the component position in the second interface and the icon appearance corresponding to the component are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color. In the embodiment of the present application, a first interface that conforms to the target object's usage habits can be displayed according to the target object's identity information and the corresponding historical usage record information, which saves the user's time for resetting each time the beauty mirror is used and eliminates the setting operation process, thereby improving the user's usage experience. In addition, a second interface can be displayed in the beauty mirror according to the target object's facial position information in the beauty mirror or the distance information between the target object and the beauty mirror. Since the component positions in the second interface and the appearance of the icons corresponding to the components are dynamically adjusted according to the facial position information or the distance information, the flexibility and intelligence of the beauty mirror display are improved, and the user's satisfaction with the beauty mirror is further improved.

[0062] The method provided in the embodiment of the present application can be applied to the beauty mirror provided in the embodiment of the present application. The beauty mirror can be an LED makeup mirror or an intelligent makeup mirror; it can be a portable makeup mirror or a professional makeup mirror or a multifunctional makeup mirror. The present application does not limit this.

[0063] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on data related to user identity or characteristics such as user information, user behavior data, user historical data, and user location information, the user's permission or consent will be obtained first, and the collection, use, and processing of these data will comply with relevant laws, regulations, and standards. In addition, when the embodiment of the present application needs to obtain the user's sensitive personal information, the user's separate permission or consent will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the user's separate permission or consent, the necessary user-related data for the normal operation of the embodiment of the present application will be obtained.

[0064] The implementation steps of a human-computer interaction method for a beauty mirror provided by an embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0065] Please refer to Figure 1 , Figure 1 A flowchart of a human-computer interaction method for a beauty mirror provided in some embodiments of the present application. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than that shown here.

[0066] The method of the embodiment of the present application comprises the following steps:

[0067] Step 101: Based on the identity information of the target object and the corresponding historical usage record information, a first interface is displayed in the beauty mirror, and the first interface is laid out according to the usage habits of the target object;

[0068] Step 102: Display a second interface in the beauty mirror based on the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, wherein the component positions in the second interface and the icon appearances corresponding to the components are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color.

[0069] Steps 101 to 102 shown in the embodiment of the present application can display a first interface that conforms to the target object's usage habits based on the target object's identity information and the corresponding historical usage record information, saving the user's time for resetting the beauty mirror each time it uses it and eliminating the setting operation process, thereby improving the user's usage experience. In addition, a second interface can be displayed in the beauty mirror based on the target object's facial position information in the beauty mirror or the distance information between the target object and the beauty mirror. Since the component positions in the second interface and the appearance of the icons corresponding to the components are dynamically adjusted according to the facial position information or the distance information, the flexibility and intelligence of the beauty mirror display are improved, further improving the user's satisfaction with the beauty mirror.

[0070] The specific implementation methods of the above steps are introduced below.

[0071] In step 101, based on the identity information of the target object and the corresponding historical usage record information, a first interface is displayed in the beauty mirror, and the first interface is laid out according to the usage habits of the target object.

[0072] Optionally, the target object may be a target user, and the target user may refer to a woman, a man, or a child, etc. The target user may also be a pet, or an intelligent robot, which is not limited in the present application.

[0073] The historical usage record information of the target object can be the information of the last usage recorded according to the identity of the target object; or it can be the target user's past usage record information calculated by statistical principles, where multiple times can be determined according to a time period or a preset number of times. For example, the historical record stores the user's usage habit data for the past 10 times, and these 10 usage habit data include 3 types of interface layouts, one of which is used 5 times, and the other two are used 2 and 3 times respectively. Then the one used 5 times can be determined as the final historical usage record information of the target object and then the first interface can be displayed in the beauty mirror.

[0074] In some implementations, the identity information of the target object can be obtained through face recognition.

[0075] Specifically, facial information of the target object may be acquired; and identity information of the target object may be determined based on the facial information.

[0076] Exemplarily, a high-definition camera can be used to capture the user's facial image, and then the captured image is pre-processed using a face recognition algorithm, including steps such as face detection and face feature extraction, to ensure the accuracy of subsequent analysis; the captured facial information is compared with the information in the user database to confirm the user's identity.

[0077] For example, a high-definition camera can be used to capture the user's facial image. The high-definition camera has high resolution and good optical performance. The high-definition camera can be installed above the LCD screen inside the beauty mirror to ensure that the user's face can be captured completely and clearly. The camera's viewing angle must be precisely adjusted to avoid deformation of the facial image due to angle problems. The camera's pixel density can reach 1080p resolution, which can capture subtle facial textures and features, including pores, wrinkles, etc. In a dimly lit environment, the camera also has an automatic fill light function, and through the fill light device of the beauty mirror itself, it ensures that a usable facial image can be captured even in low light conditions.

[0078] Afterwards, the currently collected face images are preprocessed through the face recognition algorithm, including face detection and face feature extraction, to ensure the accuracy of subsequent analysis.

[0079] After the facial information is collected, the collected facial information can be compared with the information in the user database to confirm the identity of the user. During the comparison process, a high-precision matching algorithm can be used to compare the currently collected facial feature vectors with the feature vectors in the database one by one to calculate the similarity score; when the similarity score exceeds the set threshold (for example, set to 0.8), the user's identity can be confirmed. If there are multiple user information in the database, the system traverses all user data for comparison until a matching user is found.

[0080] After confirming the user's identity, the personalized beauty mirror interface recommendation content can be loaded according to the user's identity information and historical usage records, and the position of the face in the mirror can be determined, and the corresponding interface content can be presented on the other side to avoid blocking the user's line of sight to the mirror, while taking into account the reading presentation of the screen content.

[0081] In some embodiments of the present application, the usage habit information of the target object can be determined based on the identity information of the target object and the corresponding historical usage record information, wherein the usage habit information includes at least one of the following: beauty information of interest, beauty types of interest, or color themes of interest and interface layout display methods. Thereafter, the facial position information of the target object in the beauty mirror is determined, and the usage habit information of the target object is displayed in the beauty mirror according to the facial position information.

[0082] For example, personalized beauty mirror interface recommendation content can be loaded based on the user's identity information and historical usage records, and the position of the face in the mirror can be determined, and the corresponding interface content can be presented on the other side to avoid blocking the user's line of sight to the mirror while taking into account the reading presentation of the screen content.

[0083] Among them, the identity information of the target object may include the target object's basic personal information, such as age, gender, occupation, geographic location, etc. This information can help us understand the basic characteristics of the target object, so as to recommend beauty information, beauty types, color themes or interface layout display methods that better meet their needs.

[0084] Historical usage record information: When the target user uses the beauty mirror for the first time, the target user’s usage behavior over the past period of time can be analyzed, such as browsing history, purchase history, search history, etc. By analyzing these records, it is possible to find out which beauty information the target user is interested in, which types of beauty products they like, and which interface layout display method they prefer. If it is confirmed that the target user has used the beauty mirror before, their usage habits can also be determined based on the target user’s usage records of the beauty mirror.

[0085] By analyzing identity information and historical usage record information, we can infer the target object's preferences in terms of beauty information of interest, beauty types of interest, and interface layout display methods of interest.

[0086] Since users' usage habits are not static, we can also predict and infer users' interests through data analysis and machine learning techniques. Various algorithms, such as decision trees, random forests, support vector machines, etc., can be used to analyze data and infer the usage habits of the target objects, thereby improving the prediction accuracy of the target objects' usage habits.

[0087] The function layout can also be adjusted according to the user's historical usage frequency and habits. For example, if the user frequently uses the skin analysis function, the display area of ​​the skin analysis related modules and extended function buttons will be placed in a more conspicuous and user-friendly place on the interface.

[0088] After that, the facial image of the target object can be captured by the camera or sensor in the beauty mirror. Then, image processing technology, such as face recognition algorithm, is used to determine the facial position information of the target object in the beauty mirror. This includes the position, size, angle and other features of the face.

[0089] After determining the target object's facial position information, the target object's usage habits information can be displayed in the beauty mirror based on this information. For example, if the target object is interested in a certain type of beauty makeup, relevant beauty makeup information or product recommendations can be displayed in the beauty mirror.

[0090] Among them, the usage habit information of the target object is displayed in the beauty mirror according to the facial position information, which can be that if the facial position of the target object is on the left side of the beauty mirror, the usage habit information of the target object is displayed on the right side; if the facial position of the target object is on the right side of the beauty mirror, the usage habit information of the target object is displayed on the left side; if the facial position of the target object is above the beauty mirror, the usage habit information of the target object is displayed below; if the facial position of the target object is below the beauty mirror, the usage habit information of the target object is displayed above.

[0091] Please refer to Figure 2 , Figure 2 This is a schematic diagram of the interactive display of a beauty mirror provided in some embodiments of the present application. Figure 2 In the beauty mirror, the user's face is on the left side, and the information that the user is interested in is displayed on the right side. The beauty mirror displays the functional modules that the user is accustomed to using, and also displays the skin quality test results that the user is more concerned about and frequently uses.

[0092] In some implementations, facial information of the target object may also be analyzed to obtain facial expression information of the target object, and the layout of components in the first interface and / or the information content displayed in the first interface may be dynamically adjusted based on the facial expression information.

[0093] For example, captured facial images can be analyzed using image processing and computer vision techniques, such as facial recognition and expression recognition algorithms, to identify facial expressions of the target object. This includes identifying different expressions such as happiness, sadness, surprise, anger, etc. Based on the recognized facial expressions, the emotional state of the target object can be inferred. For example, if the target object shows a happy expression, it may mean that they are interested in the current beauty product or information.

[0094] According to the target object's facial expression information, the layout of components in the first interface (such as the interface of the beauty mirror) is dynamically adjusted. For example, if the target object shows a confused expression, the interface can be adjusted to display more detailed instructions or guidance; if the target object shows an interested expression, the interface can display more relevant beauty information or product recommendations.

[0095] In order to improve the user experience, the component display mode can also be adjusted according to the emotional state and operation habits of the target object. For example, if the target object shows an impatient expression, the interface can simplify the operation process and provide faster service.

[0096] In some implementations, facial information of the target object may also be analyzed to obtain skin condition information of the target object, and then the information content displayed in the first interface may be dynamically adjusted according to the skin condition information.

[0097] Exemplarily, image processing and computer vision techniques, such as skin analysis algorithms, can be used to analyze captured facial images to identify the skin condition of the target object. This includes identifying skin types (such as dry, oily, and mixed), skin problems (such as acne, spots, wrinkles), etc. Based on the identified skin condition, the target object's skin needs and preferences can be inferred. For example, if the target object has an acne problem, it may be necessary to display beauty product recommendations for acne-prone skin. If the target object has dry skin, the beauty mirror can display recommendations for moisturizing products suitable for dry skin; if the target object has wrinkle problems, the beauty mirror can display recommendations for anti-aging products.

[0098] Based on the target person’s skin condition information, the beauty mirror can provide personalized beauty recommendations. For example, it can recommend suitable cleansing products, skin care products, and makeup products based on skin type.

[0099] In order to improve the user experience, the interface design of the beauty mirror needs to take into account the skin condition and needs of the target object. For example, if the target object has a specific skin problem, the interface can provide corresponding solutions and suggestions. For example: when the user's skin is dry, the interface can automatically recommend a moisturizing tutorial; when the user's skin has spots, the interface can automatically recommend a concealer tutorial.

[0100] When the beauty mirror dynamically reminds the user of the current skin condition, the functional layout of the beauty mirror and the display of suggested measures can be adjusted at the same time.

[0101] Please refer to Figure 3 , Figure 3 This is another interactive display schematic diagram of a beauty mirror provided in some embodiments of the present application. Figure 3 A schematic diagram of analyzing the user's facial expression and skin condition in real time and dynamically reminding the user based on the analysis results is given in FIG. The reminder content may be a brief skin quality test result or a reminder message for the user's emotion.

[0102] In step 102, a second interface may be displayed in the beauty mirror according to facial position information of the target object in the beauty mirror or distance information between the target object and the beauty mirror, wherein component positions in the second interface and icon appearances corresponding to the components are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape, or icon color.

[0103] The facial position information of the target object in the beauty mirror may be determined according to the method provided in the above embodiment.

[0104] Sensors in the beauty mirror (such as infrared sensors, ultrasonic sensors, etc.) can be used to capture distance information between the target object and the beauty mirror. This can help determine whether the target object is close to the beauty mirror and the distance from the beauty mirror.

[0105] The information content displayed in the beauty mirror can be dynamically adjusted according to the facial position information of the target object or the distance information from the beauty mirror to display the second interface. The second interface can contain different information, such as beauty tutorials, product recommendations, skin analysis results, etc.

[0106] In order to improve the user experience, the interface design of the beauty mirror needs to take into account the facial position and distance information of the target object. For example, when the target object is close to the beauty mirror, more detailed information can be displayed; when the target object is far away from the beauty mirror, more concise information can be displayed.

[0107] The position of interface components can be dynamically adjusted according to the user's facial position and movement trajectory to avoid blocking the user's line of sight. For example, a camera can be used to capture the user's facial position and movement in real time to determine the position of the face in the mirror and present the corresponding interface content on the other side to avoid blocking the user's line of sight while taking into account the reading presentation of the screen content.

[0108] In some embodiments, the facial coordinates of the target object in the beauty mirror and the movement trajectory of the facial coordinates can be obtained; the area information of the target object's face in the beauty mirror is determined by the facial coordinates and the movement trajectory of the facial coordinates to obtain the target area; according to the target area, a second interface is displayed in the beauty mirror, wherein the component position in the second interface is located in the non-target area, and the appearance of the icon corresponding to the component is dynamically adjusted according to the size of the non-target area.

[0109] Exemplarily, image processing and computer vision techniques, such as facial recognition algorithms, can be used to analyze the captured facial images to determine the facial coordinates of the target object in the beauty mirror. By continuously capturing the facial images of the target object, the movement trajectory of the facial coordinates can be tracked. This can help determine the movement of the target object's face in the beauty mirror, such as approaching, moving away, moving left and right, etc. According to the facial coordinates of the target object and the movement trajectory of the facial coordinates, the regional information of the target object's face in the beauty mirror can be determined. This includes features such as the area where the face is located, the size of the area, and the location of the area. By analyzing the facial coordinates of the target object and the movement trajectory of the facial coordinates, the target area can be determined. The target area can be understood as the area in the beauty mirror where the user's facial coordinates pass through or currently exist. Afterwards, the components in the second interface are set in the non-target area. It can be understood that if the non-target area is relatively large, the size of the component can be relatively adjusted to be larger to facilitate user viewing; if the non-target area is relatively small, the size of the component can be relatively adjusted to be smaller to store these components, or this will simplify the display of the components.

[0110] Please refer to Figure 4 , Figure 4 This is another interactive display schematic diagram of a beauty mirror provided in some embodiments of the present application. Figure 4 Two display examples are provided. In the left display example, when the user's face is located on the left side of the beauty mirror, the components in the second interface (recommended content) are set on the right; in the right display example, when the user's face is located on the right side of the beauty mirror, the components in the second interface (recommended content) are set on the left.

[0111] Optionally, the coordinates of the face center position of the target object in the beauty mirror can be determined, and when the target object moves relative to the beauty mirror, the coordinate offset of the face center position can be determined, and then the movement trajectory of the face coordinates can be determined based on the coordinate offset.

[0112] In order to ensure the precise positioning and adaptive adjustment of the interface components, the display interface of the beauty mirror can be divided into multiple grid areas, and then the target area is determined according to the grid area where the coordinates of the center position of the face are located and the grid area where the movement trajectory of the facial coordinates are located, wherein the target area includes at least one grid area.

[0113] The grid area where the components in the second interface are located is determined based on the grid area where the coordinates of the center position of the face are located and the grid area where the movement trajectory of the facial coordinates are located, and the components are displayed in the second interface according to the grid area where the components in the second interface are located.

[0114] Exemplarily, the size of each grid can be determined according to the size of the display area of ​​the beauty mirror and the number of functional components. The grids can be squares or rectangles of equal size, or they can be customized according to the shape and size of the beauty mirror. Determine the number of grids to be divided according to the size of the display area of ​​the beauty mirror and the number of functional components. A unique number can be assigned to each grid for subsequent positioning and identification. The number can be a number or a letter, or a combination of numbers and letters. Determine the position of each functional component in the grid according to the functional requirements of the beauty mirror. Functional components can be beauty tutorials, product recommendations, skin analysis results, etc. It should be understood that the functional components should be located in the non-target area (the target area is the grid area where the user's face is located). Afterwards, the components in the second interface are displayed according to the grid area where the components in the second interface are located.

[0115] In some embodiments, the distance information between the target object and the beauty mirror can be obtained, and the icon appearance corresponding to the component can be set according to the distance information, wherein the icon size is inversely proportional to the distance information, and then the icon appearance corresponding to the component is displayed in the second interface.

[0116] For example, when the user approaches, the interface content and components will shrink accordingly to avoid occupying too much of the field of vision; when the user moves away, the interface content components will be appropriately enlarged to ensure that the user can see and operate clearly.

[0117] Optionally, when the user approaches, the icon shape can be dynamically adjusted to a shape with softer edges, and when the user moves away, the icon shape can be dynamically adjusted to a shape with more obvious and protruding edges.

[0118] Optionally, when the user approaches, the icon color can be dynamically adjusted to a softer color, such as macaron color; when the user moves away, the icon color can be dynamically adjusted to a more eye-catching color.

[0119] The above is an introduction to an embodiment of the human-computer interaction method of the beauty mirror of the present application.

[0120] Combine the following Figure 5 , the method provided in the embodiments of the present application is further described.

[0121] Please refer to Figure 5 , Figure 5 This is another flow chart of the human-computer interaction method of the beauty mirror provided in some embodiments of the present application. Figure 5 In the process, the facial information of the current user can be obtained, and then the collected user image is preprocessed through the face recognition algorithm, which includes face detection and face feature extraction.

[0122] Furthermore, the collected user facial information is compared with the information in the user database to confirm the user's identity.

[0123] During the comparison process, a high-precision matching algorithm can be used to compare the currently collected facial feature vectors with the feature vectors in the database one by one to calculate the similarity score; when the similarity score exceeds the set threshold (for example, set to 0.8), the user's identity can be confirmed. If there are multiple user information in the database, the system traverses all user data for comparison until a matching user is found.

[0124] After confirming the user's identity, the personalized beauty mirror interface recommendation content can be loaded based on the user's identity information and historical usage records. The position of the face in the mirror can also be determined, and the corresponding interface content is presented on the other side to avoid blocking the user's view of the mirror while taking into account the reading presentation of the screen content.

[0125] Afterwards, facial recognition technology is used to analyze the user's facial expressions, skin condition and other information in real time, and the functional layout and recommended content of the beauty mirror are dynamically adjusted according to the analysis results to remind the user.

[0126] Facial recognition technology can be used to analyze the user's facial expressions and skin condition information in real time, and analyze the skin's texture, color, and gloss. By analyzing the color distribution in the skin image, the skin tone and whether there is uneven skin tone can be determined. At the same time, the skin surface can be detected for blemishes, including acne, spots, and dark circles.

[0127] Based on the analysis results, the user is dynamically reminded of the current skin condition, and the functional layout of the beauty mirror is adjusted and suggested measures are displayed.

[0128] The position of the interface components can also be dynamically adjusted according to the user's facial position and movement trajectory to avoid blocking the user's line of sight; the camera is used to capture the user's facial position and movement in real time, determine the position of the face in the mirror, and present the interface content on the other side accordingly to avoid blocking the user's line of sight while taking into account the reading presentation of the screen content. When the user approaches, the interface content and components will be reduced accordingly to avoid occupying too much of the line of sight; when the user moves away, the interface content components will be appropriately enlarged to ensure that the user can see and operate clearly.

[0129] During the dynamic adjustment of the beauty mirror, the interface can be divided into grid areas to ensure the precise positioning and adaptive adjustment of interface components.

[0130] The embodiments of the present application collect the user's facial information, identify and analyze the user in real time, and dynamically adjust the interface layout and functions according to the user's actual needs to achieve a personalized user experience. Specifically, the interface layout and functions can be dynamically adjusted according to the user's facial expression and skin condition, thereby enhancing the interactivity between the user and the beauty mirror; through real-time facial analysis and personalized settings, provide users with a more intelligent and convenient beauty mirror experience; by adopting an adaptive interface design, ensure that the interface components can be dynamically adjusted according to the user's facial position and movement trajectory, avoid blocking the user's line of sight in the mirror, and further improve the user's satisfaction.

[0131] The implementation of the human-computer interaction device of the beauty mirror provided by the embodiment of the present application will be described in detail below with reference to the accompanying drawings.

[0132] Regarding the human-computer interaction method of the beauty mirror provided in the above embodiment, the present application embodiment also provides a human-computer interaction device of the beauty mirror, which is used to implement the above method, such as Figure 6 As shown, Figure 6 : is a schematic block diagram of a module of a human-computer interaction device 600 of a beauty mirror according to an embodiment of the present application. The human-computer interaction device 600 of the beauty mirror includes:

[0133] The first display module 601 is used to display a first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information. The first interface is laid out according to the usage habits of the target object;

[0134] The second display module 602 is used to display a second interface in the beauty mirror according to the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, wherein the component position in the second interface and the icon appearance corresponding to the component are dynamically adjusted according to the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color.

[0135] It can be understood that the contents of the above method embodiments are all applicable to the present device embodiments, the functions specifically implemented by the present device embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0136] Reference Figure 7 The embodiment of the present application also provides a beauty mirror, which includes a memory, one or more processors ( Figure 7 Only one is shown) and a computer program stored in the memory and executable on the processor. Wherein: the memory is used to store software programs and units, and the processor executes various functional applications and data processing by running the software programs and units stored in the memory to obtain the resources corresponding to the above-mentioned preset events. Optionally, the processor implements the human-computer interaction method of the beauty mirror by running the above-mentioned computer program stored in the memory.

[0137] The memory, as a non-transitory computer-readable medium, can be used to store non-transitory software programs and non-transitory computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transitory memory, such as at least one disk storage device, a flash memory device, or other non-transitory solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network.

[0138] It can be understood that the contents of the above method embodiments are all applicable to the present beauty mirror embodiment, the functions specifically implemented by the present beauty mirror embodiment are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0139] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the human-computer interaction method of the beauty mirror is implemented.

[0140] It can be understood that the contents of the above method embodiments are all applicable to the present storage medium embodiments, the functions specifically implemented by the present storage medium embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0141] An embodiment of the present application also provides a computer program product, which includes a computer program. When the computer program is executed by one or more processors, it can implement the steps of the human-computer interaction method of the beauty mirror.

[0142] It can be understood that the contents of the above method embodiments are all applicable to the present computer program product, the functions specifically implemented by the present computer program product embodiments are the same as those of the above method embodiments, and the beneficial effects achieved are also the same as those achieved by the above method embodiments.

[0143] The human-computer interaction method, device, beauty mirror, medium and computer program product of the beauty mirror provided in the embodiments of the present application display a first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, wherein the first interface is laid out according to the usage habits of the target object, and then display a second interface in the beauty mirror according to the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, wherein the component position in the second interface and the icon appearance corresponding to the component are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color. In the embodiment of the present application, a first interface that conforms to the target object's usage habits can be displayed according to the target object's identity information and the corresponding historical usage record information, which saves the user's time for resetting each time the beauty mirror is used and eliminates the setting operation process, thereby improving the user's usage experience. In addition, a second interface can be displayed in the beauty mirror according to the target object's facial position information in the beauty mirror or the distance information between the target object and the beauty mirror. Since the component positions in the second interface and the appearance of the icons corresponding to the components are dynamically adjusted according to the facial position information or the distance information, the flexibility and intelligence of the beauty mirror display are improved, and the user's satisfaction with the beauty mirror is further improved.

[0144] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.

[0145] Although specific embodiments are described herein, those of ordinary skill in the art will recognize that many other modifications or alternative embodiments are also within the scope of the present disclosure. For example, any of the functions and / or processing capabilities described in conjunction with a particular device or component may be performed by any other device or component. In addition, although various exemplary implementations and architectures have been described according to embodiments of the present disclosure, those of ordinary skill in the art will recognize that many other modifications to the exemplary implementations and architectures described herein are also within the scope of the present disclosure.

[0146] Some aspects of the present disclosure are described above with reference to the block diagram and flow chart of the system, method, system and / or computer program product according to the exemplary embodiments.It should be understood that the combination of one or more blocks in the block diagram and the flow chart and the blocks in the block diagram and the flow chart can be realized by executing computer executable program instructions respectively.Equally, according to some embodiments, some blocks in the block diagram and the flow chart may not need to be executed in the order shown, or may not need to be executed in full.In addition, additional components and / or operations beyond those components and / or operations shown in the blocks in the block diagram and the flow chart may be present in certain embodiments.

[0147] Therefore, the blocks in the block diagrams and flow charts support the combination of devices for performing the specified functions, the combination of elements or steps for performing the specified functions, and the program instruction devices for performing the specified functions. It should also be understood that each block in the block diagrams and flow charts and the combination of blocks in the block diagrams and flow charts can be implemented by a special-purpose hardware computer system or a combination of special-purpose hardware and computer instructions that performs a specific function, element or step.

[0148] The program modules, applications, etc. described herein may include one or more software components, including, for example, software objects, methods, data structures, etc. Each such software component may include computer-executable instructions that, in response to execution, cause at least a portion of the functionality described herein (e.g., one or more operations of the illustrative methods described herein) to be performed.

[0149] Software components can be encoded with any of various programming languages. An exemplary programming language can be a low-level programming language, such as an assembly language associated with a specific hardware architecture and / or an operating system platform. The software component comprising assembly language instructions may need to be converted to executable machine code by an assembler before being executed by hardware architecture and / or platform. Another exemplary programming language can be a higher-level programming language, which can be transplanted across multiple architectures. The software component comprising a higher-level programming language may need to be converted to an intermediate representation by an interpreter or a compiler before execution. Other examples of programming languages ​​include but are not limited to macro languages, shells or command languages, job control languages, scripting languages, database queries or search languages ​​or report writing languages. In one or more exemplary embodiments, the software component comprising the instruction of one of the above-mentioned programming language examples can be directly executed by an operating system or other software components, without first being converted into another form.

[0150] Software components may be stored as files or other data storage structures. Software components of similar type or related functions may be stored together, such as in a specific directory, folder, or library. Software components may be static (e.g., preset or fixed) or dynamic (e.g., created or modified at execution time).

[0151] The embodiments of the present application are described in detail above in conjunction with the accompanying drawings, but the present application is not limited to the above embodiments, and various changes can be made within the knowledge scope of ordinary technicians in the relevant technical field without departing from the purpose of the present application.

Claims

1. A human-computer interaction method for a beauty mirror, characterized in that: The following steps are involved: Based on the identity information of the target object and the corresponding historical usage record information, a first interface is displayed in the beauty mirror, where the first interface is laid out according to the usage habits of the target object; A second interface is displayed in the beauty mirror according to the facial position information of the target object in the beauty mirror or the distance information between the target object and the beauty mirror, wherein the component positions in the second interface and the icon appearances corresponding to the components are dynamically adjusted with the facial position information or the distance information, and the icon appearance includes at least one of the following: icon size, icon shape or icon color.

2. The human-computer interaction method of the beauty mirror according to claim 1, characterized in that: Before displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, the method further includes: Acquire facial information of the target object; The identity information of the target object is determined according to the facial information.

3. The human-computer interaction method of the beauty mirror according to claim 1, characterized in that: The method of displaying a first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information includes: Determining usage habit information of the target object based on the identity information of the target object and the corresponding historical usage record information, wherein the usage habit information includes at least one of the following: beauty information of interest, beauty type of interest, or interface layout display mode of interest; Determine facial position information of the target object in the beauty mirror; The usage habit information of the target object is displayed in the beauty mirror according to the facial position information.

4. The human-computer interaction method of the beauty mirror according to claim 1, characterized in that: After displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, the method further includes: Analyzing the facial information of the target object to obtain facial expression information of the target object; Dynamically adjust the layout of components in the first interface and / or the information content displayed in the first interface according to the facial expression information.

5. The human-computer interaction method of the beauty mirror according to claim 1, characterized in that: After displaying the first interface in the beauty mirror based on the identity information of the target object and the corresponding historical usage record information, the method further includes: Analyzing facial information of the target object to obtain skin condition information of the target object; The information content displayed in the first interface is dynamically adjusted according to the skin status information.

6. The human-computer interaction method of the beauty mirror according to claim 1, characterized in that: The step of displaying a second interface in the beauty mirror according to the facial position information of the target object in the beauty mirror comprises: Obtaining facial coordinates of the target object in the beauty mirror and a moving trajectory of the facial coordinates; Determine the area information of the face of the target object in the beauty mirror by using the facial coordinates and the movement trajectory of the facial coordinates to obtain the target area; According to the target area, the second interface is displayed in the beauty mirror, wherein the component position in the second interface is located in the non-target area, and the icon appearance corresponding to the component is dynamically adjusted according to the size of the non-target area.

7. The human-computer interaction method of the beauty mirror according to claim 1, characterized in that: The displaying a second interface in the beauty mirror according to the distance information between the target object and the beauty mirror comprises: Acquire distance information between the target object and the beauty mirror; Setting the appearance of an icon corresponding to the component according to the distance information, wherein the size of the icon is in inverse proportion to the distance information; The icon appearance corresponding to the component is displayed in the second interface.

8. The human-computer interaction method of the beauty mirror according to claim 6, characterized in that: The acquiring the facial coordinates of the target object in the beauty mirror and the moving track of the facial coordinates includes: Determine the coordinates of the center position of the face of the target object in the beauty mirror; When the target object moves relative to the beauty mirror, determining a coordinate offset of the center position of the face; The movement trajectory of the facial coordinates is determined according to the coordinate offset.

9. The human-computer interaction method of the beauty mirror according to claim 8, characterized in that: The step of determining the area information of the face of the target object in the beauty mirror by using the facial coordinates and the moving track of the facial coordinates to obtain the target area includes: Dividing the display interface of the beauty mirror into a plurality of grid areas; Determine the target area according to the grid area where the coordinates of the center position of the face are located and the grid area where the moving track of the face coordinates are located, wherein the target area includes at least one of the grid areas; The step of displaying the second interface in the beauty mirror according to the target area includes: Determine the grid area where the components in the second interface are located based on the grid area where the coordinates of the center position of the face are located and the grid area where the movement trajectory of the facial coordinates are located; The component in the second interface is displayed according to the grid area where the component in the second interface is located.

10. A makeup mirror, characterized in that: The beauty mirror comprises a memory and a processor, the memory stores a computer program, and the processor implements the human-computer interaction method for the beauty mirror according to any one of claims 1 to 9 when executing the computer program.

Images