Makeup system, makeup mirror, control method, data processing method and mobile device

Abstract

This application provides a makeup system, a makeup mirror, a control method, a data processing method, and a mobile device. The makeup system includes a makeup mirror, a connector, and a mobile device. The makeup mirror has a mirror surface; the connector is disposed on the makeup mirror; the mobile device is connected to the makeup mirror via the connector and is used to collect data from the mirror surface to perform corresponding tasks and / or control the operation of the makeup mirror based on the data. The technical solution provided in this embodiment combines the makeup mirror and the mobile device through a connector, integrating hardware and software. It utilizes the powerful hardware (camera, sensors, processor, etc.) and software functions of the mobile device to enhance the functionality of the makeup mirror. It requires minimal modification to existing makeup mirror hardware, significantly improving the performance of the makeup mirror at a low cost.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, and in particular to a makeup system, a makeup mirror, a control method, a data processing method, and a mobile device. Background Technology

[0002] Makeup mirrors are used when applying makeup or doing skincare. In addition to the functions of a regular mirror, makeup mirrors also have lights on the edge (usually called fill lights) to illuminate the face, making them more convenient to use.

[0003] If a user wants to watch a makeup tutorial and practice applying makeup in front of the mirror, they would need to look at their phone, tablet, or computer placed next to the mirror before applying makeup, requiring them to twist or move their head back and forth, which is inconvenient. Summary of the Invention

[0004] This application provides a beauty system, beauty mirror, control method, data processing method, and mobile device that can solve or improve problems existing in the prior art.

[0005] One embodiment of this application provides a beauty system. The beauty system includes:

[0006] A makeup mirror, featuring a mirrored surface;

[0007] A connector is provided on the makeup mirror;

[0008] A mobile device, connected to the makeup mirror via the connector, is used to collect data from the mirror surface of the makeup mirror in order to perform corresponding tasks and / or control the operation of the makeup mirror based on the data.

[0009] Another embodiment of this application provides a makeup mirror. The makeup mirror includes:

[0010] Mirror components;

[0011] A connector, disposed on the mirror assembly, is used to connect a mobile device to the mirror assembly, so that the mobile device can collect data from the mirror side of the makeup mirror and perform corresponding tasks and / or control the operation of the makeup mirror based on the data.

[0012] Another embodiment of this application provides a method for controlling a makeup mirror. This method is applicable to mobile devices, which are mounted on the makeup mirror via a connector. Specifically, the method includes:

[0013] Collect ambient lighting information from the side of the makeup mirror;

[0014] Based on the ambient light information, a dimming command is sent to the makeup mirror via a wireless communication component or the connector, so that the makeup mirror adjusts the color temperature and / or brightness according to the dimming command.

[0015] Another embodiment of this application provides a method for controlling a makeup mirror. This method is applicable to mobile devices, which are mounted on the makeup mirror via a connector. Specifically, the method includes:

[0016] Capture the facial image on the mirror side of the beauty mirror;

[0017] The face image is processed to generate a composite image with virtual makeup on the face;

[0018] The synthesized image is displayed.

[0019] Another embodiment of this application provides a mobile device. The mobile device includes a memory and a processor, wherein...

[0020] The memory is used to store programs;

[0021] The processor, coupled to the memory, is configured to execute the program stored in the memory for:

[0022] Collect ambient lighting information from the side of the makeup mirror;

[0023] Based on the ambient light information, a dimming command is sent to the makeup mirror via a wireless communication component or the connector, so that the makeup mirror adjusts the color temperature and / or brightness according to the dimming command.

[0024] Another embodiment of this application provides a mobile device. The mobile device includes a memory and a processor, wherein...

[0025] The memory is used to store programs;

[0026] The processor, coupled to the memory, is configured to execute the program stored in the memory for:

[0027] Capture the facial image on the mirror side of the beauty mirror;

[0028] The face image is processed to generate a composite image with virtual makeup on the face;

[0029] The synthesized image is displayed.

[0030] The technical solution provided in this application embodiment includes a connector. This connector allows a mobile device (such as a mobile phone, a smart computer, or a smart wearable device) to be connected to the makeup mirror. This enables the mobile device to collect data from the mirror surface and perform corresponding tasks and / or control the mirror's operation based on this data. For example, it can collect ambient light information from the mirror surface to control the mirror's adjustment of light color temperature and / or brightness; or it can collect facial images from the mirror surface to perform tasks such as skin texture testing, makeup synthesis, playing makeup tutorial videos, and live-streaming the user's makeup application. Because the mobile device is connected to the makeup mirror via the connector, the user can simultaneously see the content playing on the mobile device while using the mirror, without needing to significantly twist or move their head. Therefore, the technical solution provided in this embodiment combines the makeup mirror and mobile device through a connector, leveraging the powerful hardware (camera, sensors, processor, etc.) and software functions of the mobile device to enhance the makeup mirror's functionality. It requires minimal modification to existing makeup mirror hardware, significantly improving the mirror's performance at a low cost. Attached Figure Description

[0031] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0032] Figure 1 This is an installation diagram of a beauty system provided in one embodiment of this application;

[0033] Figure 2 This is a front view of the beauty system provided in the embodiments of this application after installation.

[0034] Figure 3 This is a side view of the beauty system provided in the embodiments of this application after installation.

[0035] Figure 4 This is a schematic diagram of the back of the beauty system provided in this application embodiment after installation;

[0036] Figure 5 A schematic diagram showing the mobile device located above the edge of the makeup mirror in the beauty system provided in this application embodiment;

[0037] Figure 6 A schematic diagram showing the mobile device located on the left side of the edge of the makeup mirror in the beauty system provided in this application embodiment;

[0038] Figure 7This is a schematic diagram illustrating the control of a makeup mirror's dimming function by a mobile device in a beauty system provided in this application embodiment.

[0039] Figure 8 This is a diagram illustrating the user's usage status when using the beauty system for live streaming, skin analysis, or virtual makeup creation.

[0040] Figure 9 A schematic diagram of the first implementation structure of the connector;

[0041] Figure 10 This is a schematic diagram of the back of a makeup mirror.

[0042] Figure 11 A schematic diagram showing a support frame on the connector supporting a mobile device;

[0043] Figure 12 This is a schematic diagram showing that the support portion on the connector is a slot;

[0044] Figure 13 A schematic diagram showing a first electrical connection terminal located within a connector slot;

[0045] Figure 14 A flowchart illustrating a beauty mirror control method provided in an embodiment of this application;

[0046] Figure 15 A schematic flowchart illustrating a data processing method provided in an embodiment of this application;

[0047] Figure 16 This is a schematic diagram of the structure of a mobile device provided in an embodiment of this application. Detailed Implementation

[0048] As living standards improve, people's pursuit of fashion is getting higher and higher. They not only require their clothing and accessories to keep up with the trends, but also to create exquisite makeup looks. Lighting is crucial for makeup, and makeup mirrors solve this problem very well. The fill lights around the edge of a makeup mirror can provide light with various color temperatures and brightness levels.

[0049] Currently, some beauty mirrors also have voice interaction functions, allowing users to adjust the color temperature or brightness of the mirror's fill light using their voice; they can also control the mirror to play music, makeup tutorial audio, or skincare tutorial audio, etc. However, with audio guidance, users can only hear the sound and cannot see the image, making it relatively difficult for most beginners. Learning with videos is much easier. In reality, if users need makeup guidance, they must use another smart device (such as a mobile phone or tablet), requiring them to frequently turn their heads to glance at the video and then practice makeup application in the mirror, which is not very convenient.

[0050] To address or improve the aforementioned problems, this application provides the following embodiments. To enable those skilled in the art to better understand the solutions presented in this application, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.

[0051] In some processes described in the specification, claims, and accompanying drawings of this application, multiple operations appearing in a specific order are included. These operations may be performed out of order or in parallel. Operation numbers such as 101, 102, etc., are merely used to distinguish different operations and do not represent any execution order. Furthermore, these processes may include more or fewer operations, and these operations may be performed sequentially or in parallel. It should be noted that the terms "first," "second," etc., used herein are used to distinguish different components, modules, devices, etc., and do not represent a sequential order, nor do they limit "first" and "second" to different types. Moreover, the following embodiments are merely some embodiments of this application, not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0052] Figure 1 , Figure 2 , Figure 3 and Figure 4 A schematic diagram of the structure of a beauty system provided in one embodiment of this application is shown. Figure 1 , Figure 2 , Figure 3 and Figure 4 As shown, the beauty system includes: a beauty mirror 1, a connector 2, and a mobile device 3. The mobile device 3 can be a mobile phone, tablet computer, or smart wearable device (such as a smartwatch), but this embodiment does not specifically limit its use. Figure 1 , Figure 2 , Figure 3 and Figure 4 As shown, the makeup mirror 1 has an image-receiving mirror surface 11. A connector 2 is disposed on the makeup mirror 1. A mobile device 3 is connected to the makeup mirror 1 via the connector 2, and is used to collect data from the mirror surface of the makeup mirror 1, so as to perform corresponding tasks and / or control the operation of the makeup mirror 1 based on the data.

[0053] The connector 2 can be positioned anywhere on the makeup mirror 1 without affecting its use. For example, as... Figures 1 to 4 In the embodiment shown, the connector 2 is disposed on the back of the mirror of the beauty mirror 1, so that part of the mobile device 3 is exposed and the other part is covered by the beauty mirror 1.

[0054] Or, such as Figure 5 and Figure 6 In the embodiment shown, the connector 2 is disposed at the edge of the mirror surface of the beauty mirror 1, such that the mobile device 3 is located at the edge of the mirror surface. Figure 5 This illustrates a scenario where the mobile device 1 is positioned above the mirror surface of the makeup mirror 1 via the connector 2. Figure 6 The illustration shows a scenario where the mobile device 1 is positioned to the left of the mirror surface of the makeup mirror 1 via the connector 2. Of course, the mobile device 1 can also be positioned to the right of the mirror surface of the makeup mirror 1 via the connector 2; however, this embodiment does not provide a complete example.

[0055] like Figures 1 to 6 As shown, the mobile device includes a display screen; the display screen is exposed and not obstructed by the makeup mirror, and is located on the same side as the mirror. This allows users to play makeup or skincare instruction videos on the mobile device. Users can watch the instruction videos on the display screen while simultaneously learning to apply makeup in front of the makeup mirror. Because the mobile device is on the makeup mirror, users only need to move their eyes, without needing to twist their heads or make large movements, to watch the videos and apply makeup in front of the mirror.

[0056] Furthermore, such as Figure 7 As shown, the mobile device 3 includes a light sensor 31. The light sensor 31 is used to collect ambient light information and send a dimming command to the makeup mirror 1 based on the ambient light information. The makeup mirror 1 includes a fill light assembly 12 and a controller (not shown in the figure). The controller is used to control the fill light assembly 12 to adjust the color temperature and / or brightness according to the received dimming command. In a specific implementation, the controller can be set inside the base 13 of the makeup mirror 1.

[0057] In this way, when users are using a beauty mirror for makeup or skincare, the mobile device can control the color temperature and / or brightness of the mirror based on the ambient light information collected by the light sensor 31. Users do not need to adjust it manually, which greatly improves ease of use. For example, if a user is applying skincare or foundation and has skincare or foundation products on their hands, without the automatic adjustment function of this solution, the user can only adjust it with the back of their hand, or adjust it with their hand, causing the adjustment control to stick to the skincare or foundation products. Another example is that some beauty mirrors have voice-activated color temperature and / or brightness adjustment functions, but this voice-activated adjustment corresponds to a certain level, i.e., brightness is divided into three, four, or five levels, etc. If the user says "brighter," the beauty mirror will increase the brightness by one level based on the current brightness level. If the adjusted brightness is not satisfactory, the user needs to say "brighter" again. The solution provided in this embodiment, however, controls the color temperature and / or brightness of the beauty mirror based on ambient light information, without user intervention. Users can obtain satisfactory brightness and color temperature without even noticing.

[0058] See Figure 8As shown, the mobile device may include a camera 31, a processor (not shown), and a display screen 32. The camera 31 is used to capture a facial image from the mirror side of the makeup mirror 1. The processor performs image processing on the facial image to generate a composite image of the face with virtual makeup. The display screen 32 is used to display the composite image.

[0059] Furthermore, the mobile device is also used to respond to a user's video playback command triggered by the synthesized image, acquire the video corresponding to the synthesized image, and play the video. Specifically, the mobile device has a corresponding application (APP) installed, which provides a virtual makeup try-on function. After the user activates the virtual makeup try-on function, the camera 31 of the mobile device 3 captures a facial image from the mirror side of the makeup mirror 1; the application's corresponding interactive interface displays various makeup styles, such as Korean makeup, Japanese makeup, Western makeup, Chinese makeup, etc., with corresponding controls. If the user clicks the control corresponding to Korean makeup, the application starts the virtual makeup try-on program, processes the facial image captured by the camera 31, and generates a synthesized image of the face with Korean makeup. The display screen 32 of the mobile device 3 displays this synthesized image. If the user is not satisfied and feels that the Korean makeup is not suitable for them, they can click the controls corresponding to other makeup styles to find a suitable or preferred style. If the user is satisfied with the Korean makeup, they can click or use voice control to trigger the playback of a Korean makeup tutorial video. After detecting the instruction, mobile device 3 can retrieve the corresponding Korean makeup video from the server or the mobile device itself and play it on the display screen. Users can then learn to apply makeup while watching the instructional video played on the edge of the makeup mirror.

[0060] In addition to playing videos, Mobile Device 3 can also analyze a user's skin type and suggest improvement plans. See also... Figure 8 As shown, when a user faces a beauty mirror, the camera 31 of the mobile device 3 captures an image of the user's face on the mirror side. The processor of the mobile device 3 extracts a skin image from the face image, classifies the skin texture to obtain a skin type, and determines an improvement plan based on the skin type. The display screen 32 of the mobile device 3 displays the skin type and the improvement plan. The user can check their skin condition by looking in the beauty mirror.

[0061] The beauty system provided in this embodiment can also be used for live streaming. For example, a user who is a beauty influencer frequently streams various makeup tutorials online. Users of the beauty system provided in this embodiment do not need many auxiliary devices, such as phone or tablet stands, makeup mirrors, lighting equipment, etc.; nor do they need to constantly adjust the positions of various devices to find the right angle for live streaming. For details, please refer to [link to relevant documentation]. Figure 8As shown, the mobile device 3 is connected to the beauty mirror 1 via connector 2. After the user starts a live stream using the mobile device 3, the camera 31 of the mobile device 3 is used to capture video of the person on the mirror side of the beauty mirror 1. The communication component of the mobile device 3 (not shown in the figure) is used to send the video of the person to a server (such as a server corresponding to the live streaming platform, a server cluster, or a virtual server, etc.) so that at least one client can obtain the video of the person from the server; it is also used to obtain interactive information sent by the at least one client from the server. The display screen 32 of the mobile device 3 is used to display the video of the person and the interactive information.

[0062] In this embodiment, connector 2 can simply be a mechanical structural component serving both a connecting and supporting function. The connector may include a connecting portion and a supporting portion. The connecting portion connects to the makeup mirror. The supporting portion supports the mobile device to maintain the relative position of the mobile device and the makeup mirror. Specifically, the connecting portion can be a suction cup, adhering to the makeup mirror. Alternatively, the connecting portion may have an adhesive layer, adhering to the makeup mirror. Or, the connecting portion and the makeup mirror may be connected via a snap-fit ​​structure; for example, the connecting portion has a slot, and the makeup mirror has a snap-fit, which engages with the slot to connect the connecting portion to the makeup mirror. Alternatively, see [link to relevant documentation]. Figure 9 As shown, the connecting portion is provided with at least one protrusion, and the at least one protrusion 21 may be... Figure 9 The “T”-shaped protrusion shown; see also, correspondingly, the T-shaped protrusion. Figure 10 As shown, the makeup mirror 1 has at least one socket 13 that mates with at least one protrusion 21. Specifically, the socket 13 is a "T"-shaped socket. To prevent the protrusion 21 from falling out of the socket 13, the socket also contains a recessed groove. After the "T"-shaped protrusion is inserted into the entrance of the socket 13, it moves along... Figure 10 Entering the dark groove in the middle y direction ( Figure 10 (The dotted line section) This way, the horizontal straight rod part of the "T"-shaped protrusion will be inserted into the concealed groove and will not come out of the socket 13. When removing it, simply move the protrusion in the opposite direction of the y-direction to the entrance of the socket 13, and then pull it out from the entrance of the socket 13.

[0063] The support portion includes, but is not limited to, any one of the following: support frame 22 (e.g., ...). Figure 11 As shown), the retractable clamping mechanism 23 (as shown) Figure 5 As shown), slot 24 (as shown) Figure 12 (As shown). For details, see [link / reference]. Figure 11 As shown, after the connecting part (such as the protrusion) of connector 2 is connected to the makeup mirror 1, a mobile phone or tablet can be placed on connector 2, and the support bracket 22 provides support to hold the back of the mobile phone or tablet. See also Figure 5 As shown in the structure, after the connecting part (such as a protrusion) of connector 2 is connected to the makeup mirror 1, the user can first open the two clamping arms of the retractable clamping mechanism 23 to place a mobile phone or tablet computer inside. Then, the user applies force to the two clamping arms of the retractable clamping mechanism 23 in opposite directions, or the two clamping arms return to their original position under their own restoring force, thus clamping the mobile phone or tablet computer between the two clamping arms. See also Figure 12 As shown, after the connector 2's connecting part (such as protrusion 21) is connected to the makeup mirror 1, the user can insert a mobile phone or tablet into the slot 25, and the rear wall of the support slot provides support.

[0064] In the beauty system provided in this embodiment, the beauty mirror and the mobile device can communicate wirelessly, such as via Bluetooth or Wi-Fi. Specifically, the beauty mirror is equipped with a wireless communication component; the beauty mirror communicates with the mobile device through the wireless communication component to receive control commands sent by the mobile device.

[0065] Of course, the makeup mirror and mobile device provided in this embodiment can communicate wirelessly or via a wired connection. That is, the connector mentioned in the above embodiment, in addition to its mechanical connection function, also has the function of electrically connecting the makeup mirror and the mobile device. Specifically, the connector includes a connector body and an electrical connection circuit. The connector body is provided with a connection structure for connecting the makeup mirror. The electrical connection circuit is disposed on the connector body and has a first electrical connection terminal 25 and a second electrical connection terminal, such as... Figure 9 and Figure 13 As shown, the first electrical connection terminal 25 is used to electrically connect the mobile device, and the second electrical connection terminal is used to electrically connect the beauty mirror.

[0066] In one feasible technical solution, such as Figure 9 and Figure 13 As shown, the connection structure includes at least one protrusion 21; at least a portion of the at least one protrusion 21 is provided with the second electrical connection terminal (not shown in the figure); as Figure 10 As shown, the makeup mirror 1 has at least one socket 13 adapted to the at least one protrusion 21; at least a portion of the at least one socket 13 has a third electrical connection terminal (not shown in the figure); the at least one protrusion 21 is inserted into the at least one socket 13, and the second electrical connection terminal is electrically connected to the third electrical connection terminal. In a specific implementation, the second electrical connection terminal and the third electrical connection terminal can be metal conductive terminals, and electrical connection can be achieved by contacting the two metal conductive terminals.

[0067] See also Figure 9 and Figure 13As shown, the first electrical connection terminal 25 is an electrical connector plug; the electrical connector plug is adapted to the charging interface of the mobile device 3. Thus, the makeup mirror provides charging power to the mobile device through the connector. Of course, the mobile device can also send control commands to the makeup mirror through the connector.

[0068] The above embodiments of the beauty system illustrate the collaborative work between a beauty mirror and a mobile device, achieving numerous beneficial effects. In fact, various mobile devices can be connected to the beauty mirror via a connector, and the beauty mirror can also communicate with various types of mobile devices. The following embodiment provides a beauty mirror with a connector. This connector can be used as an accessory for the beauty mirror. Specifically, the beauty mirror includes: a mirror assembly and a connector. The connector, disposed on the mirror assembly, is used to connect a mobile device to the mirror assembly, facilitating the mobile device to collect data from the mirror surface and perform corresponding tasks and / or control the operation of the beauty mirror based on the data.

[0069] The connector is disposed on the edge of the mirror of the mirror assembly, such that the mobile device is located at the edge of the mirror; or the connector is disposed on the back of the mirror of the mirror assembly, such that part of the mobile device is exposed and the other part is covered by the mirror assembly.

[0070] One implementation is that the connector includes a connecting body and an electrical connection circuit. The connecting body has a connecting structure for connecting to the makeup mirror. The electrical connection circuit is disposed on the connecting body and has a first electrical connection end and a second electrical connection end. The first electrical connection end is used to electrically connect to the mobile device, and the second electrical connection end is used to electrically connect to the makeup mirror.

[0071] It should be noted that the connection structure of the connector, the makeup mirror, and the mobile device, as well as the various functional scenarios that can be realized, can be found in the relevant content of the above embodiments, and will not be repeated here.

[0072] Specifically, the mirror assembly includes: a mirror, a mounting housing, a fill light assembly, a light guide plate, and a controller. The mounting housing is used to mount the mirror and has the connector. The fill light assembly is disposed within the space between the mirror and the mounting housing and is used to emit light. The light guide plate is disposed on the mirror and is used to reflect and scatter the light emitted by the fill light assembly into a surface light source. The controller is used to control the operation of the fill light assembly to adjust the color temperature and / or brightness according to the dimming command sent by the mobile device.

[0073] A makeup mirror may include: a mirror assembly, a hinge assembly, and a base. The mirror assembly is connected to the base via the hinge assembly.

[0074] The base is equipped with an intelligent control module, a microphone module, a wireless communication module, and a speaker module. The intelligent control module is connected to the microphone module, the wireless communication module, and the speaker module.

[0075] The intelligent control module receives user voice commands collected by the microphone module, generates a demand signal based on the user voice commands, sends the demand signal to the wireless communication module, and receives demand feedback information sent by the wireless communication module, controlling the speaker to play the demand feedback information; the demand feedback information is obtained by the server based on the demand signal and sent to the wireless communication module.

[0076] When a user issues a voice command, such as "Recommend a Western-style makeup step-by-step guide," the microphone module picks it up and sends it to the smart control module. The smart control module then generates a corresponding request signal based on the voice command and sends this signal to the wireless communication module. The wireless communication module uploads this signal to the server, which searches the network for and retrieves the corresponding request feedback information, namely "Western-style makeup step-by-step guide," and sends this feedback back to the smart control module via the wireless communication module. The smart control module then controls the speaker module to play this feedback, thus enabling voice interaction between the user and the makeup mirror. This provides the user with the necessary makeup guidance, freeing up their hands and improving makeup efficiency.

[0077] The mirror assembly includes a mirror, a fill light module, and a light guide plate. The fill light module includes at least two light sources. The light guide plate is fixed to the mirror and reflects and scatters the light emitted by the light sources to create a surface light source. The fill light module is connected to an intelligent control module and receives lighting control signals from the intelligent control module. Based on these signals, the module adjusts the color temperature and brightness of the light sources. The lighting control signals are generated by the intelligent control module based on lighting control instructions collected by the microphone module.

[0078] The mirror can be fitted with a fill light module connected to the intelligent control module. This module can include multiple LEDs with different color temperatures, which can be combined in various ways to create different adjustable modes. The intelligent control module adjusts the color temperature and brightness based on light control commands received from the microphone module. Alternatively, a light guide plate can be added and fixed to the mirror surface to emit and scatter the light emitted by the LEDs, creating a surface light source that evenly illuminates the user's face, providing fill light and better assisting with the makeup process.

[0079] The rotating assembly includes a rotating shaft and a connecting rod. The rotating shaft is connected to both the mirror assembly and the connecting rod, and is used to adjust the mirror assembly to a preset angle. The rotating shaft movably connects the mirror to the connecting rod, allowing the user to rotate the mirror to adjust the angle as needed.

[0080] Optionally, the base assembly may also include a power supply module connected to the wireless communication module for supplying power to the wireless communication module. Once the power supply module is turned on, the wireless communication module begins to operate and broadcasts matching information.

[0081] The power supply module starts supplying power, and the smart makeup mirror begins to work. First, the wireless communication module broadcasts matching information, and the user can then use a smart terminal to establish a network connection with the smart makeup mirror, thereby connecting to the server.

[0082] The base assembly also includes a touch module, which includes a power button: the touch module is connected to the intelligent control module, and the power button is used to control the power supply module to turn on and off.

[0083] The touch module also includes light adjustment buttons for adjusting the color temperature and brightness of the light source. The touch module can also include additional light adjustment buttons to adjust the color temperature and brightness of the light source. Similarly, volume adjustment buttons can be provided to adjust the speaker volume, and a mute button can be provided to disable the microphone module when voice functionality is not needed.

[0084] Specifically, the supplementary lighting module includes multiple LEDs with different color temperatures, combined in a specific manner to form various adjustable brightness modes. The three light sources are natural light (5500k), cool light (7000k), and warm light (4000k). Each mode's color temperature can be adjusted to five levels of brightness, with the intelligent control module adjusting the brightness based on the lighting control commands collected by the microphone module.

[0085] The solutions provided in the various embodiments of this application combine the hardware and software of a makeup mirror and a mobile device. By utilizing the sensors, cameras, and AR (augmented reality) technology of the mobile device (which is used in the virtual makeup try-on function mentioned above), a hardware and software integrated user experience can be formed. At the same time, this solution requires minimal modification to existing hardware, especially the makeup mirror, and has a low implementation cost.

[0086] AR, short for Augmented Reality, is a new technology developed on the basis of virtual reality. Also known as mixed reality, it's a technology that enhances a user's perception of the real world by using information provided by a computer system. It applies virtual information to the real world, overlaying computer-generated virtual objects, scenes, or system prompts onto real-world environments to enhance reality. In simpler terms, it's a novel human-computer interaction technology that uses cameras, sensors, real-time computing, and matching technology to overlay real facial images and virtual makeup onto a facial image in real time, generating a composite image with makeup. Users can experience a realistic, "immersive" feeling after applying makeup through the virtual reality system.

[0087] In summary, the technical solutions provided in this application can achieve functions such as "intelligent dimming, intelligent makeup try-on, one-click skin analysis, and rapid live streaming." When the intelligent dimming function is implemented, the ambient light information sensed by the mobile device's light sensor automatically adjusts the color temperature and / or brightness of the makeup mirror's fill light. For example, the phone's light sensor detects ambient light and sends it to the makeup mirror's fill light, which then intelligently adjusts the fill light. When the intelligent makeup function is implemented, AR makeup try-on is performed using the mobile device's front-facing camera, and makeup tutorials are provided. For example, the phone's front-facing camera captures a facial image, AR synthesizes the makeup, and displays the finished makeup image. When the user confirms they want the corresponding makeup tutorial, the phone plays the tutorial, and the user can apply makeup in front of the mirror. When the one-click skin analysis function is implemented, the user only needs to face the makeup mirror, and the mobile device can use its own camera and processing capabilities to perform AI skin texture detection, providing a skin texture report and improvement suggestions. For example, the phone's front-facing camera scans the face facing the makeup mirror, and the phone screen displays a skin texture analysis report and improvement suggestions. The user can check their skin condition in front of the makeup mirror. During a quick live stream, users simply apply makeup and speak in front of a beauty mirror. The camera of a mobile device connected to the mirror records the user's makeup application, and the microphone captures the audio of the user's speech. Both the video and audio are sent to the server for viewing by users on the network side. Users on the network side can also send interactive messages to the server. While applying makeup in front of the mirror, the live stream user can see these interactive messages displayed on their mobile device. In addition, the technical solution provided in this application embodiment can also implement a "product recommendation" function. For example, it can recommend makeup products used in a currently playing makeup tutorial video, such as foundation, mascara, blush, eyebrow pencil, lipstick, etc. This will be described in detail in the following embodiments.

[0088] The above embodiments describe the solution from a hardware structure perspective. The following description uses a mobile device as the execution subject to illustrate the makeup mirror control method. Specifically, the mobile device, the execution subject of the method described in this embodiment, is mounted on the makeup mirror via a connector. For example... Figure 14 As shown, the method includes:

[0089] S11. Collect ambient light information on the side of the makeup mirror;

[0090] S12. Based on the ambient light information, a dimming command is sent to the makeup mirror via a wireless communication component or the connector, so that the makeup mirror adjusts the color temperature and / or brightness according to the dimming command.

[0091] In step S12 above, the process of adjusting the color temperature and / or brightness according to the ambient light information can be implemented based on a preset adjustment strategy. This embodiment does not specifically limit the adjustment strategy, and it can be set according to actual design requirements.

[0092] This application also provides embodiments of data processing methods. Figure 15 A flowchart illustrating the data processing method is shown. Similarly, the execution entity of the method provided in this embodiment can be a mobile device. This mobile device is mounted on the makeup mirror via a connector. Specifically, the method includes:

[0093] S21. Acquire a face image from the mirror side of the beauty mirror;

[0094] S22. Perform image processing on the face image to generate a composite image with virtual makeup on the face;

[0095] S23. Display the synthesized image.

[0096] The above-mentioned S22 can be implemented using AR technology. This embodiment does not specifically limit the specific implementation process of AR technology.

[0097] Furthermore, the method may also include the following steps:

[0098] S24. In response to a video playback command triggered by the user for the synthesized image, obtain the video corresponding to the synthesized image;

[0099] S25. Play the video.

[0100] The tutorial for the synthesized image mentioned in S24 above can be obtained from the server or from the local device (such as a mobile phone, tablet computer, etc.).

[0101] In addition to displaying the composite image for user reference and playing corresponding videos to guide users in actual operation, the system can also recommend relevant product information to users. For example, it can draw the cosmetics and tools needed for the makeup look in the composite image. That is, the method provided in this embodiment may also include the following steps:

[0102] S26. Obtain product information related to the virtual makeup;

[0103] S27. Display the product information.

[0104] The product information may include the product name, product description, purchase link, QR code, etc. Users can simply touch the product purchase link displayed on the screen to enter the corresponding purchase interface and complete the order. Alternatively, users can scan the displayed QR code to enter the corresponding purchase interface and complete the order. Assuming the virtual makeup is Korean-style, the server can obtain information on the products needed for this Korean-style makeup, such as cosmetics (e.g., lipstick shades, mascara, eyebrow pencils, etc.) and tools (e.g., eyelash curlers, beauty blenders, etc.). This allows users to conveniently purchase the corresponding products without needing to remember the product information and then go to a specific e-commerce platform or purchase them offline.

[0105] Furthermore, the method may also include the following steps:

[0106] S28. Acquire a face image from the mirror side of the beauty mirror;

[0107] S29. Extract the skin image from the face image;

[0108] S30. Perform skin texture recognition on the skin image to obtain the skin texture type;

[0109] S31. Determine an improvement plan based on the skin type described;

[0110] S32. Display the skin type and the improvement plan.

[0111] In step S29 above, skin images can be extracted based on an elliptical skin model. More precisely, it should be about extracting the pixels corresponding to the skin in the face image. The collection of all skin pixels then forms the skin image. Simply put, only the skin portion of the face image is extracted; the eyes, hair, mouth, etc., are not included in the extraction. In specific implementation, the skin information can be mapped to the YCrCb space. In the CrCb two-dimensional space, these skin pixels are approximately distributed in an ellipse, resulting in a CrCb ellipse. The next time a coordinate (Cr, Cb) is received, it is only necessary to determine whether it is inside the ellipse (including the boundary). If it is, it is determined to be a skin pixel; otherwise, it is a non-skin pixel.

[0112] The above-mentioned S30 can be implemented using deep learning algorithms. For example, a deep learning model can be trained using training samples to obtain an optimized (i.e., fully learned) deep learning model. Then, the skin image is used as the input parameter to the deep learning model, and the deep learning model is executed to obtain the skin type. The skin type can include neutral, oily, dry, combination, acne-prone skin, etc. Of course, the obtained skin type can include one or more types; many people have a mixture of skin types, such as oily skin or acne-prone skin.

[0113] The above-mentioned S31 can utilize expert systems or knowledge graphs to determine an improvement plan based on the skin type. For details on expert systems and knowledge graphs, please refer to relevant existing technologies; these will not be elaborated upon here.

[0114] In a specific implementation, step S32 above can also alternately display facial images without the improvement plan and those with the improvement plan.

[0115] Furthermore, the method may also include the following steps:

[0116] S33. Collect video of the person on the side of the beauty mirror;

[0117] S34. Send the video of the person to the server so that at least one client can obtain the video of the person from the server;

[0118] S35. Obtain the interaction information sent by the at least one client from the server;

[0119] S36. Display the video of the person and the interactive information.

[0120] The above content describes a solution for recommending relevant product information to users when they try on makeup (i.e., using virtual makeup). In fact, when users apply makeup themselves using a beauty mirror, relevant data can also be recommended. Therefore, the method provided in this embodiment may further include the following steps:

[0121] S37. Obtain at least one user image from the mirror side of the beauty mirror, wherein the at least one user image is at least one frame of a video or an image captured at at least one moment.

[0122] S38. Analyze the at least one user image to obtain the analysis result;

[0123] S39. Based on the analysis results, obtain recommendation data;

[0124] S40. Display the recommended data.

[0125] In step S38 above, a neural network model can be used to analyze at least one user image. This neural network model can be trained using beauty-related training samples. These beauty-related training samples may include images and beauty behavior labels. The analysis can be user behavior analysis or user latent need analysis. For example, an image showing a user drawing eyebrows with an eyebrow pencil corresponds to the beauty behavior label "drawing eyebrows" or the user's latent need is to buy an eyebrow pencil; an image showing a user patting their cheeks with both hands corresponds to the beauty behavior label "applying toner" or the user's latent need is to buy toner; an image showing a user applying makeup with a beauty sponge corresponds to the beauty behavior label "applying foundation" or the user's latent need is to buy foundation; and so on. The images from the above training samples are used as input parameters to the model to be trained, and the model is executed to obtain the output result. Based on the output result and the beauty behavior labels corresponding to the images, the model to be trained is optimized until it meets the optimization stopping condition, such as when the loss function calculated based on the output result and the beauty behavior labels corresponding to the images is less than a preset value.

[0126] After the neural network model has been trained, at least one user image can be used as the input parameter of the neural network model, and the analysis results can be obtained by executing the neural network model.

[0127] In specific implementations, S39 described above can be implemented by the server. That is, S39 "obtain recommendation data based on the analysis results" includes: sending the user behavior data to the server so that the server can obtain recommendation data related to the user behavior data; and receiving the recommendation data fed back by the server.

[0128] Continuing with the example of beauty-related behaviors, if the analysis result is "applying foundation," then product information related to this result can be obtained as recommendation data, such as beauty blenders, liquid foundation, and cream foundation. Similarly, if the analysis result is "drawing eyebrows," then product information related to "drawing eyebrows" can be obtained as recommendation data, such as eyebrow pencils, eyebrow powder, and eyebrow brushes.

[0129] In practice, the analysis results can be pre-associated with relevant product identifiers, and the established relationship list can be stored in memory. When recommendations are needed, the relevant recommendation data for a specific analysis result can be retrieved by querying this relationship list.

[0130] Of course, user behavior data can include not only beauty-related behaviors, but also other behaviors. For example, when looking in the mirror and fiddling with one's hair, hair styling products such as hairspray and hair wax can be used as recommendation data.

[0131] Besides the scenarios mentioned above, the following scenarios may also exist in reality. For example, a store may display makeup mirrors for sale. Users or store clerks can connect their mobile phones to the makeup mirrors via a connector. The makeup mirrors detect the connection, establish a communication connection, and send descriptive information about the mirrors to the phone, such as usage instructions, function descriptions, prices, and introductions to different models of the same brand (e.g., functional differences). Therefore, the method provided in this embodiment may also include the following steps:

[0132] S41. After establishing a communication connection with the makeup mirror, obtain and display the description information of the makeup mirror.

[0133] The description information can be stored locally on the makeup mirror, for example, by having an internal storage medium (such as a memory) containing the description information. After the makeup mirror successfully establishes a communication connection with the mobile phone, it sends the description information to the mobile phone for display. Alternatively, after establishing a communication connection with the makeup mirror, the mobile phone obtains the makeup mirror's identifier (such as model number) and sends it to the server so that the server can retrieve the corresponding description information based on the makeup mirror's identifier. This description information may include: usage guidance information, pricing information, feature introduction, and introductions to different models of the same brand of makeup mirrors (such as differences in features), etc.

[0134] Figure 16 A schematic diagram of the structure of a mobile device according to an embodiment of this application is shown. Figure 16 As shown, the mobile device includes a memory 101 and a processor 102. The memory 101 can be configured to store various other data to support operation on the mobile device. Examples of this data include instructions for any application or method operating on the mobile device. The memory 101 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0135] The processor 102, coupled to the memory 101, is used to execute the program stored in the memory for:

[0136] Collect ambient lighting information from the side of the makeup mirror;

[0137] Based on the ambient light information, a dimming command is sent to the makeup mirror via a wireless communication component or the connector, so that the makeup mirror adjusts the color temperature and / or brightness according to the dimming command.

[0138] In addition to the functions mentioned above, the processor 102 can also perform other functions when executing the program in the memory 101, as described in the previous embodiments.

[0139] Furthermore, such as Figure 16 As shown, the electronic device also includes other components such as a communication component 103, a power supply component 104, and a display 105. Figure 16 The diagram only shows a portion of the components and does not imply that the mobile device only includes... Figure 16 The components shown.

[0140] Accordingly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a computer, can implement the steps or functions of the beauty mirror control method provided in the above embodiments.

[0141] One embodiment of this application also provides another mobile device, which has the same structure as described above. Figure 16 Similarly. Specifically, the mobile device includes: a memory and a processor. The memory is used to store programs. The processor, coupled to the memory, is used to execute the programs stored in the memory for:

[0142] Capture the facial image on the mirror side of the beauty mirror;

[0143] The face image is processed to generate a composite image with virtual makeup on the face;

[0144] The synthesized image is displayed.

[0145] In addition to the functions mentioned above, the processor can also perform other functions when executing programs in memory, as described in the preceding embodiments.

[0146] Furthermore, such as Figure 16 As shown, mobile devices also include communication components, power supply components, displays, and other components. Figure 16 The diagram only shows a portion of the components and does not imply that the mobile device only includes... Figure 16 The components shown.

[0147] Accordingly, embodiments of this application also provide a computer-readable storage medium storing a computer program, which, when executed by a computer, can implement the data processing method steps or functions provided in the above embodiments.

[0148] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0149] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A makeup system characterized by, The system comprises: a makeup mirror having a mirror surface; a connector arranged on the makeup mirror; a mobile device connected to the makeup mirror through the connector, configured to collect data on the side of the mirror surface of the makeup mirror, and perform corresponding tasks based on the data and / or control the operation of the makeup mirror.

2. The system according to claim 1, wherein: the connector is arranged at the edge of the mirror surface of the makeup mirror, so that the mobile device is located at the edge of the mirror surface; or the connector is arranged at the back of the mirror surface of the makeup mirror, so that a part of the mobile device is exposed and another part is hidden by the makeup mirror.

3. The makeup system according to claim 2, wherein, the mobile device comprises a display screen; the display screen is exposed and not hidden by the makeup mirror, and is located on the same side as the mirror surface.

4. The makeup system of claim 2, wherein, the mobile device is located above the mirror surface of the makeup mirror.

5. The make-up system according to any one of claims 1 to 4, characterized in that, the mobile device comprises a light sensor; the light sensor is configured to collect ambient light information, and send a light adjustment instruction to the makeup mirror according to the ambient light information; the makeup mirror comprises a light supplement assembly and a controller, and the controller is configured to control the light supplement assembly to adjust the color temperature and / or brightness according to the received light adjustment instruction.

6. The makeup system according to any one of claims 1 to 4, wherein, the mobile device comprises: a camera configured to collect a face image on the side of the mirror surface of the makeup mirror; a processor configured to perform image processing on the face image to generate a composite image with a virtual makeup on the face; a display screen configured to display the composite image.

7. The system according to claim 6, wherein: the mobile device is further configured to, in response to a video playing instruction triggered by a user for the composite image, obtain a video corresponding to the composite image, and play the video.

8. The makeup system according to any one of claims 1 to 4, wherein, the mobile device comprises: a camera configured to collect a face image on the side of the mirror surface of the makeup mirror; a processor configured to extract a skin image from the face image, classify the skin image to obtain a skin type, and determine an improvement scheme according to the skin type; a display screen configured to display the skin type and the improvement scheme.

9. The makeup system according to any one of claims 1 to 4, wherein, the mobile device comprises: a camera configured to collect a video of a person on the side of the mirror surface of the makeup mirror; a communication component configured to send the video of the person to a server, so that at least one client obtains the video of the person from the server, and further configured to obtain interactive information sent by the at least one client from the server; a display screen configured to display the video of the person and the interactive information.

10. The makeup system according to any one of claims 1 to 4, wherein, the connector comprises: a connecting portion configured to connect the makeup mirror; a supporting portion configured to support the mobile device to maintain the relative position relationship between the mobile device and the makeup mirror.

11. The makeup system of claim 10, wherein, The supporting portion comprises any one of the following: a slot, a supporting frame, and a telescopic clamping mechanism.

12. The makeup system according to any one of claims 1 to 4, wherein, The makeup mirror is provided with a wireless communication component; The makeup mirror is in communication connection with the mobile device through the wireless communication component to receive a control instruction sent by the mobile device.

13. The makeup system according to any one of claims 1 to 4, wherein, the connector comprises: a connecting body provided with a connecting structure configured to connect the makeup mirror; An electrical connection circuit is arranged on the connecting body and has a first electrical connection end for electrically connecting the mobile device and a second electrical connection end for electrically connecting the makeup mirror.

14. The makeup system of claim 13, wherein, The connecting structure includes at least one protrusion; The second electrical connection end is arranged on at least part of the protrusion; The makeup mirror is provided with at least one socket matched with the at least one protrusion, and a third electrical connection end is arranged on at least part of the socket; The at least one protrusion is inserted into the at least one socket, and the second electrical connection end is electrically connected with the third electrical connection end.

15. The makeup system of claim 13, wherein, The first electrical connection end is an electrical connection plug; The electrical connection plug is matched with a charging interface of the mobile device.

16. The makeup system according to claim 15, wherein: The makeup mirror provides charging power for the mobile device through the connector; and / or The mobile device sends control instructions to the makeup mirror through the connector.

17. A cosmetic mirror, characterized by It comprises: a mirror assembly; a connector arranged on the mirror assembly for connecting a mobile device to connect the mobile device to the mirror assembly, so that the mobile device can collect data on the side of the mirror of the makeup mirror and perform corresponding tasks based on the data and / or control the operation of the makeup mirror.

18. The makeup mirror according to claim 17, wherein: The connector is arranged at the edge of the mirror of the mirror assembly, so that the mobile device is located at the edge of the mirror; or The connector is arranged at the back of the mirror of the mirror assembly, so that part of the mobile device is exposed and part of the mobile device is hidden by the mirror assembly.

19. The makeup mirror according to claim 17 or 18, characterized in that, The mirror assembly comprises: a mirror; a mounting shell for mounting the mirror, the mounting shell being provided with the connector; a light supplementing lamp assembly arranged in the space between the mirror and the mounting shell for emitting light; a light guide plate arranged on the mirror for reflecting and scattering the light emitted by the light supplementing lamp assembly into a surface light source; a controller for controlling the light supplementing lamp assembly to adjust color temperature and / or brightness according to the dimming instructions sent by the mobile device.

20. The makeup mirror according to claim 17 or 18, characterized in that, The connector comprises: a connecting body provided with a connecting structure for connecting the makeup mirror; an electrical connection circuit arranged on the connecting body and having a first electrical connection end for electrically connecting the mobile device and a second electrical connection end for electrically connecting the makeup mirror.

21. A method of controlling a cosmetic mirror, the method comprising: The method is suitable for a mobile device arranged on a makeup mirror through a connector, and the method comprises: collecting environmental lighting information on the side of the mirror of the makeup mirror; sending dimming instructions to the makeup mirror through a wireless communication assembly or the connector according to the environmental lighting information, so that the makeup mirror adjusts color temperature and / or brightness according to the dimming instructions.

22. A data processing method, characterized by, The method is suitable for a mobile device arranged on a makeup mirror through a connector, and the method comprises: collecting a face image on the side of the mirror of the makeup mirror; performing image processing on the face image to generate a composite image with a virtual makeup on the face; displaying the composite image.

23. The method of claim 22, wherein, It further comprises: In response to a video playing instruction triggered by a user for the composite image, a video corresponding to the composite image is acquired; The video is played.

24. The method of claim 22, wherein, Further comprising: Acquiring product information related to the virtual makeup; Displaying the product information.

25. The method of any one of claims 22-24, wherein, Further comprising: Collecting a face image on the mirror side of the makeup mirror; Extracting a skin image from the face image; Performing skin quality recognition on the skin image to obtain a skin quality type; Determining an improvement scheme according to the skin quality type; Displaying the skin quality type and the improvement scheme.

26. The method of any one of claims 22-24, wherein, Further comprising: Collecting a person video on the mirror side of the makeup mirror; Sending the person video to a server, so that at least one client acquires the person video from the server; Acquiring interactive information sent by the at least one client from the server; Displaying the person video and the interactive information.

27. The method of claim 25, wherein, Further comprising: Acquiring at least one user image on the mirror side of the makeup mirror, wherein the at least one user image is at least one image in a video or an image collected at at least one time point; Analyzing the at least one user image to obtain an analysis result; According to the analysis result, acquiring recommendation data; Displaying the recommendation data.

28. The method of claim 27, wherein, According to the analysis result, acquiring recommendation data, comprising: Sending user behavior data to a server, so that the server acquires recommendation data related to the user behavior data; Receiving the recommendation data fed back by the server.

29. The method of any one of claims 22-24, wherein, Further comprising: After establishing a communication connection with the makeup mirror, acquiring and displaying description information of the makeup mirror.

30. A mobile device, comprising: Including a memory and a processor, wherein, The memory is used to store a program; The processor is coupled with the memory and is used to execute the program stored in the memory, so as to: Collect environmental lighting information on the mirror side of the makeup mirror; According to the environmental lighting information, send a light adjusting instruction to the makeup mirror through a wireless communication component or a connector, so that the makeup mirror adjusts the color temperature and / or brightness according to the light adjusting instruction.

31. A mobile device, comprising: The mobile device is arranged on the makeup mirror in any one of claims 17-20 through a connector, and the mobile device comprises a memory and a processor, wherein, The memory is used to store a program; The processor is coupled with the memory and is used to execute the program stored in the memory, so as to: Collect a face image on the mirror side of the makeup mirror; Perform image processing on the face image to generate a composite image with a virtual makeup on the face; Display the composite image.

Images