Vehicle-mounted cosmetic mirror interaction method, device, equipment, medium and product
By installing a camera on the car's makeup mirror and using AI analysis to generate makeup recommendations, the problem of the limited functionality of the car's makeup mirror is solved, and intelligent makeup suggestions are displayed.
Patent Information
- Application Number
- CN202411246379.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-06
- Publication Date
- 2025-11-04
- Estimated Expiration
- 2044-09-06
AI Technical Summary
Existing car makeup mirrors have limited functionality and cannot meet users' needs for intelligent makeup application.
By installing a camera on the car's vanity mirror, the system captures the user's facial image, performs AI analysis, generates makeup recommendations, and displays them on the mirror's screen.
It realizes the intelligentization of in-car makeup mirrors, which can generate personalized makeup recommendations based on the user's facial features to meet the user's diverse makeup needs.
Smart Images

Figure CN119128266B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] Embodiments of the present application relate to the technical field of vehicles, and in particular to an interaction method and device for a vehicle-mounted cosmetic mirror, an apparatus, a medium and a product. BACKGROUND
[0002] With the continuous enrichment of vehicle functions, more and more people have the demand to make up or retouch in the vehicle. To meet the diversified needs of vehicle users, vehicle-mounted cosmetic mirrors are generally added in vehicles.
[0003] In the related art, a vehicle-mounted cosmetic mirror with light is provided on a sun visor to facilitate users to make up in front of the vehicle-mounted cosmetic mirror. However, the vehicle-mounted cosmetic mirror has a single function, and users can only perform simple operations on the hardware body of the vehicle-mounted cosmetic mirror, which cannot meet the intelligent needs of users for the vehicle-mounted cosmetic mirror. SUMMARY
[0004] The present application provides an interaction method and device for a vehicle-mounted cosmetic mirror, an apparatus, a medium and a product, and the technical solution is as follows:
[0005] According to an aspect of the present application, an interaction method for a vehicle-mounted cosmetic mirror is provided, which comprises:
[0006] obtaining a facial image of a first subject based on a camera on the vehicle-mounted cosmetic mirror;
[0007] performing AI analysis on the facial image, generating corresponding target recommendation information based on the facial image, wherein the target recommendation information includes makeup recommendation content for the first subject;
[0008] displaying the target recommendation information on a mirror display screen of the vehicle-mounted cosmetic mirror.
[0009] According to an aspect of the present application, an interaction device for a vehicle-mounted cosmetic mirror is provided, which comprises:
[0010] an obtaining module configured to obtain a facial image of a first subject based on a camera on the vehicle-mounted cosmetic mirror;
[0011] a generating module configured to perform AI analysis on the facial image, and generate corresponding target recommendation information based on the facial image, wherein the target recommendation information includes makeup recommendation content for the first subject;
[0012] a display module configured to display the target recommendation information on a mirror display screen of the vehicle-mounted cosmetic mirror.
[0013] In accordance with another aspect of the present application, a computer device is provided, comprising a processor and a memory, the memory having stored therein at least one program, the at least one program being loaded and executed by the processor to implement the interaction method of the vehicle-mounted cosmetic mirror as described in the above aspect.
[0014] In accordance with another aspect of the present application, a computer storage medium is provided, the computer readable storage medium having stored therein at least one computer instruction, the at least one computer instruction being loaded and executed by a processor to implement the interaction method of the vehicle-mounted cosmetic mirror as described in the above aspect.
[0015] In accordance with another aspect of the present application, a computer program product is provided, the computer program product comprising a computer program stored in a computer readable storage medium; the computer program being read and executed by a processor of a computer device from the computer readable storage medium, so that the computer device executes the interaction method of the vehicle-mounted cosmetic mirror as described in the above aspect.
[0016] The technical solutions provided by the embodiments of the present application have at least the following beneficial effects:
[0017] When the vehicle-mounted cosmetic mirror receives the trigger condition, the vehicle-mounted cosmetic mirror enters the open state from the closed state, a camera is installed above the vehicle-mounted cosmetic mirror, the vehicle-mounted cosmetic mirror in the open state acquires the face image of the first subject through the camera, then performs AI analysis on the face image, and generates target recommendation information according to the face image of the first subject. The target recommendation information is a makeup recommendation content generated according to the facial features corresponding to the face image of the first subject, for example, a corresponding makeup suggestion is generated according to the facial features of the first subject, and the target recommendation information is displayed on the mirror display screen of the vehicle-mounted cosmetic mirror. The vehicle-mounted cosmetic mirror in the embodiment of the present application can acquire and analyze the face image of the first subject, and then generate targeted target recommendation information and display it on the mirror display screen of the vehicle-mounted cosmetic mirror. This way breaks the single function of the traditional vehicle-mounted cosmetic mirror. This intelligent vehicle-mounted cosmetic mirror can meet the diversity demand for in-vehicle makeup. BRIEF DESCRIPTION OF DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.
[0019] Figure 1 is a system architecture schematic diagram of the computer device provided by an exemplary embodiment of the present application;
[0020] Figure 2 is a flow chart of an interactive method of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0021] Figure 3 is a flow chart of an interactive method of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0022] Figure 4 is a schematic diagram of an interactive method of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0023] Figure 5 is a flow chart of an interactive method of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0024] Figure 6 is a schematic diagram of an interactive method of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0025] Figure 7 is a schematic diagram of an interactive method of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0026] Figure 8 is a structural block diagram of an interactive device of a vehicle-mounted cosmetic mirror provided by an exemplary embodiment of the present application;
[0027] Figure 9 is a structural block diagram of a computer device provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION
[0028] In order to make the objects, technical solutions and advantages of the present application clearer, the following will further describe the embodiments of the present application in conjunction with the accompanying drawings.
[0029] The exemplary embodiments will be described in detail herein with reference to the accompanying drawings. The following description is with reference to the drawings, in which like numerals represent like elements, unless otherwise described in the following description. The embodiments described in the following exemplary embodiments are not representative of all embodiments consistent with the present application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of the present application as detailed in the appended claims.
[0030] The terms used in the present disclosure are merely for the purpose of describing particular embodiments and are not intended to limit the present disclosure. The singular forms "a," "an," and "the" used in the present disclosure are also intended to include the plural forms, unless the context clearly indicates otherwise.
[0031] In the embodiments of the present application, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data authorized by the user or authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the attack operation and other object behaviors involved in the present application are obtained under sufficient authorization.
[0032] It should be understood that although the terms first, second, etc. can be employed in this disclosure to describe various information, the information should not be limited to these terms. These terms are only used to distinguish one piece of information from another piece of information of the same type. For example, a first parameter can also be referred to as a second parameter without departing from the scope of the present disclosure, and similarly, a second parameter can also be referred to as a first parameter. Depending on the context, the word "if" as used herein can be interpreted as "when" or "upon" or "in response to determining".
[0033] First, the terms involved in the embodiments of the present application are briefly introduced:
[0034] Light sensor: A light sensor is a sensor device used to detect and measure the intensity of ambient light. It converts light signals into electrical signals, allowing it to sense changes in the surrounding light. In the embodiments of the present application, the light sensor is used to detect the brightness of the environment inside the vehicle. When the light sensor detects that the light is dim, it will input a signal to the micro control processor, and the micro control processor will adjust the brightness and color temperature of the LED lights on the vehicle-mounted makeup mirror according to the input signal of the light sensor, to provide suitable lighting conditions.
[0035] Touch sensor: A touch sensor is a sensor device that operates based on the user's touch action. Touch sensors are usually integrated into touchscreens or other touch interfaces. In the embodiments of the present application, a touch sensor is provided on the surface of the vehicle-mounted makeup mirror, allowing the user to control various functions such as light switching, brightness adjustment and mode selection by touching the vehicle-mounted makeup mirror. The touch sensor can recognize the user's touch gestures such as tapping, sliding or long pressing, and convert the touch gestures into control signals.
[0036] Micro-control processor: also referred to as processor, micro-control processor is a single-chip computer system integrating computer core functions. The micro-control processor can receive signals or data from various sensors, such as receiving signals or data of light sensors and touch sensors, analyze the signals or data by executing built-in programs and algorithms, and make corresponding decisions. Alternatively, the micro-control processor can send control instructions to other components, for example, when the light sensor detects that the light is too strong, the micro-control processor will issue a control instruction to reduce the light intensity of the vehicle-mounted cosmetic mirror.
[0037] Artificial intelligence (AI): using digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceiving the environment, acquiring knowledge and using knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology of computer science, which tries to understand the essence of intelligence and produce a new intelligent machine that can react in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines, so that machines have the functions of perception, reasoning and decision-making.
[0038] With the continuous enrichment of vehicle functions, more and more people have the demand of making up and retouching in the vehicle. In order to meet the diversified needs of vehicle users, vehicle-mounted cosmetic mirrors are generally added in vehicles. In the related art, only vehicle-mounted cosmetic mirrors with lights are arranged on sun visors to facilitate users to make up in front of the vehicle-mounted cosmetic mirrors. However, the vehicle-mounted cosmetic mirror is single in function, and the user can only perform simple operations on the hardware body of the vehicle-mounted cosmetic mirror, which cannot meet the intelligent needs of the user for the vehicle-mounted cosmetic mirror.
[0039] In the embodiments of the present application, the vehicle includes a vehicle-mounted cosmetic mirror. In the case of a triggering condition, the vehicle-mounted cosmetic mirror enters an open state. For example, in response to a touch operation of a user on the vehicle-mounted cosmetic mirror, a touch sensor in the vehicle-mounted cosmetic mirror receives an opening request of the user and sends the opening request to a micro control processor. The micro control processor outputs an opening instruction to a mirror display screen of the vehicle-mounted cosmetic mirror, and the vehicle-mounted cosmetic mirror enters an open state. After the vehicle-mounted cosmetic mirror is opened, a light sensor in the vehicle-mounted cosmetic mirror detects the light intensity in the vehicle. At the same time, a camera on the vehicle-mounted cosmetic mirror captures a facial image of the user. The light sensor and the camera respectively send the light intensity and the facial image to the micro control processor. The micro control processor adjusts the brightness and color temperature of the LED light band on the vehicle-mounted cosmetic mirror according to the light intensity. The micro control processor performs AI analysis on the facial image, obtains an analysis result (target recommendation information) according to the facial state information presented by the facial image, and displays the target recommendation information on the mirror display screen of the vehicle-mounted cosmetic mirror. The target recommendation information includes a makeup recommendation content for the user, for example, a recommendation content including a makeup effect mode, or a recommendation content for a makeup style mode, etc. Alternatively, the user can interact with the target recommendation information displayed on the mirror display screen. For example, the user clicks the target recommendation information displayed on the mirror to view a corresponding makeup tutorial.
[0040] Reference is made to Figure 1 which shows a system architecture schematic diagram of a computer device provided by an embodiment of the present application. The system architecture can include a vehicle 110, a vehicle-mounted cosmetic mirror 120 in the vehicle 110, a personal terminal 130 and a server 140 for controlling the vehicle 110.
[0041] In some embodiments, the vehicle 110 is installed with the vehicle-mounted cosmetic mirror 120. Alternatively, the vehicle-mounted cosmetic mirror 120 is a smart vehicle-mounted cosmetic mirror, which integrates multiple technologies to realize intelligent adjustment and personalized service. Alternatively, the vehicle-mounted cosmetic mirror 120 includes a mirror display screen 121, which has the function of intelligently adjusting brightness and color temperature to meet the makeup needs in different light environments. An angle adjustment bracket 124 is installed on the side of the vehicle-mounted cosmetic mirror 120, which can help users to adjust in multiple directions through angle rotation. A micro control processor (processor for short) is integrated in the vehicle-mounted cosmetic mirror 120. The processor can perform AI analysis on the facial image of the user to obtain target recommendation information, for example, analyze the skin state of the user, recommend a makeup scheme to the user based on the skin state, and display the target recommendation information on the mirror display screen 121, so as to realize personalized makeup scheme recommendation for the user. In addition, the vehicle-mounted cosmetic mirror 120 has a communication module inside, which supports connection with smart devices. The user can share his own makeup results based on the vehicle-mounted cosmetic mirror 120.
[0042] Optionally, in response to sensing a trigger condition for the vehicle-mounted cosmetic mirror 120, the vehicle-mounted cosmetic mirror 120 enters an open state. Illustratively, the vehicle-mounted cosmetic mirror 120 internally installs a voice collection component, the voice collection component collects a voice open instruction of a user, and controls the vehicle-mounted cosmetic mirror 120 to enter the open state. Illustratively, the vehicle-mounted cosmetic mirror 120 internally integrates a touch sensor, in response to a touch operation for the touch sensor, for example, a click operation on a switch on the vehicle-mounted cosmetic mirror 120, the touch sensor receives an open request of a user and sends the open request to a processor, and the processor outputs an open instruction to a mirror display screen 121 and controls the vehicle-mounted cosmetic mirror 120 to enter the open state. Illustratively, a user controls the vehicle-mounted cosmetic mirror 120 to enter the open state through a remote open instruction of a personal terminal 130.
[0043] In some embodiments, the vehicle-mounted cosmetic mirror 120 is mounted with an LED light strip 123 at an edge. Optionally, the vehicle-mounted cosmetic mirror 120 internally integrates a light sensor, after the vehicle-mounted cosmetic mirror is opened, the light sensor in the vehicle-mounted cosmetic mirror detects light intensity in the vehicle, and the light sensor sends the light intensity to a micro-control processor, and the processor adjusts brightness and color temperature of the LED light strip 123 on the vehicle-mounted cosmetic mirror according to the light intensity to provide appropriate light compensation for the user.
[0044] In some embodiments, the vehicle-mounted cosmetic mirror 120 is mounted with a camera 122 above, after the vehicle-mounted cosmetic mirror is opened, the camera 122 automatically captures a facial image of a user, the camera 122 sends the facial image to a processor, the processor performs AI analysis on the facial image, and feeds back analysis results (target recommendation information) after AI analysis to the vehicle-mounted cosmetic mirror, and displays the target recommendation information on a mirror display screen 121 of the vehicle-mounted cosmetic mirror.
[0045] In some embodiments, the vehicle-mounted cosmetic mirror 120 can communicate with the personal terminal 130 through a wireless network (for example, Bluetooth). Optionally, the personal terminal 130 remotely controls the vehicle-mounted cosmetic mirror 120, for example, controls the vehicle-mounted cosmetic mirror 120 to enter the open state through the personal terminal 130, and for example, adjusts brightness and color temperature of the vehicle-mounted cosmetic mirror 120 through the personal terminal 130. Optionally, a user views data stored by a processor in the vehicle-mounted cosmetic mirror 120 on the personal terminal 130, for example, views facial images, skin states, recommended cosmetic information and the like data on the personal terminal 130. Optionally, a user interacts with other programs through the personal terminal 130, for example, shares own cosmetic results to a third-party program through the personal terminal 130.
[0046] In the embodiment of the present application, the user sends a control instruction to the vehicle-mounted cosmetic mirror 120 in the vehicle 110 through the personal terminal 130. Alternatively, the control instruction sent by the personal terminal 130 is delivered to the vehicle-mounted cosmetic mirror 120 by the server 140, and the processor in the vehicle-mounted cosmetic mirror 120 receives and executes the control instruction.
[0047] In some embodiments, the vehicle 110 includes a conventional car, a smart car, an unmanned vehicle, and the like, which can be manually driven by a driver or driven by an automatic driving system to realize unmanned driving. Optionally, the vehicle 110 is also installed with a vehicle-mounted sensor, an instrument panel, a steering wheel, a controller, a data processor, and the like. The above-mentioned functional modules can realize the exchange and sharing between traffic participants by means of modern mobile communication and network technology such as Internet of Vehicles, 5G (5th Generation Mobile Networks), and V2X (Vehicle-to-Everything), so as to have the functions of sensing and perception, decision planning, control execution, and the like in complex environment.
[0048] In some embodiments, the personal terminal 130 can be an electronic device such as a mobile phone, a tablet computer, a wearable device, a personal computer (PC), and the like. The personal terminal 130 can be installed with a client running a target application, which can be an application for sending a control instruction to the vehicle-mounted cosmetic mirror 120, and the present application does not limit this.
[0049] Alternatively, the server 140 can be a standalone physical server, a server cluster or a distributed system composed of multiple physical servers, a cloud server providing cloud computing services, a cloud database, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The cloud server of the big data and artificial intelligence platform can provide artificial intelligence cloud services. The server 140 can be a background server of the target application, which is used to provide background services for the client of the target application.
[0050] Among them, the vehicle-mounted cosmetic mirror 120 and the server 140 are connected through a communication network; the personal terminal 130 and the vehicle-mounted cosmetic mirror 120 are connected through a communication network; the personal terminal 130 and the server 140 are connected through a communication network.
[0051] In combination with the above-mentioned name introduction and system architecture diagram, the interactive method of the vehicle-mounted cosmetic mirror provided in the embodiment of the present application is described. Figure 2is a flowchart of an interaction method of a vehicle-mounted cosmetic mirror provided by an example embodiment of the present application. As shown in Figure 2 The method comprises at least the following steps:
[0052] Step 210: Obtain a face image of a first subject based on a camera on the vehicle-mounted cosmetic mirror.
[0053] In some embodiments, the vehicle-mounted cosmetic mirror enters an open state from a closed state when a trigger condition is met, and after entering the open state, a face image of a first subject is obtained based on a camera on the vehicle-mounted cosmetic mirror. The first subject is located inside the vehicle, and the first subject can be the driver, or the first subject is a passenger on the co-driver seat, or the first subject is a passenger on the rear seat. The present application does not limit the first subject.
[0054] The trigger condition is used to trigger the vehicle-mounted cosmetic mirror to enter the open state from the closed state. The open state refers to a working mode of the vehicle-mounted cosmetic mirror. Optionally, after the trigger condition is met, the power supply of the vehicle-mounted cosmetic mirror is started and enters the working mode. In the open state, all functions of the vehicle-mounted cosmetic mirror are in an available state.
[0055] In some embodiments, the trigger condition for the vehicle-mounted cosmetic mirror to enter the open state comprises at least one of the following:
[0056] · In response to receiving a touch-on instruction for the vehicle-mounted cosmetic mirror;
[0057] · In response to receiving a remote-on instruction for the vehicle-mounted cosmetic mirror;
[0058] · In response to receiving a voice-on instruction for the vehicle-mounted cosmetic mirror.
[0059] In some embodiments, the trigger condition is to receive a touch-on instruction for the vehicle-mounted cosmetic mirror. The touch-on instruction refers to sending a control signal to the vehicle-mounted cosmetic mirror through a touch operation, which is an instruction for activating or starting the vehicle-mounted cosmetic mirror to enter the open state. Optionally, a touch sensor is arranged in the mirror display screen of the vehicle-mounted cosmetic mirror, which can recognize touch gestures of the first subject such as tapping, sliding or long pressing, and convert the touch gestures into control signals. Optionally, a micro control processor (referred to as processor) is integrated in the vehicle-mounted cosmetic mirror. In response to the touch operation of the first subject on the vehicle-mounted cosmetic mirror, the touch sensor in the vehicle-mounted cosmetic mirror receives the opening request of the first subject and converts the opening request into a control signal and sends it to the processor. After receiving the opening request, the processor issues a touch-on instruction to the vehicle-mounted cosmetic mirror, and the vehicle-mounted cosmetic mirror enters the open state.
[0060] In some embodiments, the triggering condition is receiving a remote start instruction for the vehicle-mounted cosmetic mirror. The remote start instruction refers to sending a remote control signal to the vehicle-mounted cosmetic mirror through remote operation, which is used to activate or start the vehicle-mounted cosmetic mirror to enter the start state. Optionally, the vehicle-mounted cosmetic mirror is internally integrated with a communication module, and the vehicle-mounted cosmetic mirror can interact with a third-party terminal device through the communication module. The third-party terminal device is installed with an application program for controlling and managing the vehicle-mounted cosmetic mirror to interact. Optionally, the third-party terminal device is installed with an application program, and the application program has a start button for controlling the vehicle-mounted cosmetic mirror to enter the start state. The third-party terminal device includes, but is not limited to, at least one of a mobile phone, a tablet, a computer, a smart watch, and a smart key. In response to receiving the remote operation for the vehicle-mounted cosmetic mirror, that is, in response to the first subject triggering the operation of the start button on the third-party terminal device, the vehicle-mounted cosmetic mirror enters the start state.
[0061] In some embodiments, the triggering condition is receiving a voice start instruction for the vehicle-mounted cosmetic mirror. The voice start instruction refers to sending a voice control signal to the vehicle-mounted cosmetic mirror through voice operation, which is used to activate or start the vehicle-mounted cosmetic mirror to enter the start state. Optionally, the vehicle-mounted cosmetic mirror is internally installed with a voice collection component, and the voice collection component collects the voice start instruction of the first subject to control the vehicle-mounted cosmetic mirror to enter the start state. Optionally, the voice start instruction is a fixed voice instruction, or the voice start instruction is a custom voice instruction including a preset keyword. The voice start instruction is a fixed voice instruction, for example, the fixed voice instruction is "turn on the cosmetic mirror". The voice start instruction is a custom voice instruction including a preset keyword, for example, the preset keyword is "cosmetic mirror", and the custom voice instruction can be "please help me turn on the cosmetic mirror" or "turn on the intelligent function of the cosmetic mirror". In response to receiving the voice operation for the vehicle-mounted cosmetic mirror, that is, in response to the voice collection component collecting the voice start instruction, the vehicle-mounted cosmetic mirror enters the start state.
[0062] In one possible implementation, the start instruction can also be an automatic start instruction triggered according to the use habit of the first subject to the vehicle-mounted cosmetic mirror. The vehicle system analyzes the regularity and habit of the first subject to start the vehicle-mounted cosmetic mirror, learns and recognizes the behavior pattern of the first subject, and can obtain the predicted start time point of the vehicle-mounted cosmetic mirror, that is, the time point at which the vehicle-mounted cosmetic mirror enters the start state. Optionally, the vehicle-mounted cosmetic mirror can determine the predicted start time point according to a periodic event. For example, the first subject enters the vehicle at about eight o'clock every day, and starts the vehicle-mounted cosmetic mirror to make up after entering the vehicle. The vehicle-mounted cosmetic mirror learns the behavior pattern of the first subject according to the time at which the first subject starts the vehicle-mounted cosmetic mirror, and determines the predicted start time point as eight o'clock.
[0063] In some embodiments, the vehicle-mounted cosmetic mirror is located at any position in the interior of the vehicle. Optionally, the vehicle-mounted cosmetic mirror is located above the driver's seat; or, the vehicle-mounted cosmetic mirror is located above the front passenger seat; or, the vehicle-mounted cosmetic mirror is located above the rear seat. The present application does not limit the position of the vehicle-mounted cosmetic mirror. Optionally, the type of vehicle includes at least one of a pure electric vehicle, a hybrid vehicle, a fuel cell electric vehicle, etc. The present application does not limit the type of vehicle.
[0064] In some embodiments, the vehicle-mounted cosmetic mirror is built-in with a camera for capturing the facial image of the first subject. Optionally, after the vehicle-mounted cosmetic mirror enters the open state, the camera on the vehicle-mounted cosmetic mirror is activated, and the camera starts to detect and identify the facial image. In response to detecting the facial image, the camera acquires the facial image of the first subject.
[0065] In some embodiments, after the camera on the vehicle-mounted cosmetic mirror successfully acquires the facial image of the first subject, the facial image is sent to the processor for subsequent analysis and processing of the facial image of the first subject by the processor.
[0066] Step 220: AI analysis of the facial image, and generating corresponding target recommendation information based on the facial image;
[0067] In some embodiments, after the camera on the vehicle-mounted cosmetic mirror acquires the facial image of the first subject, the facial image is sent to the processor, and the processor performs AI analysis on the facial image of the first subject. The facial features of the first subject are identified through the facial image, such as the face shape, eyes, lips, eyebrows, etc. of the first subject, and the target recommendation information is generated according to the facial features of the first subject.
[0068] In some embodiments, the AI analysis of the facial image can be AI analysis of the local facial features in the facial image to obtain the target recommendation information corresponding to the local facial features; or, the AI analysis of the facial image can be AI analysis of the overall facial features of the facial image to obtain the target recommendation information corresponding to the overall facial features.
[0069] Optionally, the mirror display screen of the vehicle-mounted cosmetic mirror displays buttons corresponding to the local facial features, and in response to the first subject triggering the buttons on the mirror display screen corresponding to different facial features, AI analysis is performed on the corresponding facial features of the first subject. For example, the mirror display screen of the vehicle-mounted cosmetic mirror displays an "eye makeup" button, and in response to the first subject clicking the button, AI analysis is performed on the shape of the eyes of the first subject to obtain makeup recommendation content for the eyes.
[0070] Optionally, the mirror display screen of the vehicle-mounted cosmetic mirror displays a button corresponding to the overall facial features, and the AI analysis is performed on the overall facial features of the first subject in response to the first subject triggering the button corresponding to the overall facial features. For example, the mirror display screen of the vehicle-mounted cosmetic mirror displays a "makeup style" button, and the AI analysis is performed on the overall facial features of the first subject in response to the first subject clicking the button, and the makeup recommendation content for the overall facial features is obtained, such as office makeup, light makeup, heavy makeup, European and American makeup, and Japanese and Korean makeup.
[0071] In some embodiments, the target recommendation information includes makeup recommendation content for the first subject. The makeup recommendation content includes multi-dimensional recommendation content. Optionally, the makeup recommendation content includes, but is not limited to, recommendation content of makeup effect mode, recommendation content of makeup style mode, recommendation content of makeup skill, and recommendation content of makeup tutorial. The embodiments of the present application do not limit the specific recommendations of the target recommendation information.
[0072] In step 230, the target recommendation information is displayed on the mirror display screen of the vehicle-mounted cosmetic mirror.
[0073] In some embodiments, the processor generates corresponding target recommendation information according to the facial image of the first subject, and the target recommendation information includes makeup recommendation content for the first subject. Optionally, the makeup recommendation content can be multi-dimensional makeup recommendation content.
[0074] In some embodiments, the processor returns the target recommendation information to the first subject, and displays the target recommendation information on the mirror display screen of the vehicle-mounted cosmetic mirror. Optionally, the mirror display screen is an interactive display screen, and the first subject can interact with the target recommendation information on the mirror display screen through interactive operation.
[0075] In summary, the method provided by the embodiments of the present application is as follows: when the vehicle-mounted cosmetic mirror receives a trigger condition, the vehicle-mounted cosmetic mirror enters an open state from a closed state, a camera is installed above the vehicle-mounted cosmetic mirror, the vehicle-mounted cosmetic mirror obtains a facial image of a first subject through the camera after entering the open state, then performs AI analysis on the facial image, generates target recommendation information according to the facial image of the first subject, the target recommendation information is makeup recommendation content generated according to facial state information of the first subject, for example, generates corresponding makeup suggestions according to the skin state of the first subject, and displays the target recommendation information on the mirror display screen of the vehicle-mounted cosmetic mirror. The vehicle-mounted cosmetic mirror in the embodiments of the present application can obtain and analyze the facial image of the first subject, and then generate and display targeted target recommendation information on the mirror display screen. This way breaks the single function of the traditional vehicle-mounted cosmetic mirror, and the intelligent vehicle-mounted cosmetic mirror can meet the diversity demand for in-vehicle makeup.
[0076] Analysis of a facial image of a first subject by a recommendation model
[0077] In some embodiments, the vehicle-mounted cosmetic mirror is integrated with a processor, and a recommendation model is deployed on the processor. The face image is input to the recommendation model, and the corresponding target recommendation information is obtained by analyzing the face image through the recommendation model. Figure 3 FIG. 2 is a flowchart of an interactive method of a vehicle-mounted cosmetic mirror according to an example embodiment of the present application. The step 220 can be replaced by steps 221 and 222.
[0078] The step 221 comprises: inputting the face image to a recommendation model, and obtaining a recommendation list by analyzing the face image through the recommendation model, wherein the recommendation information list includes at least one candidate recommendation information.
[0079] In some embodiments, the vehicle-mounted cosmetic mirror is integrated with a processor, and a recommendation model is deployed on the processor. Alternatively, an AI chip is included in the processor, and the recommendation model is included in the AI chip.
[0080] Optionally, the recommendation model in the processor identifies and analyzes the face image of the first subject. Alternatively, the recommendation model exists in a server, and the face image of the first subject is identified and analyzed by the recommendation model in the server. The processor obtains the analysis result (target recommendation information) of the face image through the server. In the present embodiment, the recommendation model is taken as an example deployed in the processor.
[0081] The recommendation model is an artificial neural network formed by n neurons connected with each other, and n is a positive integer. In the present application, the recommendation model is an artificial neural network for identifying the face image of the first subject. For example, the recommendation model can be divided into an input layer, a hidden layer and an output layer. The processor inputs the face image to the input layer of the recommendation model. The hidden layer performs down-sampling on the input face image, i.e., convolution calculation on the pixel points in the face image. Finally, the output layer outputs the analysis result of the face image, i.e., the target recommendation information corresponding to the face image. For example, the recommendation model includes at least one of a CNN (Convolutional Neural Network) model, a FCN (Fully Convolutional Networks) model, a DNN (Deep Neural Network) model, a RNN (Recurrent Neural Networks) model, an embedding model, a GBDT (Gradient Boosting Decision Tree) model, an LR (Logistic Regression) model, etc.
[0082] In some embodiments, the facial image of the first subject is input into a recommendation model, and a recommendation list is obtained by analyzing the facial image through the recommendation model, and the recommendation information list includes at least one candidate recommendation information. Optionally, the recommendation list has different layouts. The layout of the recommendation list generally refers to the way of optimizing the layout of the recommendation list to make it clearer, easier to read and more beautiful. The recommendation list is a collection of multiple candidate recommended products. Optionally, the layout of the recommendation list includes at least one of grid layout, list layout, card layout, sliding tab, waterfall layout, and carousel layout.
[0083] For example, the layout of the recommendation list is a grid layout, and multiple candidate recommendation information is arranged in a grid form, and the icon or name of each candidate recommendation information occupies a fixed size square. The first subject can view more candidate recommendation information by scrolling or paging; the layout of the recommendation list is a list layout, and multiple candidate recommendation information is presented in a vertical list form, and each candidate recommendation information is arranged in sequence, and the first subject can browse all candidate recommendation information by scrolling; the layout of the recommendation list is a card layout, and each candidate recommendation information is displayed in the form of a card, including an icon, a name and a brief description, and the first subject can select the corresponding candidate recommendation information by clicking or touching the card; the layout of the recommendation list is a sliding tab, and the sliding tab is placed at the top or bottom of the virtual trial interface, and each sliding tab represents different types or categories of candidate recommendation information, and the first subject can switch different categories of candidate recommendation information by sliding or clicking the sliding tab; the layout of the recommendation list is a waterfall layout, which is a dynamic grid layout, and the size of the thumbnail of each candidate recommendation information may be different, so that the overall recommendation list looks more dynamic and natural; the layout of the recommendation list is a carousel layout, and the candidate recommendation information is displayed in the form of a carousel, and the first subject can browse different candidate recommendation information by sliding left and right.
[0084] For example, as shown in Figure 4 The camera 401 of the vehicle-mounted cosmetic mirror 400 acquires the facial image of the first subject, and sends the facial image of the first subject to the processor. The processor processes the facial image of the first subject based on the recommendation model to obtain a recommendation list 402 for the facial image. The recommendation list 402 includes at least one candidate recommendation information, and the at least one candidate recommendation information is presented in a horizontal list form on the mirror display screen 403 of the vehicle-mounted cosmetic mirror 400, and each candidate recommendation information is arranged in sequence. Optionally, the candidate recommendation information in the recommendation list is video form recommendation information, such as video 1, video 2, video 3, etc.
[0085] In some embodiments, the recommendation list is a set of candidate recommendation information obtained by the processor based on AI analysis of the facial image of the first subject by the recommendation model. First, the camera of the vehicle-mounted cosmetic mirror obtains the facial image of the first subject, and sends the facial image of the first subject to the processor. The processor processes the facial image of the first subject, and extracts facial features from the facial image of the first subject. The recommendation model in the processor obtains recommendation information matched with the facial features of the first subject based on the facial features of the first subject.
[0086] For example, the recommendation model in the processor identifies the facial features of the first subject through the facial image, for example, the eye shape of the first subject is single eyelid, and the recommendation information for the first subject is makeup recommendation content for enlarging the eye makeup effect.
[0087] In some embodiments, the processor obtains candidate recommendation information for the facial image based on AI analysis of the facial image by the recommendation model. Optionally, a recommendation model is pre-trained, which can generate a corresponding recommendation list based on the facial image. Optionally, an image data set (i.e., a data set corresponding to the facial image) is obtained, and the image data set is used as a training sample to train the recommendation model. The training sample is obtained based on user feedback-driven mode, and the recommendation model is trained based on the training sample to obtain a recommendation model with recommendation capability. The training sample is obtained as follows: first, obtain the facial image captured by the camera in the vehicle-mounted cosmetic mirror, and randomly display the recommendation list; in response to positive feedback operation of the user on the preset recommendation information in the recommendation list, obtain the binding relationship between the preset recommendation information and the facial image, the positive feedback operation includes at least one of selection operation, click operation, and viewing operation on the preset recommendation information, and the facial image and the preset recommendation information are used as a training sample to train the recommendation model.
[0088] Optionally, the training sample is obtained based on the feedback driving mode of the user, the recommendation model is trained using the training sample, and the label of the training sample can be obtained based on the binding relationship between the preset recommendation information and the face image, that is, the preset recommendation information selected by the user is taken as the label data of the training sample. Optionally, the input of the recommendation model is a feature vector, the face image is converted into an image feature through a preset operation, and the detail part feature is extracted from the image of each training sample as the image feature using the image detection and image feature extraction technology. Then, the image feature and the label corresponding to the face image are taken as the input data of the recommendation model, the recommendation model is trained based on different image features and the label (the preset recommendation information) of the face image, and the recommendation model can learn the mapping relationship between the face image and the preset recommendation information. The recommendation model predicts the input data, and the training result of the image feature is obtained. The training result (recommendation information) and the real result (the preset recommendation information corresponding to the training sample) are compared to obtain a calculation loss, and the calculation loss is used to indicate the error between the training result and the real result. Optionally, the parameters of the recommendation model are adjusted using the back propagation algorithm, so that the output of the recommendation model and the label corresponding to the training sample are closer. Optionally, the recommendation model is optimized through a loss function. Based on this, the trained recommendation model is obtained, and the trained recommendation model can learn the mapping relationship between the face image and the preset recommendation information.
[0089] It should be noted that the training of the recommendation model provided in the embodiment is only illustrative, and does not constitute a limitation on the training mode of the recommendation model. The recommendation model based on the analysis of the face image of the first principal part to obtain the recommendation list in the embodiment of the application is a trained recommendation model.
[0090] Step 222: determining the target recommendation information from the recommendation list based on the face feature corresponding to the face image, and returning the target recommendation information to the first principal part.
[0091] Among them, the target recommendation information is the recommendation information whose adaptation degree with the face feature reaches a preset threshold.
[0092] In some embodiments, the processor performs AI analysis on the face image based on the recommendation model to obtain a recommendation list for the face image, and the recommendation list includes at least one candidate recommendation information. For each candidate recommendation information in the recommendation list, the processor analyzes the adaptation degree of the candidate recommendation information with the face feature based on AI, and determines the target recommendation information from the recommendation list according to the adaptation degree of the face feature with the candidate recommendation information.
[0093] Figure 5 The flowchart of the interactive method of the vehicle-mounted cosmetic mirror provided in an exemplary embodiment of the application is shown in the figure. The above-mentioned step 222 can be replaced by steps 222a and 222b.
[0094] Step 222a: display the at least one candidate recommendation information in the recommendation list in descending order of the adaptation degree to the facial feature;
[0095] In some embodiments, the at least one candidate recommendation information in the recommendation list is displayed on the mirror display screen of the vehicle-mounted cosmetic mirror in descending order of the adaptation degree to the facial feature. For each candidate recommendation information in the recommendation list, the processor analyzes the adaptation degree to the facial feature based on AI, obtains the adaptation degree calculation result of each candidate recommendation information to the facial feature, and sorts the at least one candidate recommendation information in descending order of the adaptation degree to the facial feature according to the adaptation degree calculation result. Optionally, the adaptation degree calculation result can be represented as an adaptation degree score, and the candidate recommendation information with the highest adaptation degree score is placed at the front of the recommendation list.
[0096] Step 222b: determine the top n candidate recommendation information in descending order as the target recommendation information, and return the target recommendation information to the first subject, where n is a positive integer.
[0097] Optionally, the top n candidate recommendation information in descending order is determined as the target recommendation information, and n is a positive integer. For example, the candidate recommendation information ranked first is determined as the target recommendation information, and the target recommendation information is the candidate recommendation information in the recommendation list that has an adaptation degree to the facial feature reaching a preset threshold, i.e., the target recommendation product is the candidate recommendation information in the recommendation list that has an adaptation degree score to the facial feature reaching a preset threshold.
[0098] For example, the recommendation model in the processor identifies the facial feature of the first subject through the facial image, for example, the first subject has a single eyelid, and the recommendation model in the processor obtains a recommendation list for the eyes by analyzing the eyes of the first subject. The recommendation list includes at least one candidate recommendation information, which is makeup recommendation content for the eyes of the first subject. The at least one candidate recommendation information is arranged in descending order of the adaptation degree to the eyes of the first subject, and the candidate recommendation information ranked first is determined as the target recommendation information. For example, the target recommendation information is makeup recommendation content for enlarging the eye makeup.
[0099] In some embodiments, a touch sensor is built in the vehicle-mounted cosmetic mirror, and the first subject can interact with the controls displayed on the mirror display screen. Optionally, in response to the interaction operation on the target recommendation information, the display jumps to a detail interface of the target recommendation information, and the detail interface includes at least one of video content, picture content, text content, voice content, and animation content of the target recommendation information. For example, in response to the trigger operation on the target recommendation information, the video content corresponding to the target recommendation information is played, and the first subject can watch and refer to the makeup tutorial in the video content corresponding to the target recommendation information. Optionally, the first subject can also select other candidate recommendation information in the recommendation list, and in response to the trigger operation on the other candidate recommendation information, the video content of the selected candidate recommendation information is displayed and played. Optionally, the forms of the recommendation information include, but are not limited to, at least one of video content, text content, picture content, voice content, and animation content. The video content is taken as an example for description, but this does not limit the forms of the recommendation information.
[0100] In some embodiments, the recommendation model in the processor can also analyze the facial state information of the first subject, and determine the target recommendation information from the recommendation list by taking the facial state information of the first subject as optional reference information. The facial state information is used to indicate the skin state information of the first subject. Optionally, the facial state information includes, but is not limited to, at least one of skin type (such as oily, dry, and mixed), skin problem (such as acne and pimple), skin texture (such as skin smoothness), and skin wrinkle degree (such as general and intermediate). Optionally, the processor can also display the analysis of the facial state information of the first subject on the mirror display screen of the vehicle-mounted cosmetic mirror.
[0101] In the embodiments of the present application, the candidate recommendation information is automatically sorted according to the adaptation degree with the facial features, and the recommendation based on the facial features of the first subject realizes personalized recommendation, ensures that the displayed recommendation information meets the needs of the first subject, and the first subject can quickly and intuitively preview the makeup recommendation most suitable for himself, thereby improving the accuracy of the recommendation.
[0102] In summary, the method provided in the embodiments of the present application can generate a recommendation list by AI analyzing the facial image, and the candidate recommendation information in the recommendation list is more in line with the actual needs of the user. This personalized recommendation can improve the relevance and accuracy between the candidate recommendation information and the facial image. By setting the adaptation degree threshold to determine the target recommendation information, the most matched recommendation information with the facial image can be filtered out from the recommendation list, and this filtering mechanism can reduce the difficulty of the user in selecting from a large number of recommendation information and improve the selection efficiency.
[0103] Further adjustment of a vehicle-mounted cosmetic mirror
[0104] In some embodiments, the vehicle-mounted cosmetic mirror is integrated with a light sensor for detecting the light intensity of the vehicle interior environment (i.e. the environment where the first subject is located).
[0105] After the vehicle-mounted cosmetic mirror enters the open state, the light sensor obtains the environmental information of the vehicle, including the light intensity of the vehicle. The light sensor transmits the environmental information to the processor, and the processor automatically adjusts the light effect parameters of the vehicle-mounted cosmetic mirror according to the adjustment instruction. The light effect parameters refer to the lighting settings of the vehicle-mounted cosmetic mirror. Optionally, the edge of the vehicle-mounted cosmetic mirror is surrounded by a LED light belt, and the lighting settings of the vehicle-mounted cosmetic mirror are realized through the LED light belt. The light effect parameters include the brightness and color temperature of the vehicle-mounted cosmetic mirror. The brightness is used to adjust the intensity of the light to ensure sufficient illumination in a dark environment. The color temperature is used to adjust the color tone of the light from warm light to cold light to adapt to the preferences or makeup needs of the first subject.
[0106] For example, when the light sensor detects that the light is dark, the light intensity at this time is sent to the processor, and the processor will issue an adjustment instruction according to the light intensity, for example, the processor sends an adjustment instruction to the mirror display screen to increase the brightness of the LED light belt.
[0107] Optionally, the mirror display screen of the vehicle-mounted cosmetic mirror displays a control for adjusting the light effect parameters, and the first subject can manually adjust the light effect parameters of the vehicle-mounted cosmetic mirror according to his own preferences, for example, adjusting the LED light belt to warm light.
[0108] In the embodiments of the present application, the light sensor is used to detect the light intensity of the vehicle interior environment (i.e. the environment where the first subject is located), and then transmit it to the processor. The processor automatically adjusts the light effect parameters according to the light intensity to ensure that the vehicle-mounted cosmetic mirror provides the best makeup lighting effect under different light conditions.
[0109] In some embodiments, the vehicle-mounted cosmetic mirror is provided with an angle adjusting bracket on the side, for example, the left side and the lower side of the vehicle-mounted cosmetic mirror are provided with an angle adjusting bracket, wherein the angle adjusting bracket is used to adjust the inclination angle of the vehicle-mounted cosmetic mirror.
[0110] In some embodiments, the first subject can manually adjust the inclination angle of the vehicle-mounted cosmetic mirror based on the angle adjusting bracket. For example, the first subject can adjust the inclination angle of the vehicle-mounted cosmetic mirror upward or downward based on the angle adjusting bracket located on the lower side of the vehicle-mounted cosmetic mirror; or the first subject can adjust the inclination angle of the vehicle-mounted cosmetic mirror left or right based on the angle adjusting bracket located on the left side of the vehicle-mounted cosmetic mirror. The angle adjusting bracket is exemplified as being located on the left side and the lower side of the vehicle-mounted cosmetic mirror, but this does not constitute a limitation on the position of the angle adjusting bracket.
[0111] In some embodiments, the first subject can automatically adjust the tilt angle of the vehicle-mounted cosmetic mirror based on the angle adjustment support. Optionally, in response to a change in the head movement of the first subject, the vehicle-mounted cosmetic mirror is controlled to move following the change in the head movement of the first subject based on the angle adjustment support. After the camera of the vehicle-mounted cosmetic mirror captures the facial image of the first subject; or after the first subject interacts with the display control on the mirror display screen of the vehicle-mounted cosmetic mirror, the vehicle-mounted cosmetic mirror is controlled to move following the change in the head movement of the first subject based on the angle adjustment support, with reference to the relative position between the vehicle-mounted cosmetic mirror and the first subject at this time. For example, in response to the upward head movement of the first subject, the vehicle-mounted cosmetic mirror is controlled to move upward following the head movement of the first subject based on the angle adjustment support; or in response to the downward head movement of the first subject, the vehicle-mounted cosmetic mirror is controlled to move downward following the head movement of the first subject based on the angle adjustment support; or in response to the left head movement of the first subject, the vehicle-mounted cosmetic mirror is controlled to move left following the head movement of the first subject based on the angle adjustment support; or in response to the right head movement of the first subject, the vehicle-mounted cosmetic mirror is controlled to move right following the head movement of the first subject based on the angle adjustment support.
[0112] For example, as shown in FIG. 5, the first subject 502 is displayed on the mirror display screen 501 in the vehicle-mounted cosmetic mirror 500, and the angle adjustment supports 503 are respectively located on the left side and the lower side of the vehicle-mounted cosmetic mirror 500. Optionally, the angle adjustment supports 503 move following the head movement of the first subject 502. For example, when the first subject moves his head upward, the angle adjustment support 503 located on the lower side of the vehicle-mounted cosmetic mirror 500 moves upward, i.e., adjusts the tilt angle upward. Figure 6
[0113] In the embodiments of the present application, the vehicle-mounted cosmetic mirror can automatically adjust the angle according to the head movement of the first subject. By automatically adjusting the tilt angle of the vehicle-mounted cosmetic mirror, the best field of view of the cosmetic mirror can be ensured for the first subject (e.g., the driver or the passenger) in different sitting postures or head postures, thereby greatly improving the convenience and comfort of use.
[0114] Figure 7 FIG. 1 is a schematic diagram of an interactive method of a vehicle-mounted cosmetic mirror according to an exemplary embodiment of the present application.
[0115] In some embodiments, a mirror display screen 01 is displayed in the vehicle-mounted cosmetic mirror 10, a touch sensor 02 is integrated in the vehicle-mounted cosmetic mirror 10, the touch sensor 02 can identify the touch gesture of the user, and in response to the touch operation of the user on the mirror display screen 01, the touch sensor 02 receives the opening request of the first subject and converts the opening request into a control signal and sends it to the processor 05. After receiving the opening request, the processor 05 issues a touch opening instruction to the vehicle-mounted cosmetic mirror 10, and the vehicle-mounted cosmetic mirror 10 enters an opening state. The vehicle-mounted cosmetic mirror 10 is integrated with a light sensor 03, which is used to detect the light intensity of the vehicle interior environment (i.e. the environment of the first subject). After the vehicle-mounted cosmetic mirror 10 enters the opening state, the light sensor 03 obtains the environmental information of the vehicle, including the light intensity of the vehicle, and transmits the light intensity to the processor 05, and automatically adjusts the light effect parameters of the LED light belt 08 through the adjustment instruction (adjustment light effect instruction) issued by the processor 05. Optionally, the vehicle-mounted cosmetic mirror 10 has a camera 04 above it, which can obtain the facial image of the first subject and input it into the processor 05. The processor 05 is deployed with a recommendation model, and the processor 05 performs AI analysis on the input facial image based on the recommendation model to obtain a recommendation list corresponding to the facial image of the first subject. The candidate recommendation information in the recommendation list is displayed in the form of a video on the mirror display screen 01, and the first subject can interact with the recommendation information, such as clicking the recommendation information to play the video content of the makeup recommendation tutorial. Optionally, the processor 05 has a memory 06, which can record the makeup data of the first subject, for example, the first subject clicks the first video in the recommendation list, and the memory 06 records the click operation of the first subject on the first video and considers it as the makeup preference of the first subject. Optionally, the processor 05 has a communication module 07, and the processor 05 can communicate with a third-party terminal device 20 based on the communication module 07. For example, the third-party terminal device 20 can initiate a remote instruction to the vehicle-mounted cosmetic mirror, and the processor 05 executes the remote instruction of the third-party terminal device 20 and issues the remote instruction to a specific module, for example, the processor 05 issues the adjustment light effect instruction to the LED light belt 08. Optionally, the vehicle-mounted cosmetic mirror 10 is installed with an angle adjusting bracket 09 on the side, and the first subject can manually adjust the inclination angle of the vehicle-mounted cosmetic mirror 10 based on the angle adjusting bracket 09; or the first subject can automatically adjust the inclination angle of the vehicle-mounted cosmetic mirror 10 based on the angle adjusting bracket 09.
[0116] In some embodiments, the third-party terminal device 20 is connected with the vehicle-mounted cosmetic mirror 10 through Bluetooth, and the third-party terminal device 20 can synchronize data with the vehicle-mounted cosmetic mirror 10, for example, synchronize the historical cosmetic data of the first principal, and the historical cosmetic data of the first principal can be viewed on the third-party terminal device. Optionally, the third terminal device 20 can also generate a local picture of the first principal's makeup result and save it, and can also share the makeup result to a third-party social program.
[0117] Figure 8 A structural block diagram of an interaction device of a vehicle-mounted cosmetic mirror provided by an embodiment of the present application is shown. The device has the functions of implementing the above-mentioned examples of the interaction method of the vehicle-mounted cosmetic mirror, which can be implemented by hardware or corresponding software executed by hardware. The device can be a server introduced above or be arranged in a server. As shown in the figure, the device 600 can include an acquisition module 610, a generation module 620, and a display module 630. Figure 8
[0118] The acquisition module 610 is configured to acquire a face image of a first principal based on a camera on the vehicle-mounted cosmetic mirror.
[0119] The generation module 620 is configured to perform artificial intelligence (AI) analysis on the face image, and generate corresponding target recommendation information based on the face image, wherein the target recommendation information includes makeup recommendation content for the first principal.
[0120] The display module 630 is configured to display the target recommendation information on a mirror display screen of the vehicle-mounted cosmetic mirror.
[0121] In some embodiments, the generation module 620 further includes a generation sub-module and a determination sub-module.
[0122] In an optional example, a processor is integrated in the vehicle-mounted cosmetic mirror, and a recommendation model is deployed on the processor.
[0123] The generation sub-module is configured to input the face image into the recommendation model, analyze the face image by the recommendation model to obtain a recommendation list, and the recommendation information list includes at least one candidate recommendation information.
[0124] The determination sub-module is configured to determine target recommendation information from the recommendation list based on a face feature corresponding to the face image, and return the target recommendation information to the first principal, wherein the target recommendation information is recommendation information with an adaptation degree reaching a preset threshold to the face feature.
[0125] In some embodiments, the determination sub-module includes a display unit and a determination unit.
[0126] In an optional example, the display unit is configured to display the at least one candidate recommendation information in descending order of the adaptation degree to the facial feature.
[0127] The determination unit is configured to determine the top-n candidate recommendation information in descending order as the target recommendation information, and return the target recommendation information to the first subject, where n is a positive integer.
[0128] In some embodiments, the display module 630 further includes a display submodule.
[0129] In an optional example, the target recommendation information is displayed on the mirror display screen of the vehicle-mounted cosmetic mirror, and the display submodule is configured to display a detail interface of the target recommendation information in response to an interactive operation on the target recommendation information, the detail interface including at least one of video content, picture content, text content, voice content, and animation content of the target recommendation information.
[0130] In some embodiments, the acquisition module 610 further includes an acquisition submodule and a transmission submodule.
[0131] In an optional example, the acquisition submodule is configured to acquire environmental information of the vehicle based on the light sensor, the environmental information including light intensity of the vehicle.
[0132] The transmission submodule is configured to transmit the environmental information to the processor, and automatically adjust the lamp effect parameter of the vehicle-mounted cosmetic mirror through the adjustment instruction issued by the processor.
[0133] In some embodiments, the device 600 further includes a control module.
[0134] In an optional example, an angle adjustment support is mounted on the side of the vehicle-mounted cosmetic mirror, and the control module is configured to control the vehicle-mounted cosmetic mirror to move following the head movement of the first subject based on the angle adjustment support in response to a change in the head movement of the first subject.
[0135] It should be noted that the specific limitations in the above-described one or more embodiments of the interactive device of the vehicle-mounted cosmetic mirror can refer to the limitations of the interactive method of the vehicle-mounted cosmetic mirror described above, which will not be described here. The modules of the above device can be realized by software, hardware and their combinations, and each module can be embedded in the processor of the computer device in hardware form or independent of the processor of the computer device, or can be stored in the memory of the computer device in software form, so as to call and execute the corresponding operations of each module by the processor.
[0136] The above-mentioned sequence number of the embodiments of the present application is only for description, and does not represent the advantages and disadvantages of the embodiments.
[0137] Figure 9 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. The computer device shown in this figure is only an example and should not impose any limitations on the function and scope of application of this application.
[0138] like Figure 9 As shown, this application relates to a computer device 700, which includes at least one processor 702, at least one read-only memory 703 and memory 704 connected to the processor, and a bus 711. The processor 702, read-only memory 703, and memory 704 communicate with each other via the bus 711. The processor 702, such as a CPU (Central Processing Unit), is used to call computer program instructions stored in the read-only memory 703, or load computer programs from storage into the random access memory 704 to execute processor commands. The memory 704 contains various computer applications and databases required for the operation of the computer device 700. It should be noted that the aforementioned programs can be stored not only in the read-only memory 703 and memory 704, but also in one or more other memories. By executing the stored programs, the processor 702 can acquire facial images of a user inside the vehicle and display the user's makeup effect using the makeup function provided by the mirror display screen, thereby completing various operations in the process method of this application embodiment.
[0139] The computer device 700 may also include an I / O (Input / Output) interface 710, which is also connected to a bus 711. It includes an input module 706 and an output module 707, such as a cathode ray tube or liquid crystal display; a storage module 708, such as a hard disk; and a communication module 705, including a network interface card such as a LAN (Local Area Network) card or a modem. The communication module 705 performs communication processing via a network. Drives or removable media, such as disks, optical disks, magneto-optical disks, or semiconductor memories, may also be connected to the I / O interface 710 as needed to facilitate reading computer programs and installing them into the storage module 708 as required. The process and methods of the embodiments of this application can be implemented by computer software programs, including computer programs carried on computer-readable storage media. When the computer program is downloaded and installed from the network or a removable medium via the communication module 705 and executed by the processor 702, the system, devices, apparatuses, modules, etc., in the operation mode can all be implemented through the computer program module.
[0140] In some embodiments, the computer device 700 also includes other components, as those skilled in the art will understand. Figure 9The structure shown in the figure does not constitute a limitation on the computer device 700, and can include more or fewer components than shown, or combine certain components, or use different arrangements of components.
[0141] Embodiments of the present application also provide a computer readable storage medium, which stores at least one instruction, at least one program, a code set or an instruction set. The at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the vehicle-mounted cosmetic mirror interaction method provided by any of the above method embodiments.
[0142] Embodiments of the present application also provide a computer program product or computer program, which includes computer instructions stored in a computer readable storage medium. The processor of the vehicle-mounted terminal reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to enable the vehicle-mounted cosmetic mirror to perform the vehicle-mounted cosmetic mirror interaction method described in any of the above embodiments.
[0143] The above-mentioned serial numbers of the embodiments of the present application are only for description, and do not represent the advantages and disadvantages of the embodiments.
[0144] Those of ordinary skill in the art can understand that all or part of the steps of the above-mentioned embodiments can be completed by software, or by programs instructing related software. The programs can be stored in a computer readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.
[0145] The above is only optional embodiments of the present application, and does not limit the present application. Any modification, equivalent replacement, improvement, etc. within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. An interaction method of a vehicle-mounted cosmetic mirror, characterized by, The vehicle-mounted cosmetic mirror is integrated with a processor, and a recommendation model is deployed on the processor, and the method comprises the following steps: A face image of a first subject is acquired based on a camera on the vehicle-mounted cosmetic mirror; The face image is input into the recommendation model, and a recommendation list is obtained by analyzing the face image through the recommendation model, wherein the recommendation list comprises at least one candidate recommendation information; The at least one candidate recommendation information is displayed in a descending order of adaptation degree to facial features, the top n candidate recommendation information in the descending order is determined as target recommendation information, the target recommendation information is returned to the first subject, n is a positive integer, the target recommendation information is recommendation information with an adaptation degree to the facial features reaching a preset threshold, and the target recommendation information comprises makeup recommendation content for the first subject; The target recommendation information is displayed on a mirror display screen of the vehicle-mounted cosmetic mirror.
2. The method of claim 1, wherein, The target recommendation information is displayed on the mirror display screen of the vehicle-mounted cosmetic mirror, and the method further comprises the following steps: In response to an interactive operation on the target recommendation information, a detail interface of the target recommendation information is displayed, and the detail interface comprises at least one of video content, picture content, text content, voice content and animation content of the target recommendation information.
3. The method of claim 1, wherein, The vehicle-mounted cosmetic mirror is integrated with a light sensor, and before the face image of the first subject is acquired, the method further comprises the following steps: Environment information of a vehicle is acquired based on the light sensor, and the environment information comprises light intensity of the vehicle; The environment information is transmitted to the processor, and a lamp effect parameter of the vehicle-mounted cosmetic mirror is automatically adjusted through an adjustment instruction issued by the processor.
4. The method according to any one of claims 1 to 3, characterized in that, An angle adjusting support is mounted on a side of the vehicle-mounted cosmetic mirror, and the method further comprises the following steps: In response to a change in head movement of the first subject, the vehicle-mounted cosmetic mirror is controlled to move following the head movement of the first subject based on the angle adjusting support.
5. An interactive device for a vehicle vanity mirror, comprising: The device comprises: An acquisition module is configured to acquire a face image of a first subject based on a camera on the vehicle-mounted cosmetic mirror; A generation module is configured to input the face image into a recommendation model, analyze the face image through the recommendation model to obtain a recommendation list, and display at least one candidate recommendation information in the recommendation list in a descending order of adaptation degree to facial features, determine the top n candidate recommendation information in the descending order as target recommendation information, and return the target recommendation information to the first subject, wherein n is a positive integer, the target recommendation information is recommendation information with an adaptation degree to the facial features reaching a preset threshold, and the target recommendation information comprises makeup recommendation content for the first subject; A display module is configured to display the target recommendation information on a mirror display screen of the vehicle-mounted cosmetic mirror.
6. A computer device, comprising: The computer device comprises a processor and a memory, and at least one program is stored in the memory, the at least one program is loaded and executed by the processor to implement the interactive method of the vehicle-mounted cosmetic mirror according to any one of claims 1 to 4.
7. A computer storage medium, characterized in that The computer storage medium stores at least one computer instruction, and the at least one computer instruction is loaded and executed by the processor to realize the interaction method of the vehicle-mounted cosmetic mirror according to any one of claims 1 to 4.
8. A computer program product, characterised in that, The computer program product comprises a computer program stored in a computer readable storage medium; the computer program is read and executed by the processor of the computer device from the computer readable storage medium, so that the computer device executes the interaction method of the vehicle-mounted cosmetic mirror according to any one of claims 1 to 4.
Citation Information
Patent Citations
Makeup recommendation method and device, storage medium and electronic equipment
CN114333032A
Automobile beauty makeup mirror system and method, beauty makeup mirror and storage medium
CN115649031A