Interaction method and device of vehicle-mounted system and electronic equipment

Abstract

The invention provides an interaction method and device of a vehicle-mounted system and electronic equipment, and relates to the technical field of vehicles. The vehicle-mounted system carries a makeup application program, and the interaction method comprises the steps of obtaining a first instruction in response to a triggering operation of a makeup suggestion interaction button of the makeup application program; obtaining target information according to the first instruction, wherein the target information comprises light data of the external environment of the vehicle and / or current weather data; inputting the target information into a trained makeup suggestion model on the vehicle-mounted system to obtain a makeup suggestion; and displaying the makeup suggestion on the vehicle-mounted entertainment screen.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to an interaction method, device, and electronic equipment for a vehicle-mounted system. Background Art

[0002] With the rapid development of in-vehicle infotainment systems, the co-pilot screen in modern cars has integrated a variety of entertainment functions.

[0003] However, in the related art, these screens on the vehicle-mounted system are usually limited to media playback and navigation display, with relatively simple functions, and are unable to provide functions applicable to specific scenarios, such as providing specialized functions for specific user needs such as makeup. Summary of the invention

[0004] The present invention provides an interactive method, device and electronic device for an in-vehicle system, which are used to solve the problem in the related art that the in-vehicle system has a relatively single function and cannot provide more applicable scenarios.

[0005] In a first aspect, the present invention provides an interaction method of an in-vehicle system, wherein the in-vehicle system is equipped with a makeup application, and the interaction method comprises:

[0006] In response to a triggering operation on a makeup suggestion interaction button of the makeup application, acquiring a first instruction;

[0007] Acquire target information according to the first instruction, where the target information includes light data and / or current weather data of the vehicle's external environment;

[0008] Inputting the target information into a makeup suggestion model trained on the vehicle-mounted system to obtain makeup suggestions;

[0009] The makeup suggestion is displayed on the in-vehicle entertainment screen.

[0010] Optionally, the makeup application is provided with a makeup mirror interaction button. Before the method responds to the triggering operation of the makeup suggestion interaction button of the makeup application, the method further includes: in response to the triggering operation of the makeup mirror interaction button of the makeup application, obtaining a second instruction; obtaining a first video frame according to the second instruction, the first video frame being a video frame including the current face of the vehicle occupant; inputting the first video frame into a first model trained on the vehicle-mounted system, performing facial recognition on the first video frame through the first model to obtain first image data, the first image data including first facial data; generating a target video frame according to the first image data; and displaying the target video frame and the makeup suggestion interaction button on the vehicle-mounted entertainment screen.

[0011] Optionally, after performing facial recognition on the first video frame through the first model to obtain the first image data, the method also includes: acquiring first facial data through a tracking algorithm; using the tracking algorithm to compare the first facial data with second facial data, the second facial data being facial data included in a second video frame stored in the tracking algorithm, the second video frame being the previous frame of the first video frame; if a data deviation between the second facial data and the first facial data is not less than a target threshold, initializing the facial data stored in the tracking algorithm.

[0012] Optionally, after the target video frame and the makeup suggestion interaction button are displayed on the in-car entertainment screen, the method further includes: obtaining a third instruction, wherein the third instruction is an instruction for the user to enlarge the target video frame; enlarging the target video frame according to the third instruction, and displaying the enlarged video frame on the in-car entertainment screen.

[0013] Optionally, generating a target video frame according to the first image data includes: preprocessing the first image data by an image enhancement algorithm; and performing enhancement processing on the preprocessed first image data to obtain the target video frame.

[0014] Optionally, the acquiring of target information includes: acquiring the vehicle external environment data through a sensor device disposed outside the vehicle; and / or acquiring current weather data through a networking function on a vehicle-mounted system.

[0015] Optionally, the method further includes: obtaining user feedback; and optimizing the makeup application on the in-vehicle system based on the user feedback.

[0016] In a second aspect, the present invention provides an interactive device for an in-vehicle system, wherein the in-vehicle system is equipped with a makeup application program, and the interactive device comprises:

[0017] An acquisition module, configured to acquire a first instruction in response to a triggering operation on a makeup mirror interaction button of the makeup application;

[0018] The acquisition module is further used to acquire target information according to the first instruction, wherein the target information includes light data and / or current weather data of the vehicle's external environment;

[0019] An input module, used for inputting the target information into a makeup suggestion model trained on the vehicle-mounted system to obtain makeup suggestions;

[0020] The display module displays the makeup suggestions on the in-vehicle entertainment screen in English.

[0021] The third invention, the present invention also provides an electronic device, comprising:

[0022] processor;

[0023] a memory for storing instructions executable by the processor;

[0024] The processor is configured to execute the instructions to implement the method as described in the first aspect.

[0025] In a fourth aspect, the present invention further provides a storage medium, which, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to execute the method provided in the first aspect.

[0026] In a fifth aspect, the present invention further provides a computer program product, comprising a computer program, wherein the computer program is executed by a processor according to the method provided in the first aspect.

[0027] The present invention provides an interactive method for an in-vehicle system, wherein the in-vehicle system is equipped with a makeup application program. Specifically, in response to a trigger operation of a makeup mirror interaction button of the makeup application program, a first instruction is obtained; target information is obtained according to the first instruction, and the target information includes light data of the vehicle's external environment and / or current weather data; the target information is input into a makeup suggestion model trained on the in-vehicle system to obtain makeup suggestions; and the makeup suggestions are displayed on an in-vehicle entertainment screen. In this way, makeup suggestions can be obtained according to at least one of the vehicle's external environment data and the current weather data through the makeup application program on the in-vehicle system, so that the in-vehicle system can be applied to more scenarios, which solves the problem that the in-vehicle system in the related art has a relatively single function and cannot provide more applicable scenarios to a certain extent.

[0028] At the same time, the present invention integrates the makeup function into the in-car entertainment screen, which can provide a new and convenient makeup experience for the co-pilot passenger. It not only saves space in the car, but also provides a clearer makeup view through the large screen, so that passengers can enjoy a better makeup experience even in the car. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0030] Figure 1 A flow chart of an interactive method of a vehicle-mounted system provided by an embodiment of the present invention;

[0031] Figure 2Conceptual diagram of an interactive method of a vehicle-mounted system provided by an embodiment of the present invention

[0032] Figure 3 A structural block diagram of an interactive device for a vehicle-mounted system provided by an embodiment of the present invention;

[0033] Figure 4 A structural block diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0034] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings, but it should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present disclosure.

[0035] As described in the background technology, with the rapid development of in-vehicle infotainment systems, the co-pilot screens in modern cars have integrated a variety of entertainment functions. However, in the related art, these screens are usually limited to media playback and navigation display, with relatively simple functions and unable to provide functions applicable to specific scenarios, such as providing special functions for specific user needs such as makeup.

[0036] In this regard, the present invention provides an interactive method for an in-vehicle system, wherein the in-vehicle system is equipped with a makeup application. Specifically, in response to a makeup suggestion interactive button of the makeup application, a first instruction is obtained; target information is obtained according to the first instruction, and the target information includes light data of the vehicle's external environment and / or current weather data; the target information is input into a makeup suggestion model trained on the in-vehicle system to obtain makeup suggestions; and the makeup suggestions are displayed on an in-vehicle entertainment screen. In this way, makeup suggestions can be obtained according to at least one of the vehicle's external environment data and the current weather data through the makeup application on the in-vehicle system, so that the in-vehicle system can be applied to more scenarios, which to a certain extent solves the problem that the in-vehicle system in the related art has a relatively single function and cannot provide more applicable scenarios.

[0037] At the same time, the present invention integrates the makeup function into the in-car entertainment screen, which can provide a new and convenient makeup experience for the co-pilot passenger. It not only saves space in the car, but also provides a clearer makeup view through the large screen, so that passengers can enjoy a better makeup experience even in the car.

[0038] In addition, in the present invention, a third instruction can also be obtained, and the third instruction is an instruction for the user to enlarge the target video frame; the target video frame is enlarged according to the third instruction, and the enlarged video frame is displayed on the in-vehicle entertainment screen. Through the local magnification function, the present invention enables passengers to make up in detail in the car, especially when applying eyeliner, mascara and other detailed operations, which can be more precise, thereby improving the quality and effect of makeup.

[0039] It should be understood that the interactive method of the vehicle-mounted system provided in the embodiment of the present invention can be executed by a target device. The target device can be one electronic device or multiple electronic devices that cooperate with each other. The electronic device can be a server, such as an independent physical server, a server on a vehicle, or a server cluster composed of multiple servers and a cloud server capable of cloud computing.

[0040] Before introducing the technical solution provided by the present invention, it can be understood that in the embodiment of the present invention, the target device may include the following units:

[0041] High Definition Camera Unit: used to capture the user's facial image.

[0042] Entertainment screen unit: used to display facial images and makeup suggestions.

[0043] Ambient light detection unit: used to detect external ambient light.

[0044] Network connection unit: used to obtain local weather conditions.

[0045] Image processing unit: used to process the images captured by the camera, including magnification and enhancement.

[0046] Makeup Advice Unit: Provides makeup advice based on ambient light and weather conditions.

[0047] The technical solution of the present invention and how the technical solution of the present invention solves the above-mentioned technical problems are described in detail below with specific embodiments. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0048] Figure 1 The following is a flow chart of an interactive method of a vehicle-mounted system provided by an embodiment of the present invention. Figure 1 As shown, the in-vehicle system interaction method provided by the present invention includes steps 110 to 140.

[0049] Step 110: acquiring a first instruction in response to a triggering operation on a makeup suggestion interaction button of the makeup application.

[0050] In an embodiment of the present invention, the in-vehicle system is equipped with a makeup application, and the makeup application can provide a makeup suggestion interaction button. After the user clicks the makeup suggestion interaction button, the target device can respond to the triggering operation of the makeup suggestion interaction button of the makeup application through the makeup suggestion unit described above, thereby obtaining a first indication. The first indication can be used to instruct the target device to execute step 120 to obtain target information after receiving the user's interactive operation (i.e., the user clicks the makeup suggestion interaction button).

[0051] Step 120: acquiring target information according to the first instruction, wherein the target information includes light data of the vehicle's external environment and / or current weather data.

[0052] In the embodiment of the present invention, the light data of the vehicle's external environment may include data types describing the light of the vehicle's external environment, such as the color temperature of the light, the light intensity, and the light brightness. The embodiment of the present invention does not specifically limit the types of data describing the light included in the light data. The current weather data may include weather condition data of the area where the vehicle is located, such as temperature, humidity, ultraviolet intensity, etc. The embodiment of the present invention does not specifically limit the types of data included in the current weather data.

[0053] In the embodiment of the present invention, the vehicle external environment data may be acquired through the above-mentioned ambient light detection unit, wherein the ambient light detection unit may be a sensor device disposed outside the vehicle.

[0054] In the embodiment of the present invention, the current weather data can be obtained through the network connection unit described above, wherein the network connection unit can be a networking function on the vehicle-mounted system. After obtaining the target information, the target device can perform step 130 to provide makeup suggestions according to the target information.

[0055] Step 130 : input the target information into a makeup suggestion model trained on the vehicle-mounted system to obtain makeup suggestions.

[0056] In an embodiment of the present invention, the trained makeup model can be any deep learning model with learning ability, which can not only learn the makeup suggestion rules input during the training process, but also autonomously learn the correlation between the makeup in pictures on the Internet and the background environment.

[0057] In an embodiment of the present invention, after inputting the target information into the trained makeup suggestion model, the trained makeup suggestion model can be used to give corresponding makeup suggestions. For example, it is recommended to use sunscreen with a high sun protection factor (SPF) value in high ultraviolet weather, and it is recommended to use sweat-proof cosmetics in humid weather.

[0058] Step 140: Display the makeup suggestion on the in-vehicle entertainment screen.

[0059] In an embodiment of the present invention, after obtaining makeup suggestions, the target device may display the makeup suggestions in the form of text or pictures on the entertainment screen unit mentioned above, wherein the entertainment screen unit may be an in-vehicle entertainment screen for passengers to refer to.

[0060] In this way, makeup suggestions can be obtained through the makeup suggestion model on the vehicle system according to at least one of the vehicle's external environment data and the current weather data. Different from the related art that relies on traditional makeup mirrors and external light, it solves the problem that the vehicle system in the related art cannot provide assistance for passengers to put on makeup in the car to a certain extent. At the same time, the present invention integrates the makeup function into the vehicle entertainment screen, which can provide a new and convenient makeup experience for the co-pilot passenger. It not only saves space in the car, but also provides a clearer makeup field of view through the large screen, so that passengers can enjoy a better makeup experience even in the car.

[0061] In the embodiment of the present invention, the makeup application is provided with a makeup mirror interaction button. Figure 1 Before the provided step 110, the method also includes: in response to a triggering operation of a makeup mirror interaction button of the makeup application, obtaining a second instruction; obtaining a first video frame according to the second instruction, the first video frame being a video frame including the current face of the vehicle occupant; inputting the first video frame into a first model trained on the vehicle system, performing facial recognition on the first video frame through the first model to obtain first image data, the first image data including first facial data; generating a target video frame according to the first image data; and displaying the target video frame and the makeup suggestion interaction button on the vehicle entertainment screen.

[0062] In an embodiment of the present invention, before acquiring the first instruction, the target device may first acquire the second instruction, and the second instruction may be used to acquire the first video frame. The first video frame may be a real-time video stream from a high-definition camera unit, and the real-time video stream is captured in the form of frames, wherein the high-definition camera unit may be a vehicle-mounted camera in front of the passenger seat. For example, the frame rate is 30 frames per second or higher. The first video frame may include the face of the occupant in the vehicle in front of the vehicle-mounted camera.

[0063] In an embodiment of the present invention, after obtaining the first video frame, the target device may input the first video frame into a first model that has been trained on the vehicle-mounted system. The trained first model may be any trained deep learning model with facial recognition function. By performing facial recognition processing on the first video frame using the trained first model, a set of bounding boxes may be obtained, each of which corresponds to a detected face and includes a confidence score, and the facial data corresponding to the bounding box with the highest confidence score is used as the first facial data. The first image data including the first facial data may be obtained using the trained first model. The first image data may be the image data of the first video frame including the first facial data.

[0064] In an embodiment of the present invention, a target video frame can be generated according to the first image data, for example, by performing image processing, cropping, scaling, etc. on the first image data to obtain the target video frame, so that the size of the target video frame is more suitable for the display requirements of the in-vehicle entertainment screen. Finally, the target video frame and the makeup suggestion interaction button are displayed on the in-vehicle entertainment screen.

[0065] In the embodiment of the present invention, the trained first model can also perform facial analysis on the first video frame to obtain the facial skin condition of the occupant in the first video frame. After responding to the triggering operation of the makeup suggestion interaction button, the target information can also include the facial skin condition just obtained, which will be input into the trained makeup suggestion model together with the light data of the vehicle's external environment and / or the current weather data as described above, to obtain more accurate makeup suggestions.

[0066] In the embodiment of the present invention, by Figure 1 The makeup suggestions obtained by the method can be superimposed on the screen of the target video frame, and the in-vehicle entertainment screen can also be split to display the target video frame and the makeup suggestions in different screen areas, so that the in-vehicle entertainment screen can provide more comprehensive makeup functions.

[0067] In an embodiment of the present invention, in order to make the first video frame obtained through the real-time video stream of the vehicle-mounted camera display more smoothly, the embodiment of the present invention also provides further processing of the first video frame using a tracking algorithm. Specifically, the first facial data is obtained through the tracking algorithm; the first facial data is compared with the second facial data using the tracking algorithm, and the second facial data is stored in the second video frame in the tracking algorithm. The second video frame is the previous frame of the first video frame; if the data deviation between the second facial data and the first facial data is not less than the target threshold, the facial data stored in the tracking algorithm is initialized.

[0068] In an embodiment of the present invention, the tracking algorithm may be any algorithm capable of tracking facial data in the image, such as a basic tracking algorithm or a gaze tracking algorithm. After facial recognition processing is performed using the trained first model, the first image data may be input into the tracking algorithm, and the first facial data included in the first image data may be obtained through the tracking algorithm. The newly obtained first facial data is then compared with the second facial data originally stored in the tracking algorithm, and the second facial data may be facial data contained in the previous frame of the first video frame, wherein the second facial data may also be obtained in real time from the trained first model, or may be stored in the tracking algorithm by being entered in advance.

[0069] In the embodiment of the present invention, if the deviation range between the first facial data and the second facial data is less than a target threshold, the target threshold is a preset reasonable deviation range of facial data, then the first image data including the first facial data is output for subsequent processing. If the data deviation between the second facial data and the first facial data is not less than the target threshold, then the facial data stored in the tracking algorithm is initialized, and the first facial data can be stored in the tracking algorithm.

[0070] In addition, in the interactive method of the in-vehicle system provided by an embodiment of the present invention, after the target video frame is displayed on the in-vehicle entertainment screen, the target device can also obtain a third instruction, wherein the third instruction is an instruction for the user to enlarge the target video frame; the target video frame is enlarged according to the third instruction, and the enlarged video frame is displayed on the in-vehicle entertainment screen, so that the displayed image on the in-vehicle entertainment screen is more localized, which is convenient for the passengers in the car to perform more delicate makeup operations.

[0071] In an embodiment of the present invention, a processing method for generating a target video frame based on the first image data may include the following steps: preprocessing the first image data through an image enhancement algorithm; and enhancing the preprocessed first image data to obtain the target video frame.

[0072] In an embodiment of the present invention, preprocessing may include cropping, scaling and other processing, so that the image size of the first image data can be more adapted to the display requirements of the entertainment screen. The processed first image data may also be subjected to additional processing such as histogram equalization, so that the target video frame can meet different lighting conditions.

[0073] In the embodiment of the present invention, in order to make the in-vehicle system including the makeup function provided by the embodiment of the present invention more convenient, user feedback can also be obtained; based on the user feedback, the makeup application on the in-vehicle system is optimized.

[0074] In order to better understand the interactive method of the vehicle-mounted system provided by the embodiment of the present invention, an example is given. It should be understood that the example is not limiting. Figure 2 The interactive method of the vehicle-mounted system shown mainly includes the following processing steps:

[0075] Video stream input: Get real-time video stream from the vehicle camera.

[0076] Face Detection: Use deep learning models to detect passengers’ faces in video frames.

[0077] Face tracking: Use tracking algorithms to track faces and maintain continuous tracking.

[0078] Image processing: cropping, scaling, and enhancing detected faces.

[0079] Ambient light detection: Use an external light sensor or camera to capture ambient light.

[0080] Weather information acquisition: Get local weather conditions through the network connection module.

[0081] Makeup suggestions: Generate makeup suggestions based on ambient light conditions and weather conditions.

[0082] User interface update: Display processed images and suggestions on the entertainment screen and provide user interaction functions.

[0083] Specifically, in Figure 2 In the interactive method of the vehicle-mounted system shown, an implementation method of each step is as described below, when the vehicle-mounted system responds to the makeup mirror interactive button of the makeup application software, obtains the second instruction, and implements steps 1 to 4.

[0084] Step 1: Video Stream Input

[0085] Get live video stream from the vehicle's onboard camera.

[0086] Video streams are captured in frames, typically 30 frames per second or higher.

[0087] Step 2: Face Detection

[0088] Face detection is performed on each frame of image (i.e., the first video frame described above) using a pre-trained deep learning model (i.e., the first model described above).

[0089] The model output is a set of bounding boxes (i.e., the first image data described above), each bounding box corresponding to a detected face and including a confidence score.

[0090] Step 3: Face Tracking

[0091] The face detected in the previous frame (ie, the second video frame described above) is tracked using a tracking algorithm.

[0092] The tracking result (ie, the second facial data) is matched with the facial detection result (ie, the first facial data) of the current frame to maintain continuous tracking of each passenger's face.

[0093] If a new face is detected or tracking fails, the tracker is reinitialized.

[0094] Step 4: Image Processing

[0095] The detected facial image (ie, the target video frame) is preprocessed, including cropping and scaling to meet the display requirements of the entertainment screen.

[0096] Implement a zoom feature that allows the user to select a specific area of ​​the face to zoom in on.

[0097] Apply image enhancement algorithms, such as histogram equalization, to improve image quality under different lighting conditions.

[0098] The in-vehicle system responds to the makeup suggestion interaction button of the makeup application software, obtains the first instruction, and implements steps 5 to 6.

[0099] Step 5: Ambient Light Detection

[0100] Use the vehicle's exterior light sensor or camera to capture the exterior ambient light.

[0101] Analyzes the color temperature and intensity of ambient light to provide data support for makeup recommendations.

[0102] Step 6: Makeup Tips

[0103] Obtain local weather conditions, including temperature, humidity, UV index, etc., through the network connection module of the vehicle system.

[0104] Combining weather conditions and the color temperature and intensity of ambient light, makeup recommendations are generated using pre-set makeup rules and machine learning models (i.e., the makeup recommendation model described above). For example, a sunscreen with a high SPF value is recommended in high-UV weather, and sweat-proof cosmetics are recommended in humid weather.

[0105] The makeup suggestions are superimposed on the facial image (eg, the target video frame described above) in the form of graphics or text, or displayed separately on the entertainment screen.

[0106] Step 7: UI Updates

[0107] The processed facial image and makeup suggestions are displayed on the entertainment screen in real time.

[0108] Provide user interaction functions, such as touch selection to enlarge the area, accept makeup suggestions, etc.

[0109] Make sure your user interface is responsive to provide a smooth user experience.

[0110] Step 8: Feedback and Optimization

[0111] Collect user feedback and evaluate algorithm performance.

[0112] Based on feedback and performance evaluation results, the algorithm is adjusted and optimized.

[0113] In an embodiment of the present invention, the vehicle-mounted system can capture the user's facial image through a high-definition camera and display it in real time on the entertainment screen. The user can select a specific area of ​​the face through the touch screen to zoom in so as to apply makeup more finely. The ambient light detection module captures the external ambient light, and the makeup suggestion algorithm provides makeup suggestions based on the detected ambient light and weather conditions. The interactive method of the vehicle-mounted system provided by the present invention can achieve the following advantages:

[0114] 1. Improve user experience

[0115] The present invention provides a new and convenient makeup experience for the front passenger by integrating the makeup function into the in-car entertainment screen. This integrated solution not only saves space in the car, but also provides a clearer makeup view through the large screen, so that passengers can enjoy an experience comparable to that of a professional makeup mirror even in the car.

[0116] 2. Enhance makeup accuracy

[0117] By capturing facial details with a high-definition camera and combining it with a local magnification function, the present invention enables passengers to apply makeup in detail in the car, especially when applying details such as eyeliner and mascara, which can be more precise, thereby improving the quality and effect of makeup.

[0118] 3. Optimize makeup suggestions

[0119] The present invention not only takes into account the ambient light in the car, but also obtains the local real-time weather conditions through networking, and integrates this information to provide personalized makeup suggestions. The intelligent makeup suggestion system can help passengers choose the most suitable makeup according to the current weather and light conditions, thereby improving the durability and adaptability of the makeup.

[0120] 4. Innovation and foresight

[0121] This invention demonstrates an innovative approach to combining automotive technology with personal care needs. This forward-looking technology integration not only improves the intelligence level of vehicles, but also provides new possibilities for the development direction of future vehicle systems.

[0122] Figure 3 This is a structural block diagram of an interactive device of a vehicle-mounted system provided by an embodiment of the present invention, wherein the vehicle-mounted system is equipped with a makeup application program. Figure 3 As shown, the interactive device of the vehicle-mounted system provided by the present invention includes:

[0123] An acquisition module 310 is configured to acquire a first instruction in response to a makeup suggestion interaction button of the makeup application;

[0124] The acquisition module 310 is further used to acquire target information according to the first instruction, wherein the target information includes light data and / or current weather data of the vehicle's external environment;

[0125] An input module 320, configured to input the target information into a makeup suggestion model trained on the vehicle-mounted system to obtain makeup suggestions;

[0126] The display module 330 is used to display the makeup suggestion on the in-vehicle entertainment screen.

[0127] It should be noted that the embodiment of the interactive device of the vehicle-mounted system in this specification and the embodiment of the interactive method of the vehicle-mounted system in this specification are based on the same inventive concept. Therefore, the specific implementation method of this embodiment can refer to the corresponding embodiment of the interactive method of the vehicle-mounted system in the previous text, and the repeated parts will not be repeated.

[0128] Figure 4 A structural block diagram of an electronic device provided for the implementation of the present invention. Figure 4 As shown, the electronic device provided by the embodiment of the present invention includes a processor 410 and a memory 420, wherein the memory is used to store instructions executable by the processor; wherein the processor is configured to execute the instructions to implement as shown in Figure 1 The interaction method of the vehicle system shown.

[0129] In an exemplary embodiment, the electronic device may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.

[0130] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory including instructions, and the instructions can be executed by a processor of the device to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device. The non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by the processor of the electronic device, enables the electronic device to perform Figure 1 The interaction method of the vehicle system shown.

[0131] The present invention also provides a computer program product, comprising a computer program, which when executed by a processor Figure 1 The interaction method of the vehicle system shown.

[0132] In the above description, the technical details such as the patterning of each layer are not described in detail. However, those skilled in the art should understand that various technical means can be used to form layers, regions, etc. of desired shapes. In addition, in order to form the same structure, those skilled in the art can also design methods that are not completely the same as the methods described above. In addition, although the various embodiments are described above separately, this does not mean that the measures in the various embodiments cannot be used in combination to advantage.

[0133] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0134] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An interactive method for a vehicle-mounted system, characterized in that: The vehicle-mounted system is equipped with a makeup application, and the interaction method includes: In response to a triggering operation on a makeup suggestion interaction button of the makeup application, acquiring a first instruction; Acquire target information according to the first instruction, where the target information includes light data of the vehicle's external environment and / or current weather data; Inputting the target information into a makeup suggestion model trained on the vehicle-mounted system to obtain makeup suggestions; The makeup suggestion is displayed on the in-vehicle entertainment screen.

2. The method according to claim 1, characterized in that The makeup application is provided with a makeup mirror interaction button, and before the triggering operation of the makeup suggestion interaction button in response to the makeup application, the method further includes: In response to a triggering operation on a makeup mirror interaction button of the makeup application, acquiring a second instruction; Acquire a first video frame according to the second instruction, where the first video frame is a video frame including a current face of an occupant in the vehicle; Inputting a first video frame into a first model trained on the vehicle-mounted system, and performing facial recognition on the first video frame by using the first model to obtain first image data, wherein the first image data includes first facial data; generating a target video frame according to the first image data; The target video frame and the makeup suggestion interaction button are displayed on the in-vehicle entertainment screen.

3. The method according to claim 2, characterized in that After performing facial recognition on the first video frame by using the first model to obtain first image data, the method further includes: Acquire first facial data through a tracking algorithm; Using the tracking algorithm to compare the first facial data with second facial data, the second facial data being facial data included in a second video frame stored in the tracking algorithm, the second video frame being a previous frame of the first video frame; If the data deviation between the second facial data and the first facial data is not less than a target threshold, the facial data stored in the tracking algorithm is initialized.

4. The method according to claim 2, characterized in that: After the in-vehicle entertainment screen displays the target video frame and the makeup suggestion interaction button, the method further includes: Acquire a third instruction, where the third instruction is an instruction instructing a user to zoom in on the target video frame; The target video frame is enlarged according to the third instruction, and the enlarged video frame is displayed on the in-vehicle entertainment screen.

5. The method according to claim 2, characterized in that: Generating a target video frame according to the first image data includes: Preprocessing the first image data by using an image enhancement algorithm; The preprocessed first image data is enhanced to obtain the target video frame.

6. The method according to claim 1, characterized in that The obtaining of target information includes: Acquiring the vehicle external environment data through a sensor device disposed outside the vehicle; and / or Get current weather data through the Internet connection function on the vehicle system.

7. The method according to any one of claims 1 to 6, characterized in that: The method further comprises: Get user feedback; Based on the user feedback, the makeup application on the in-vehicle system is optimized.

8. An interactive device for a vehicle-mounted system, characterized in that: The vehicle-mounted system is equipped with a makeup application program, and the interactive device includes: an acquisition module, configured to acquire a first instruction in response to a triggering operation on a makeup suggestion interaction button of the makeup application; The acquisition module is further used to acquire target information according to the first instruction, wherein the target information includes light data and / or current weather data of the vehicle's external environment; An input module, used for inputting the target information into a makeup suggestion model trained on the vehicle-mounted system to obtain makeup suggestions; The display module displays the makeup suggestions on the in-vehicle entertainment screen in English.

9. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the method according to any one of claims 1 to 7. 10 . A storage medium, when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method according to claim 1 .

Images