Lamp adaptive adjustment method and system based on driver and passenger interaction

Abstract

The invention provides a driver and passenger interaction-based lamp adaptive adjustment method and system, and relates to the technical field of vehicle driving, and the method comprises the steps: constructing a display scheme of a lamp group based on a sample picture uploaded by a user, and a display atmosphere corresponding to each display scheme; facial expression and gesture changes of a driver are monitored in real time through a visual acquisition subsystem; matching a target display scheme and a target display atmosphere from the display schemes according to the facial expression and the gesture change, and determining a corresponding target lamp group control instruction; and adjusting the display color of each LED lamp in the vehicle lamp group according to the target lamp group control instruction, so that the display of the lamp group is matched with the target display scheme and the display atmosphere. By implementing the method, the display scheme and the display atmosphere of the lamp group can be automatically adjusted to match the emotion and environment requirements of a driver, so that the personalization and the comfort of the internal environment of the vehicle are improved, and meanwhile, the interactivity and the intelligent degree of driving experience are improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle driving technology, and in particular to a method and system for adaptively adjusting lamps based on driver-passenger interaction. Background Art

[0002] In modern vehicles, the lighting system not only plays a basic lighting role, but also is an important element to enhance the vehicle's appearance and driving experience. With the development of technology, the vehicle lighting system has evolved from a simple switch control to a system that can achieve a variety of lighting modes.

[0003] In the related art, the vehicle lighting adjustment system usually includes two modes: manual and automatic. In the manual mode, the driver can select different lighting modes through physical switches or touch screen operation interfaces. The automatic mode automatically adjusts the light brightness and color through ambient light sensors to adapt to different driving environments and weather conditions.

[0004] However, the vehicle lighting adjustment method in the related art is too cumbersome, such as requiring manual touch screen operation, and its display effect is generally limited to the adjustment of light brightness and color, failing to fully consider the driver's personal preferences and emotional changes, resulting in a low degree of personalization. Summary of the invention

[0005] The present application provides a method and system for adaptively adjusting lamps based on driver-passenger interaction, which is used to solve the problem that the lamp adjustment method in the related art is too complicated to operate and the display effect is difficult to meet the personalized needs of the driver.

[0006] In a first aspect, the present application provides a lamp adaptive adjustment method based on driver-passenger interaction, which is applied to a vehicle lamp adjustment system, including a visual acquisition subsystem and a lamp group control subsystem. The method includes: Based on the sample pictures uploaded by the user, a display scheme of the light group and a display atmosphere corresponding to each display scheme are constructed, wherein the display scheme and the corresponding display atmosphere uniquely determine a set of control instructions for the light group, and the light group includes a plurality of densely arranged LED lights; Real-time monitoring of the driver's facial expressions and gestures through a visual acquisition subsystem, where the visual acquisition subsystem is equipped with at least one computer vision sensing device; Matching a target display scheme and a target display atmosphere from the display scheme according to the facial expression and gesture changes, and determining a corresponding target light group control instruction; The display color of each LED light in the vehicle light group is adjusted according to the target light group control instruction, so that the light group display matches the target display scheme and display atmosphere.

[0007] Through the above embodiments, the vehicle lighting adjustment system collects the driver's facial expression and gesture information through the visual acquisition subsystem, and combined with the sample pictures uploaded by the user, it can automatically adjust the display scheme and display atmosphere of the lighting group to match the driver's emotions and environmental requirements, thereby increasing the personalization and comfort of the vehicle's interior environment, while improving the interactivity and intelligence of the driving experience.

[0008] In some embodiments, the step of constructing a display scheme of the light group based on the sample pictures uploaded by the user, and the display atmosphere corresponding to each display scheme, specifically includes: Using an image recognition algorithm to extract key visual elements from the sample image, the key visual elements include color, shape and subject; Determine the control instructions of each LED light in the light group according to the key visual element, and obtain the display scheme of the light group; One or more display atmospheres corresponding to the display scheme are determined according to the preset emotional characteristics, and the colors corresponding to different display atmospheres are not all the same.

[0009] Through the above embodiment, the vehicle lighting adjustment system analyzes the sample pictures uploaded by the user through the image recognition algorithm, extracts key visual elements such as color, shape and theme, and generates a display plan for the lighting group, so that the lighting group can more accurately reflect the atmosphere and style in the picture, thereby better meeting the user's personalized needs and emotional expression.

[0010] In some embodiments, before the step of matching the target display scheme and the target display atmosphere from the display scheme according to the facial expression and gesture changes, and determining the corresponding target light group control instructions, the method further includes: Record the driver's commonly used operation gestures and build a mapping relationship between the operation gestures and the target display scheme; A matching rule between the target display scheme and the target display atmosphere is determined according to the mapping relationship and the current emotional feature, and the current emotional feature is determined according to the facial expression.

[0011] Through the above embodiments, the vehicle lighting adjustment system can construct a mapping relationship between the driver's commonly used operating gestures and the display scheme, so that the driver can directly call the preset display scheme and display atmosphere through specific gestures, thereby realizing the combination of active control of gesture operation and passive adjustment of emotional characteristics, which not only simplifies the operation process, improves the response speed and ease of use of the system, but also makes the lighting adjustment during driving more intuitive and convenient.

[0012] In some embodiments, the step of constructing a mapping relationship between the operation gesture and the target display scheme specifically includes: A first type of gesture is selected from the operation gestures to construct a function mapping relationship, and the function mapping relationship is used to switch and select the display scheme to obtain a target display scheme; A second type of gesture is selected from the operation gesture to build a custom mapping relationship, where the custom mapping relationship is used to directly lock the target display scheme; A mapping relationship between the operation gesture and the target display scheme is determined according to the function mapping relationship and the custom mapping relationship.

[0013] Through the above embodiments, the vehicle lighting adjustment system determines the mapping relationship between the operation gesture and the display scheme by constructing function mapping and custom mapping. This layered gesture recognition architecture improves the personalization of the lighting display, allowing the system to respond more flexibly to different user needs.

[0014] In some embodiments, the step of monitoring the driver's facial expression and gesture changes in real time through a visual acquisition subsystem, the visual acquisition subsystem being equipped with at least one computer vision sensing device; matching a target display scheme and a target display atmosphere from the display scheme according to the facial expression and gesture changes, and determining a corresponding target light group control instruction specifically includes: Name all the display schemes; Recognize the driver's voice input information, the voice input information including the scheme name and current emotion characteristics; The scheme name is matched with the naming, and the current emotional feature is matched with the preset emotional feature to determine the target display scheme and the target display atmosphere.

[0015] Through the above embodiments, the vehicle lighting adjustment system enhances the accuracy of display scheme selection and the convenience of operation through real-time monitoring of the visual acquisition subsystem and dual verification of voice input. This multimodal interaction method improves the user-friendliness and interaction efficiency of the system, allowing drivers to adjust the lighting atmosphere inside and outside the car while maintaining driving attention.

[0016] In some embodiments, before the step of constructing a display scheme of the light group based on the sample pictures uploaded by the user, and the display atmosphere corresponding to each display scheme, the step further includes: Receive sample pictures and preset emotion features newly uploaded by users; The sample image and preset emotion features are loaded into the local visual acquisition subsystem and light group control subsystem through over-the-air download technology.

[0017] Through the above embodiment, the vehicle lighting adjustment system receives and processes the newly uploaded sample pictures and preset emotional features of the user, and updates the local system through over-the-air download technology. This dynamic update mechanism ensures that the lighting adjustment system can continuously adapt to new user needs and environmental changes, and enhances the adaptability of the system.

[0018] In some embodiments, before the step of adjusting the display color of each LED light in the vehicle light group according to the target light group control instruction so that the light group display matches the target display scheme and display atmosphere, the step further includes: Determine a target light group area to be adjusted, the target light group area including a vehicle exterior area and a vehicle interior area; Adjust the display scheme and display atmosphere of the target light group area.

[0019] Through the above embodiment, before adjusting the LED light display color, the vehicle lighting adjustment system first determines the target light group area to be adjusted. Such detailed management improves the accuracy of light adjustment and the adaptability of the effect. By distinguishing the different needs of the internal and external areas of the vehicle, the lighting effect can be controlled more accurately to adapt to different usage scenarios and driving conditions.

[0020] In a second aspect, the present application provides a vehicle lamp adjustment system, the vehicle lamp adjustment system comprising: one or more processors and a memory; The memory is coupled to the one or more processors, and the memory is used to store computer program code, which includes computer instructions. The one or more processors call the computer instructions so that the vehicle lighting adjustment system can implement a lighting adaptive adjustment method based on driver and passenger interaction provided in the above embodiment, which will not be repeated here.

[0021] In a third aspect, the present application provides a computer-readable storage medium, including instructions. When the instructions are executed on a vehicle lighting adjustment system, the vehicle lighting adjustment system can implement a lighting adaptive adjustment method based on driver and passenger interaction provided in the above-mentioned embodiment, which will not be repeated here.

[0022] In a fourth aspect, the present application provides a computer program product. When the computer program product runs on a vehicle lighting adjustment system, the vehicle lighting adjustment system can implement a lighting adaptive adjustment method based on driver and passenger interaction provided in the above embodiment, which will not be repeated here.

[0023] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. Combined with the visual acquisition subsystem, the vehicle lighting system is adjusted by monitoring the driver's facial expressions and gestures in real time. This real-time feedback mechanism not only makes the lighting adjustment more interactive and intelligent, but also can accurately match the driver's emotions and environmental needs, greatly improving the personalized experience and comfort in the car.

[0024] 2. Use image recognition technology to extract key visual elements (such as color, shape, and theme) from the pictures uploaded by users, and automatically generate a lighting display scheme that matches the atmosphere of the picture. This approach allows the lighting system to not only reflect the current environment and mood, but also to make a direct visual and emotional connection with the user's personalized content such as pictures.

[0025] 3. A mapping relationship between operation gestures and target display schemes is constructed. This allows users to select and switch lighting display schemes with simple gestures, greatly simplifying the operation process and improving the system's response speed and ease of use. This mapping mechanism not only improves the intuitiveness of the interaction, but also enhances the safety and convenience of driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 It is a flow chart of a method for adaptively adjusting lamps based on driver-passenger interaction in an embodiment of the present application; Figure 2 is another flow chart of a method for adaptively adjusting lamps based on driver-passenger interaction in an embodiment of the present application; Figure 3 It is a schematic diagram of the structure of a physical device of a vehicle lighting adjustment system in an embodiment of the present application. DETAILED DESCRIPTION

[0027] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more listed items.

[0028] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0029] For ease of understanding, the application scenarios of related technical embodiments are introduced below.

[0030] A user installed a lighting system on his vehicle to adjust the display solutions for the interior and exterior lights of the vehicle. However, he found that there were some problems with the vehicle lighting adjustment solutions on the market. Either the operation was cumbersome and required manual adjustment, or the degree of intelligence was insufficient. Generally, only the brightness and color of the interior and exterior lights could be adjusted, and it was difficult to achieve adaptive adjustment according to the driver's real-time state and preferences.

[0031] In response to this, the present application provides a method and system for adaptive adjustment of vehicle lights based on the interaction between the driver and passengers. Multiple personalized lighting display solutions are generated based on the personalized pictures uploaded by the user. During use, the camera is used to capture the user's facial expressions and gestures in real time, and his current emotions and display pattern requirements are automatically inferred, and the lighting atmosphere effect and pattern display effect inside and outside the vehicle are adjusted accordingly. For example, when the system detects that the user is smiling, it will present a bright and cheerful color combination; when Xiao Zhang frowns in thought, the lights will turn to a soft and soothing tone. At the same time, based on the user's gesture actions, the display solution currently required by the user is determined from multiple personalized lighting display solutions, and then the color and brightness of each LED light in the light group are adjusted to form a pattern display.

[0032] For ease of understanding, the method provided in this embodiment is described in terms of its process below in combination with the above scenario. Specifically, as Figure 1 shown, it is a schematic flow diagram of a method for adaptive adjustment of vehicle lights based on the interaction between the driver and passengers in an embodiment of the present application.

[0033] S101. Construct a display solution for the light group and the corresponding display atmosphere based on the sample pictures uploaded by the user.

[0034] Among them, the sample pictures are patterns or videos that the user wants to display, such as the dynamic video of "Little Bear", the pattern of "Double Happiness", etc. The vehicle lighting adjustment system uses computer vision and image processing technologies to analyze the sample pictures, or analyze each frame of the video, and extract the key visual elements therein, such as the main color, brightness contrast, texture features, geometric shapes, etc. Then, based on the extracted visual elements, a corresponding display solution for the light group is constructed, that is, the display state parameters of each LED light in the vehicle light group are specified, such as color, brightness, blinking frequency, etc.

[0035] It can be understood that since a large number of densely arranged LED lights are usually installed on the interior and exterior trim parts of modern vehicles, the light group can generate a rich variety of lighting pattern effects by flexibly combining the display states of different LED lights. For example, by controlling the parameters such as the color, brightness, and blinking frequency of the LED lights at different positions, a static or dynamic "Little Bear" pattern is formed in the light group.

[0036] At the same time, the vehicle lighting adjustment system associates each display scheme with one or more display atmospheres according to the preset mapping rules. Among them, the display atmosphere reflects the emotional tone conveyed by the display scheme, such as warmth, passion, mystery, melodiousness, etc. Different display atmospheres will have different color matching, such as warm colors reflect more warmth, and cold colors can render a sense of mystery. In addition, a display scheme can correspond to multiple similar display atmospheres, but each unique "display scheme-display atmosphere" combination corresponds to a unique set of light group control instructions.

[0037] S102. Monitor the driver's facial expressions and gesture changes in real time through the visual acquisition subsystem.

[0038] The vehicle lighting adjustment system is equipped with a visual acquisition subsystem for real-time tracking of the driver's facial expressions and gestures. The visual acquisition subsystem is equipped with computer vision sensing devices such as high-resolution cameras and depth sensors to collect close-up facial images and hand movement images of the driver in real time and transmit them to the central processing unit of the vehicle lighting adjustment system.

[0039] Specifically, the visual acquisition subsystem uses facial recognition algorithms to analyze the driver's facial micro-expressions, such as raised eyebrows, raised corners of the mouth, squinting eyes, and other subtle facial muscle movements. Different combinations of micro-expressions reflect the driver's current emotional state, such as happiness, surprise, fatigue, etc. Through facial expression recognition, the visual acquisition subsystem can accurately grasp the driver's real-time emotional changes.

[0040] In addition to facial expressions, the visual acquisition subsystem can also recognize the driver's gestures. Optionally, the visual acquisition subsystem pre-records common gestures registered by the driver, such as waving, raising fingers, and opening palms, and establishes a mapping relationship with specific control instructions. During driving, the driver makes a gesture, and the visual acquisition subsystem captures and recognizes the gesture, and then triggers the corresponding command, such as switching the lighting display scheme. It should be noted that in order to reduce false triggering, gesture interaction should be set in an area that is within the driver's field of view but does not affect driving operations.

[0041] For example, in a specific embodiment, the driver yawns tiredly on his way home from get off work. The visual acquisition subsystem immediately recognizes that he is tired at the moment, automatically adjusts the interior lighting to a soft warm tone, and flashes slowly to remind him to take a rest. When the driver enters the tunnel, he slightly raises his right hand and extends two fingers. The system recognizes that this is a pre-set "switch atmosphere" gesture, so it immediately dims the brightness of the ceiling light, turns on the front taillights of the car, and makes the interior atmosphere lights flash slowly to simulate the effect of passing through the tunnel.

[0042] S103 , matching a target display scheme and a target display atmosphere from display schemes according to changes in facial expressions and gestures.

[0043] The vehicle lighting adjustment system analyzes the driver's facial expression and gesture data sent back by the visual acquisition subsystem, and matches the target display scheme and target display atmosphere that best suits the current driver status from multiple preset display schemes.

[0044] Specifically, the vehicle lighting adjustment system first uses the expression recognition algorithm to analyze the driver's facial expression, and judges the driver's emotional state at the moment, such as happiness, surprise, fatigue, etc., through the relative position and deformation amplitude of facial feature points such as eyebrows, eyes, and mouth corners. At the same time, the gesture recognition module will track the driver's hand movements in real time, compare the finger extension state, palm orientation and other factors with the preset gesture library, and identify directive gestures such as switching schemes and adjusting brightness.

[0045] After determining the driver's current emotional state and control instructions, the vehicle lighting adjustment system selects the best match from multiple candidate display schemes according to the pre-built matching rules as the target display scheme at the moment. At the same time, the corresponding target display atmosphere is matched based on the driver's current emotional state.

[0046] For example, in a specific embodiment, a user has just uploaded a red heart pattern and preset a romantic and warm emotional feature. While driving, the visual acquisition subsystem detects that the user's mouth corners are raised and his eyes are shining, and determines that he is in a state of joy. At this moment, the user gently waves his right hand and makes a gesture to switch patterns. The vehicle lighting adjustment system responds quickly, automatically matches the display scheme of the red heart, and selects a romantic and warm display atmosphere. Then, it sends a series of control instructions to the light group control subsystem, instructing the LED lights on the roof, doors, etc. to display a bright and full red heart shape, and slowly flash with the rhythm of the music in the car, creating a romantic and warm atmosphere.

[0047] S104, adjusting the display color of each LED light in the vehicle light group according to the target light group control instruction, so that the light group display matches the target display scheme and target display atmosphere.

[0048] In step S103, the vehicle lighting adjustment system has determined the target display scheme and target display atmosphere that match the current driver state, and generated the corresponding light group control instruction sequence. This step will execute these instructions to effectively adjust the display state of the vehicle light group. When the states of all LED lights in the light group are adjusted in place, the vehicle interior and exterior will present a lighting effect that is highly consistent with the target display scheme and target display atmosphere.

[0049] Specifically, after receiving the control command sequence issued by the vehicle lighting adjustment system, the light group control subsystem begins to parse and execute each command. Each command clearly specifies the color, brightness and other parameters that the LED lights at a specific position in the light group should present at a specific moment. The light group control subsystem converts these parameter values ​​into control signals and applies them to the control electrodes of the corresponding LED lights, causing corresponding changes in their light-emitting states.

[0050] Taking color control as an example, the control instruction will include the component values ​​of the three primary colors RGB. The light group control subsystem converts the RGB value into a PWM signal, adjusts the ratio of the luminous intensity of the three sub-pixels of the red, green and blue LED lights, and thus accurately controls its display color. Multiple LED lights are matched with different colors to form a color layout in the light group that matches the target display scheme. As for brightness control, the control instruction directly specifies the current that each LED light needs to emit. The light group control subsystem converts the current value into a constant current drive signal to make the luminous intensity of the LED light reach the ideal level.

[0051] In addition to adjusting the display color and brightness, the light group control command also controls the dynamic effects of the LED lights, such as flashing frequency, gradient speed, etc., which are not limited here.

[0052] In the above embodiment, the vehicle lighting adjustment system collects the driver's facial expression and gesture information through the visual acquisition subsystem, and combined with the sample pictures uploaded by the user, it can automatically adjust the display scheme and display atmosphere of the lighting group to match the driver's emotions and environmental requirements, thereby increasing the personalization and comfort of the vehicle's interior environment, while improving the interactivity and intelligence of the driving experience.

[0053] The following is a more detailed description of the process of the method provided by this embodiment. Figure 2 , which is another flow chart of a method for adaptively adjusting lamps based on driver-passenger interaction in an embodiment of the present application.

[0054] S201, receiving a sample image and preset emotion features newly uploaded by a user.

[0055] During the initialization phase of the vehicle lighting adjustment system, the system provides users with an interface for uploading sample images. Users can select their favorite images and upload them to the vehicle lighting adjustment system through mobile applications or the vehicle's central control screen. Sample images can be static patterns or photos, or dynamic video clips. At the same time, users can also preset one or more emotional feature labels for each sample image, such as warmth, passion, and joy.

[0056] S202, loading the sample images and preset emotion features into the local visual acquisition subsystem and light group control subsystem through over-the-air download technology.

[0057] Since the vehicle lighting adjustment system involves a large amount of sample image data and the vehicle's storage and computing resources are relatively limited, the vehicle lighting adjustment system uses Over-the-Air (OTA) technology in its design to achieve incremental updates of sample images and preset emotional features. Specifically, when a user uploads a new sample image, the cloud server of the vehicle lighting adjustment system will package the image data and emotional features into an update firmware, and use OTA technology to download it in the vehicle's dormant state to complete the data update of the local system.

[0058] In the above embodiment, the vehicle lighting adjustment system receives and processes the newly uploaded sample pictures and preset emotional features of the user, and updates the local system through over-the-air download technology. This dynamic update mechanism ensures that the lighting adjustment system can continuously adapt to new user needs and environmental changes, and enhances the adaptability of the system.

[0059] S203: Use an image recognition algorithm to extract key visual elements from the sample image.

[0060] After obtaining the sample images uploaded by the user, the vehicle lighting adjustment system performs semantic understanding and feature extraction on the image content to prepare for the subsequent generation of the lighting display solution. Specifically, the vehicle lighting adjustment system uses an image recognition algorithm to quantify the color of the sample images and extract the most frequently appearing main color. For example, in a photo with a blue ocean as the main subject, the algorithm will automatically extract representative colors such as sea blue and sky blue. In addition, color attributes such as saturation and brightness will also affect the final visual effect of the light. The algorithm will further analyze the HSV components of these colors to guide the dynamic range setting of the light.

[0061] Furthermore, the image recognition algorithm analyzes the periodic change pattern of pixels in the image through methods such as gradient transformation, and then distinguishes different texture areas, such as sand, fluff, ripples, etc. These texture features can be mapped to dynamic patterns in the light group display solution to create a texture experience that matches the sample image. In addition, the image recognition algorithm can also use technical means such as edge detection, region segmentation, and contour matching to extract significant geometric shapes from the image, such as circles, triangles, and stars. This provides an important layout reference for the light group display solution. For example, the algorithm segmented the circular outline of the flower disk from a close-up picture of a sunflower, and it can use this as a prototype to design a radially arranged light pattern.

[0062] It should be noted that since vehicle lighting groups are usually composed of standardized LED modules, the image recognition algorithm needs to consider the constraints of the hardware equipment when extracting key visual elements, such as the color gamut coverage, resolution size, dynamic range and other parameters of a single module. Only within the scope allowed by the hardware can the algorithm generate practical and usable lighting group control instructions.

[0063] S204, determining the control instructions for each LED light in the light group according to the key visual elements, and obtaining a display scheme for the light group.

[0064] After the image recognition algorithm completes the extraction of key visual elements of the sample image, the vehicle lighting adjustment system further maps these color, texture, shape and other features into specific lighting group control instructions, thus forming a complete lighting group display solution.

[0065] Specifically, the vehicle lighting adjustment system finds several achievable color points closest to the main color of the sample image on the chromaticity diagram based on the color gamut characteristics of the LED lamp, and directly maps their RGB values ​​to the LED lamps in the corresponding area. For example, if the sample image is mainly warm-toned, the algorithm will select the brightest colors in the warm color area and assign them to the display scheme of the ambient light. Then, the texture information of the sample image is used to add dynamic effects to the LED lamp. Finally, based on the shape information extracted from the sample image, the spatial layout of the LED lamp is determined.

[0066] S205: Determine one or more display atmospheres corresponding to the display scheme according to preset emotional characteristics.

[0067] Specifically, the vehicle lighting adjustment system pre-builds a mapping dictionary from emotional features to display atmospheres. The dictionary defines various common emotional features and their common expressions in lighting semantics. For example, "warmth" usually corresponds to soft, yellowish light tones, with a slow gradient effect as the main effect. "Passion" often uses bright warm tones, such as red and orange, with fast-paced flashing light effects. After generating the light group display plan, the system will search the mapping dictionary for the corresponding display atmosphere based on the emotional feature labels of the sample images, and make local fine-tuning to the display plan to highlight its emotional tone.

[0068] In the above embodiment, the vehicle lighting adjustment system analyzes the sample pictures uploaded by the user through the image recognition algorithm, extracts key visual elements such as color, shape and theme, and generates a display plan for the lighting group, so that the lighting group can more accurately reflect the atmosphere and style in the picture, thereby better meeting the user's personalized needs and emotional expression.

[0069] S206 , input the operation gestures commonly used by the driver, and select the first type of gestures from them to build a function mapping relationship.

[0070] In order to improve the usability and interaction efficiency of the vehicle lighting adjustment system, the vehicle lighting adjustment system allows drivers to pre-record a set of commonly used operation gestures. These gestures can be habitual actions of drivers in daily driving, such as waving, raising fingers, opening palms, etc. The vehicle lighting adjustment system selects the first type of gestures from the recorded operation gestures to build a functional mapping relationship. Among them, functional mapping refers to associating a specific gesture with a specific function of light display and control. These functions are usually high-frequency operations of drivers when using the lighting system, such as switching display schemes, adjusting brightness, changing color themes, etc. The system corresponds the first type of gestures to these functions one by one to form an intuitive and easy-to-remember mapping relationship.

[0071] S207: Filter out the second type of gestures from the operation gestures to build a custom mapping relationship.

[0072] The vehicle lighting adjustment system supports the association of user-defined gestures with display schemes. The system selects the second type of gestures from the recorded operation gestures for the user to map them to the specified display scheme. Unlike the first type of gestures, the second type of gestures do not trigger specific control functions, but are used to quickly call out a set of display schemes preferred by the user.

[0073] Specifically, users can designate any gesture they enter as a second-class gesture and bind it to a preset display scheme on the mobile application. In this way, the gesture is dedicated to calling out this display scheme. When the system recognizes that the user has made the preset gesture, it will directly switch the interior ambient light to the bound display scheme, without the need to perform multiple steps through function switching.

[0074] S208: Determine a mapping relationship between the operation gesture and the target display solution according to the function mapping relationship and the custom mapping relationship.

[0075] Specifically, when the vehicle lighting adjustment system recognizes that the driver makes a certain operation gesture, it will first determine whether the gesture belongs to the second category. If so, the current display scheme is directly switched to the target scheme bound to the gesture, and the corresponding control instructions are executed. If not, the system then determines whether the gesture is a first category gesture. If so, the control function of the gesture mapping is triggered, such as switching the previous / next scheme, increasing / decreasing the brightness, etc. The system calculates the target display scheme according to the functional requirements and switches the current scheme to the target scheme. If it is neither the first category nor the second category, no operation is triggered.

[0076] S209: Determine a matching rule between the target display scheme and the target display atmosphere according to the mapping relationship and the current emotional characteristics.

[0077] Specifically, the vehicle lighting adjustment system determines the target display scheme corresponding to the driver's current input gesture based on the gesture mapping relationship. One operation gesture may correspond to one or more alternative display schemes. Then, the system analyzes the emotional characteristics inferred from the driver's facial expression and matches it with the preset emotional characteristics of each alternative display scheme. If the emotional characteristics of a display scheme are most consistent with the current emotional state of the driver, the system will give priority to this scheme as the final target display scheme and match its corresponding display atmosphere parameters.

[0078] In the above embodiment, the vehicle lighting adjustment system can construct a mapping relationship between the driver's commonly used operating gestures and the display scheme, so that the driver can directly call the preset display scheme and display atmosphere through specific gestures, thereby realizing the combination of active control of gesture operation and passive adjustment of emotional characteristics, which not only simplifies the operation process, improves the system's response speed and ease of use, but also makes the lighting adjustment during driving more intuitive and convenient.

[0079] S210 , matching a target display scheme and a target display atmosphere from the display schemes according to the collected facial expressions and gesture changes of the driver.

[0080] This step is the same as S103 and will not be repeated here.

[0081] S211. Name all display schemes.

[0082] Specifically, the vehicle lighting adjustment system uses the method of theme + style + serial number to generate a unique naming identifier for each display scheme. Among them, the theme reflects the core content or situation to be expressed by the display scheme, such as "starry sky", "forest", "party", etc. The style reflects the visual atmosphere and emotional tone of the display scheme, such as "warmth", "dynamic", "dream", etc. The serial number is used to distinguish different display schemes under the same theme, usually represented by numbers or letters.

[0083] S212: Match the driver's voice input information with the name, and match the current emotional characteristics with the preset emotional characteristics to determine the target display scheme and target display atmosphere.

[0084] Specifically, when the driver issues a voice command like "Open Starry Sky Fantasy Plan No. 2", the vehicle lighting adjustment system first obtains the audio signal through the on-board microphone array and pre-processes it, such as noise reduction and echo cancellation. Then, the speech recognition engine transcribes the optimized audio into text and extracts keywords such as "open", "Starry Sky Fantasy No. 2", etc. The system performs full-text matching in the naming index table based on the keywords to find the corresponding target display plan. If there is no exact match for the plan name, the system can also enable fuzzy matching and semantic parsing to intelligently infer the plan that the driver is most likely to call.

[0085] At the same time, the vehicle lighting adjustment system will track and analyze the driver's facial expressions in real time and extract the emotional feature values ​​contained therein. When the voice command matches the target display scheme, the system calculates the similarity between the preset emotional features of the scheme and the driver's current emotional state. If the two sets of features have a high degree of match, the system directly calls the built-in display parameters of the scheme. If there is a certain deviation (such as exceeding the preset threshold), the system dynamically adjusts the display parameters to generate a display atmosphere that is closer to the driver's actual emotions. Taking the "Starry Sky Fantasy No. 2" scheme as an example, if the system detects that the driver is slightly tired and the corners of his mouth are drooping, the color temperature of the scheme may be adjusted from a cool blue to a warm purple, and the speed of the dynamic effect will be reduced to create a more soothing and relaxing atmosphere.

[0086] In the above embodiment, the vehicle lighting adjustment system enhances the accuracy of display scheme selection and the convenience of operation through real-time monitoring of the visual acquisition subsystem and dual verification of voice input. This multimodal interaction method improves the user-friendliness and interaction efficiency of the system, allowing drivers to adjust the lighting atmosphere inside and outside the car while maintaining driving attention.

[0087] S213: Determine the target light group area to be adjusted.

[0088] Specifically, each display scheme specifies a default target light group area when it is generated and called. In addition to the default area preset by the scheme, the vehicle lighting adjustment system also supports the driver to manually select or modify the target light group area. The driver can intuitively check the light group area that he wants to light up through the visual interface on the vehicle's central control screen, and preview the display effect after the selection in real time, without limitation here.

[0089] S214, adjusting the display color of each LED light in the vehicle light group according to the target light group control instruction, so that the light group display matches the target display scheme and target display atmosphere.

[0090] This step is the same as S104 and will not be described again here.

[0091] In the above embodiment, before adjusting the LED light display color, the vehicle lighting adjustment system first determines the target light group area to be adjusted. Such detailed management improves the accuracy of light adjustment and the adaptability of the effect. By distinguishing the different needs of the internal and external areas of the vehicle, the lighting effect can be controlled more accurately to adapt to different usage scenarios and driving conditions.

[0092] The vehicle lamp adjustment system of the embodiment of the present invention is applied to electronic equipment. Figure 3 A schematic diagram of the architecture of an electronic device suitable for implementing an embodiment of the present invention is shown.

[0093] It should be noted that Figure 3 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0094] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments can be completed by instructions (computer programs), or by controlling related hardware through instructions (computer programs), and the instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. The electronic device of this embodiment includes a storage medium and a processor, wherein a plurality of instructions are stored in the storage medium, and the instructions can be loaded by the processor to execute any step of the method provided in the embodiment of the present invention.

[0095] Specifically, the storage medium and the processor are electrically connected directly or indirectly to realize data transmission or interaction. For example, these elements can be electrically connected to each other through one or more signal lines. The storage medium stores computer execution instructions for implementing the data access control method, including at least one software function module that can be stored in the storage medium in the form of software or firmware. The processor executes various functional applications and data processing by running the software program and module stored in the storage medium. The storage medium can be, but is not limited to, random access storage medium (Random Access Memory, referred to as: RAM), read-only storage medium (Read Only Memory, referred to as: ROM), programmable read-only storage medium (Programmable Read-Only Memory, referred to as: PROM), erasable read-only storage medium (Erasable Programmable Read-Only Memory, referred to as: EPROM), electrically erasable read-only storage medium (Electric Erasable Programmable Read-Only Memory, referred to as: EEPROM), etc. Among them, the storage medium is used to store programs, and the processor executes the program after receiving the execution instruction.

[0096] Furthermore, the software programs and modules in the above-mentioned storage medium may also include an operating system, which may include various software components and / or drivers for managing system tasks (such as memory management, storage device control, power management, etc.), and may communicate with various hardware or software components to provide an operating environment for other software components. The processor may be an integrated circuit chip having signal processing capabilities. The above-mentioned processor may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc., which may implement or execute the various methods, steps, and logic flow diagrams disclosed in this embodiment. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0097] Since the instructions stored in the storage medium can execute the steps in any method provided in the embodiments of the present invention, the beneficial effects of any method provided in the embodiments of the present invention can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0098] The above is only a preferred specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A lamp adaptive adjustment method based on driver-passenger interaction, applied to a vehicle lamp adjustment system, including a visual acquisition subsystem and a lamp group control subsystem, characterized in that: The method comprises: Based on the sample pictures uploaded by the user, a display scheme of the light group and a display atmosphere corresponding to each display scheme are constructed, wherein the display scheme and the corresponding display atmosphere uniquely determine a set of light group control instructions, wherein the light group includes a plurality of densely arranged LED lights, and the sample pictures include scene pictures and patterns; Real-time monitoring of the driver's facial expressions and gestures through a visual acquisition subsystem, wherein the visual acquisition subsystem is equipped with at least one computer vision sensing device; Matching a target display scheme and a target display atmosphere from the display scheme according to the facial expression and gesture changes, and determining a corresponding target light group control instruction; The display color of each LED light in the vehicle light group is adjusted according to the target light group control instruction, so that the light group display matches the target display scheme and target display atmosphere.

2. The method according to claim 1, characterized in that The step of constructing a display scheme of the light group based on the sample pictures uploaded by the user, and a display atmosphere corresponding to each display scheme, specifically includes: Extract key visual elements from the sample images using an image recognition algorithm, wherein the key visual elements include color, shape, and subject matter; Determine the control instructions of each LED light in the light group according to the key visual elements to obtain a display scheme of the light group; One or more display atmospheres corresponding to the display scheme are determined according to preset emotional characteristics, and the colors corresponding to different display atmospheres are not all the same.

3. The method according to claim 1, characterized in that Before the step of matching the target display scheme and the target display atmosphere from the display scheme according to the facial expression and gesture changes, and determining the corresponding target light group control instructions, the step further includes: Recording the operating gestures commonly used by drivers and establishing a mapping relationship between the operating gestures and the target display scheme; A matching rule between the target display scheme and the target display atmosphere is determined according to the mapping relationship and the current emotional feature, and the current emotional feature is determined according to the facial expression.

4. The method according to claim 3, characterized in that The step of constructing a mapping relationship between the operation gesture and the target display scheme specifically includes: Filtering a first type of gestures from the operation gestures to construct a function mapping relationship, wherein the function mapping relationship is used to switch and select the display scheme to obtain a target display scheme; Filtering a second type of gesture from the operation gestures to build a custom mapping relationship, wherein the custom mapping relationship is used to directly lock a target display scheme; A mapping relationship between the operation gesture and the target display scheme is determined according to the function mapping relationship and the custom mapping relationship.

5. The method according to claim 1, characterized in that The visual acquisition subsystem monitors the driver's facial expressions and gestures in real time, and the visual acquisition subsystem is equipped with at least one computer vision sensing device; The step of matching a target display scheme and a target display atmosphere from the display scheme according to the facial expression and gesture changes, and determining a corresponding target light group control instruction specifically includes: Naming all of the display schemes; Recognize the voice input information of the driver, wherein the voice input information includes the scheme name and current emotional characteristics; The scheme name is matched with the naming, and the current emotional characteristics are matched with the preset emotional characteristics to determine the target display scheme and the target display atmosphere.

6. The method according to claim 1, characterized in that Before the step of constructing a display scheme of the light group based on the sample pictures uploaded by the user, and the display atmosphere corresponding to each display scheme, the step further includes: Receive sample pictures and preset emotion features newly uploaded by users; The sample images and preset emotional features are loaded into the local visual acquisition subsystem and light group control subsystem through over-the-air download technology.

7. The method according to claim 1, characterized in that Before the step of adjusting the display color of each LED light in the vehicle light group according to the target light group control instruction so that the light group display matches the target display scheme and the target display atmosphere, the step further includes: Determining a target light group area to be adjusted, wherein the target light group area includes an exterior area of ​​the vehicle and an interior area of ​​the vehicle; The display scheme and display atmosphere of the target light group area are adjusted.

8. A vehicle lamp adjustment system, characterized in that: The vehicle lamp adjustment system includes: one or more processors and memory; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the vehicle lighting adjustment system to perform the method according to any one of claims 1 to 7.

9. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on a vehicle lamp adjustment system, the vehicle lamp adjustment system is caused to perform the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product runs on a vehicle lamp adjustment system, the vehicle lamp adjustment system is enabled to perform the method according to any one of claims 1 to 7.

Images