A method and system for adaptive adjustment of a luminaire based on occupant interaction

Abstract

The application provides a lamp adaptive adjustment method and system based on driver interaction, and relates to the technical field of vehicle driving. The method comprises the following steps: constructing display schemes of a lamp group and display atmospheres corresponding to each display scheme based on sample pictures uploaded by a user; monitoring facial expressions and gesture changes of a driver in real time through a visual acquisition subsystem; matching a target display scheme and a target display atmosphere from the display schemes according to the facial expressions and gesture changes, and determining a corresponding target lamp group control instruction; and adjusting the display color of each LED lamp in the vehicle lamp group according to the target lamp group control instruction, so that the lamp group display matches the target display scheme and the display atmosphere. By implementing the method, the display scheme and the display atmosphere of the lamp group can be automatically adjusted to match the mood and environmental requirements of the driver, the individualization and comfort of the vehicle interior environment are increased, and the interactivity and intelligent degree of the driving experience are improved.

Description

Technical Field

[0001] This application relates to the field of vehicle driving technology, and in particular to a method and system for adaptive adjustment of lighting fixtures based on driver and passenger interaction. Background Technology

[0002] In modern vehicles, lighting systems not only provide basic illumination but are also crucial elements in enhancing the vehicle's aesthetics and driving experience. With technological advancements, vehicle lighting systems have evolved from simple on / off controls to systems capable of providing multiple lighting modes.

[0003] In related technologies, vehicle lighting adjustment systems typically include both manual and automatic modes. In manual mode, the driver can select different lighting modes via a physical switch or touchscreen interface. Automatic mode, on the other hand, uses an ambient light sensor to automatically adjust the brightness and color of the lights to adapt to different driving environments and weather conditions.

[0004] However, the vehicle lighting adjustment methods in related technologies are too cumbersome, requiring manual touchscreen operation, and their display effects are generally limited to adjusting the brightness and color of the lights, failing to fully consider the driver's personal preferences and emotional changes, resulting in a low degree of personalization. Summary of the Invention

[0005] This application provides a method and system for adaptive lighting adjustment based on driver and passenger interaction, which solves the problems that the lighting adjustment methods in related technologies are too cumbersome to operate and the display effect is difficult to meet the personalized needs of drivers.

[0006] In a first aspect, this application provides a method for adaptive adjustment of lighting fixtures based on driver and passenger interaction, applied to a vehicle lighting fixture adjustment system, including a visual acquisition subsystem and a lighting group control subsystem, the method comprising:

[0007] The display scheme of the light group is constructed based on the sample images uploaded by the user, and the display atmosphere corresponding to each display scheme is determined. The display scheme and the corresponding display atmosphere uniquely determine a set of light group control instructions. The light group includes multiple densely arranged LED lights.

[0008] The visual acquisition subsystem monitors the driver's facial expressions and gestures in real time. This visual acquisition subsystem is equipped with at least one computer vision sensing device.

[0009] Based on the changes in facial expressions and gestures, the target display scheme and target display atmosphere are matched from the display scheme, and the corresponding target light group control command is determined;

[0010] The display color of each LED in the vehicle's headlight assembly is adjusted according to the target headlight assembly control command, so that the headlight assembly display matches the target display scheme and display atmosphere.

[0011] Through the above embodiments, the vehicle lighting adjustment system collects the driver's facial expressions and gestures through the visual acquisition subsystem, and combines them with sample images uploaded by the user to automatically adjust the display scheme and atmosphere of the lighting group to match the driver's emotions and environmental needs, thereby increasing the personalization and comfort of the vehicle's interior environment, while also enhancing the interactivity and intelligence of the driving experience.

[0012] In some embodiments, the steps of constructing a display scheme for the light group based on user-uploaded sample images, and the display atmosphere corresponding to each display scheme, specifically include:

[0013] Image recognition algorithms were used to extract key visual elements from the sample image, including color, shape, and subject.

[0014] Based on this key visual element, the control instructions for each LED in the light group are determined, and the display scheme of the light group is obtained.

[0015] Based on preset emotional characteristics, one or more display atmospheres are determined for the display scheme, and the colors corresponding to different display atmospheres are not all the same.

[0016] Through the above embodiments, the vehicle lighting adjustment system analyzes sample images uploaded by users using image recognition algorithms, extracts key visual elements such as color, shape, and theme, and generates a display scheme for the lighting group accordingly. This allows the lighting group to more accurately reflect the atmosphere and style in the image, thereby better meeting the user's personalized needs and emotional expression.

[0017] In some embodiments, prior to the step of matching a target display scheme and a target display atmosphere from the display scheme based on the facial expression and gesture changes, and determining the corresponding target light group control command, the method further includes:

[0018] Input commonly used driver gestures and establish a mapping relationship between these gestures and the target display scheme;

[0019] Based on the mapping relationship and the current emotional characteristics, the matching rules for the target display scheme and the target display atmosphere are determined, and the current emotional characteristics are determined based on the facial expression.

[0020] Through the above embodiments, the vehicle lighting adjustment system can establish a mapping relationship between commonly used driver gestures and display schemes, enabling drivers to directly call preset display schemes and display atmospheres through specific gestures. This achieves a combination of active control of gesture operation and passive adjustment of emotional characteristics, which simplifies the operation process, improves the system's response speed and ease of use, and makes lighting adjustment during driving more intuitive and convenient.

[0021] In some embodiments, the step of establishing the mapping relationship between the operation gesture and the target display scheme specifically includes:

[0022] The first type of gesture is selected from the operation gestures to construct a function mapping relationship. This function mapping relationship is used to switch and select the display scheme to obtain the target display scheme.

[0023] A second type of gesture is selected from the operation gestures to construct a custom mapping relationship, which is used to directly lock the target display scheme;

[0024] The mapping relationship between the operation gesture and the target display scheme is determined based on the function mapping relationship and the custom mapping relationship.

[0025] Through the above embodiments, the vehicle lighting adjustment system determines the mapping relationship between operation gestures and display schemes by constructing functional mapping and custom mapping. This hierarchical gesture recognition architecture improves the personalization of lighting display, enabling the system to respond more flexibly to different user needs.

[0026] In some embodiments, the visual acquisition subsystem monitors the driver's facial expressions and gesture changes in real time, and the visual acquisition subsystem is equipped with at least one computer vision sensing device; the step of matching a target display scheme and a target display atmosphere from the display scheme based on the facial expressions and gesture changes, and determining the corresponding target light group control command, specifically includes:

[0027] Name all of this display scheme;

[0028] Recognize the driver's voice input information, which includes the scheme name and current emotional characteristics;

[0029] The scheme name is matched with the naming, and the current emotional characteristic is matched with the preset emotional characteristic to determine the target display scheme and target display atmosphere.

[0030] Through the above embodiments, the vehicle lighting adjustment system enhances the accuracy of display scheme selection and the convenience of operation by combining real-time monitoring from the visual acquisition subsystem with dual verification via voice input. This multimodal interaction method improves the system's user-friendliness and interaction efficiency, enabling drivers to adjust the interior and exterior lighting atmosphere while maintaining driving focus.

[0031] In some embodiments, before the step of constructing the display scheme of the light group based on the sample images uploaded by the user, and the display atmosphere corresponding to each display scheme, the method further includes:

[0032] Receive newly uploaded sample images and preset emotion features from users;

[0033] The sample image and preset emotional features are loaded into the local visual acquisition subsystem and light control subsystem using over-the-air download technology.

[0034] Through the above embodiments, the vehicle lighting adjustment system receives and processes newly uploaded sample images and preset emotional characteristics from users, and updates the local system via over-the-air (OTA) download technology. This dynamic update mechanism ensures that the lighting adjustment system can continuously adapt to new user needs and environmental changes, enhancing the system's adaptability.

[0035] In some embodiments, prior to the step of adjusting the display color of each LED in the vehicle light group according to the target light group control command to match the light group display with the target display scheme and display atmosphere, the method further includes:

[0036] Determine the target light group area to be adjusted, which includes the vehicle exterior area and the vehicle interior area;

[0037] Adjust the display scheme and atmosphere of the target lighting area.

[0038] Through the above embodiments, before adjusting the LED light display color, the vehicle lighting adjustment system first determines the target light group area to be adjusted. This refined management improves the accuracy and adaptability of the lighting adjustment. By differentiating the different needs of the vehicle's internal and external areas, the lighting effect can be controlled more precisely to adapt to different usage scenarios and driving conditions.

[0039] Secondly, this application provides a vehicle lighting adjustment system, which includes one or more processors and a memory;

[0040] The memory is coupled to the one or more processors and is used to store computer program code, which includes computer instructions. The one or more processors call the computer instructions to enable the vehicle lighting adjustment system to implement the driver-passenger interaction-based adaptive lighting adjustment method provided in the above embodiments, which will not be described in detail here.

[0041] Thirdly, this application provides a computer-readable storage medium including instructions that, when executed on a vehicle lighting adjustment system, enable the vehicle lighting adjustment system to implement the driver-passenger interaction-based adaptive lighting adjustment method provided in the above embodiments, which will not be elaborated here.

[0042] Fourthly, this application provides a computer program product that, when running on a vehicle lighting adjustment system, enables the vehicle lighting adjustment system to implement the driver-passenger interaction-based adaptive lighting adjustment method provided in the above embodiments, which will not be elaborated here.

[0043] One or more technical solutions provided in the embodiments of this application have at least the following technical effects or advantages:

[0044] 1. The vehicle's lights are adjusted in real time by monitoring the driver's facial expressions and gestures using a vision acquisition subsystem. This real-time feedback mechanism not only makes light adjustments more interactive and intelligent, but also accurately matches the driver's emotions and environmental needs, greatly enhancing the personalized experience and comfort inside the vehicle.

[0045] 2. Image recognition technology is used to extract key visual elements (such as color, shape, and theme) from user-uploaded images, and a lighting scheme that matches the atmosphere of the image is automatically generated accordingly. This method allows the lighting system to not only reflect the current environment and mood, but also to establish a direct visual and emotional connection with the user's personalized content, such as images.

[0046] 3. A mapping relationship was established between operation gestures and target display schemes. This allows users to select and switch lighting display schemes with simple gestures, greatly simplifying the operation process and improving the system's response speed and ease of use. This mapping mechanism not only enhances the intuitiveness of the interaction but also strengthens safety and convenience during driving. Attached Figure Description

[0047] Figure 1 This is a flowchart illustrating a method for adaptive adjustment of lighting fixtures based on driver and passenger interaction in an embodiment of this application.

[0048] Figure 2 This is another flowchart illustrating a method for adaptive adjustment of lighting fixtures based on driver and passenger interaction in an embodiment of this application;

[0049] Figure 3 This is a schematic diagram of the physical device structure of a vehicle lighting adjustment system in the embodiments of this application. Detailed Implementation

[0050] The terminology used in the following embodiments of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to include the plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term “and / or” as used in this application refers to any or all possible combinations including one or more of the listed items.

[0051] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0052] To facilitate understanding, the application scenarios of the relevant technical embodiments are described below.

[0053] A user installed a lighting system in his car to adjust the display scheme of the interior and exterior lights. However, he found that the vehicle lighting adjustment schemes on the market all had some problems. They were either cumbersome to operate and required manual adjustment, or they lacked intelligence and could generally only adjust the brightness and color of the interior and exterior lights, making it difficult to achieve adaptive adjustment based on the driver's real-time state and preferences.

[0054] To address this issue, this application provides a method and system for adaptive lighting adjustment based on driver and passenger interaction. The system generates multiple personalized lighting display schemes based on user-uploaded personalized images. During use, a camera captures the user's facial expressions and gestures in real time, automatically inferring their current mood and desired display pattern, and accordingly adjusting the lighting atmosphere and pattern display effects inside and outside the vehicle. For example, when the system detects a smile, it displays a bright and cheerful color scheme; when the user is frowning in thought, the lighting switches to a softer, more soothing tone. Simultaneously, based on the user's gestures, the system determines the desired display scheme from multiple personalized lighting display schemes, thereby adjusting the color and brightness of each LED in the lighting group to create a pattern display.

[0055] To facilitate understanding, the method provided in this implementation will be described in detail below, using the above scenario as an example. Specifically, as follows... Figure 1 The diagram shown is a flowchart illustrating an adaptive lighting adjustment method based on driver and passenger interaction in an embodiment of this application.

[0056] S101. Construct a display scheme for the light group based on the sample images uploaded by the user, and the display atmosphere corresponding to each display scheme.

[0057] Among them, the sample picture is a pattern or video that the user wants to display, such as a dynamic video of "Little Bear" or a pattern of the character "Xi". The vehicle lamp adjustment system uses computer vision and image processing technologies to analyze the sample picture or each frame of the video, extract key visual elements therein, such as the main color, brightness contrast, texture features, geometric shapes, etc. Then, based on the extracted visual elements, a corresponding lamp group display scheme is constructed, that is, the display state parameters of each LED lamp in the vehicle lamp group are specified, such as color, brightness, blinking frequency, etc.

[0058] It can be understood that since a large number of densely arranged LED lamps are usually assembled on the interior and exterior trim parts of modern vehicles, the lamp group can generate a rich variety of lighting pattern effects by flexibly combining the display states of different LED lamps. For example, by controlling parameters such as the color, brightness, and blinking frequency of the LED lamps at different positions, a static or dynamic pattern of "Little Bear" is formed in the lamp group.

[0059] At the same time, the vehicle lamp adjustment system associates each display scheme with one or more display atmospheres according to a preset mapping rule. Among them, the display atmosphere reflects the emotional tone conveyed by the display scheme, such as warm, passionate, mysterious, melodious, etc. Different display atmospheres will have differences in color matching. For example, warm colors more reflect warmth, and cool colors are more capable of rendering a sense of mystery. In addition, a display scheme can correspond to multiple similar display atmospheres, but each unique "display scheme - display atmosphere" combination corresponds to a unique set of lamp group control instructions.

[0060] S102. Real-time monitor the facial expressions and gesture changes of the driver through the visual acquisition subsystem.

[0061] The vehicle lamp adjustment system is equipped with a visual acquisition subsystem for real-time tracking of the facial expressions and gesture movements of the driver. Among them, the visual acquisition subsystem is equipped with computer vision sensing devices such as high-resolution cameras and depth sensors, which can real-time collect the facial close-up images and hand movement images of the driver and transmit them to the central processing unit of the vehicle lamp adjustment system.

[0062] Specifically, the visual acquisition subsystem uses facial recognition algorithms to analyze the micro facial expressions of the driver, such as subtle facial muscle movements like eyebrows raising, corners of the mouth turning up, eyes squinting, etc. Different combinations of micro facial expressions reflect the current emotional state of the driver, such as happy, surprised, tired, etc. Through facial expression recognition, the visual acquisition subsystem can accurately grasp the real-time emotional changes of the driver.

[0063] In addition to facial expressions, the visual acquisition subsystem can also recognize driver gestures. Optionally, the visual acquisition subsystem pre-records commonly used gestures registered by the driver, such as waving, raising a finger, and opening the palm, and establishes a mapping relationship with specific control commands. During driving, when the driver makes a gesture, the visual acquisition subsystem captures and recognizes the gesture, thereby triggering the corresponding command, such as switching the headlight display scheme. It should be noted that, to reduce false triggers, gesture interactions should be limited to areas within the driver's field of vision but that do not interfere with driving operations.

[0064] For example, in one specific embodiment, a driver yawns wearily on his way home from get off work. The vision acquisition subsystem immediately recognizes his fatigue and automatically adjusts the interior lighting to a soft, warm tone, flashing it gently to remind him to take a rest. When the driver enters a tunnel, he slightly raises his right hand and extends two fingers. The system recognizes this as a pre-set "ambience switching" gesture, and immediately dims the dome lights, turns on the front and rear lights, and makes the interior ambient lighting flash gently to simulate the effect of passing through a tunnel.

[0065] S103. Match the target display scheme and target display atmosphere from the display schemes based on changes in facial expressions and gestures.

[0066] The vehicle lighting adjustment system analyzes the driver's facial expressions and gestures data transmitted back by the vision acquisition subsystem, and matches the target display scheme and target display atmosphere that best matches the current driver's state from multiple preset display schemes.

[0067] Specifically, the vehicle lighting adjustment system first uses an expression recognition algorithm to analyze the driver's facial expressions. By analyzing the relative positions and deformation amplitudes of facial feature points such as eyebrows, eyes, and corners of the mouth, it determines the driver's current emotional state, such as happiness, surprise, or fatigue. Simultaneously, the gesture recognition module tracks the driver's hand movements in real time, comparing the extension of fingers and the direction of the palm with a preset gesture database to identify command gestures such as switching modes and adjusting brightness.

[0068] After determining the driver's current emotional state and control commands, the vehicle's lighting adjustment system selects the best match from multiple candidate display schemes based on pre-built matching rules, using it as the target display scheme for that moment. Simultaneously, it matches a corresponding target display atmosphere based on the driver's current emotional state.

[0069] For example, in one specific embodiment, a user has just uploaded a bright red heart image with a preset romantic and warm emotional tone. While driving, the visual acquisition subsystem detects that the user's lips are upturned and their eyes are bright, determining that they are in a joyful emotional state. At this moment, the user gently waves their right hand, making a gesture to change the image. The vehicle lighting adjustment system responds quickly, automatically matching the red heart display scheme and selecting a romantic and warm display atmosphere. Then, it sends a series of control commands to the lighting control subsystem, instructing the LED lights on the roof, doors, etc., to display a bright and full red heart shape, which flashes slowly in rhythm with the music inside the car, creating a romantic and warm atmosphere.

[0070] S104. Adjust the display color of each LED in the vehicle's light group according to the target light group control command, so that the light group display matches the target display scheme and target display atmosphere.

[0071] In step S103, the vehicle lighting adjustment system has determined the target display scheme and target display atmosphere that match the current driver's state and generated a corresponding sequence of lighting control commands. This step will execute these commands to effectively adjust the display state of the vehicle lighting group. Once the states of all LEDs in the lighting group are adjusted to their proper positions, the interior and exterior of the vehicle will present a lighting effect that highly matches the target display scheme and target display atmosphere.

[0072] Specifically, after receiving the sequence of control commands from the vehicle's lighting control system, the lighting control subsystem begins to parse and execute them one by one. Each command clearly specifies the color, brightness, and other parameters that an LED at a specific location in the lighting assembly should display at a specific time. The lighting control subsystem converts these parameter values ​​into control signals, applies them to the control electrodes of the corresponding LED, and causes a corresponding change in its luminous state.

[0073] Taking color control as an example, the control command includes the component values ​​of the three primary colors (RGB). The lamp group control subsystem converts the RGB values ​​into PWM signals, adjusting the luminous intensity ratio of the red, green, and blue sub-pixels of the LED, thereby precisely controlling its displayed color. Multiple LEDs, arranged in different color combinations, form a color layout in the lamp group that matches the target display scheme. For brightness control, the control command directly specifies the amount of current required for each LED to emit light. The lamp group control subsystem converts the current value into a constant current drive signal, ensuring the LED's luminous intensity reaches the ideal level.

[0074] In addition to adjusting the displayed color and brightness, the light group control commands also control the dynamic effects of the LED lights, such as flashing frequency and fading speed, which are not limited here.

[0075] In the above embodiments, the vehicle lighting adjustment system collects the driver's facial expressions and gestures through the vision acquisition subsystem. Combined with sample images uploaded by the user, it can automatically adjust the display scheme and atmosphere of the lighting group to match the driver's emotions and environmental needs, thereby increasing the personalization and comfort of the vehicle's interior environment and enhancing the interactivity and intelligence of the driving experience.

[0076] The following is a more detailed description of the process of the method provided in this implementation. Specifically, as follows... Figure 2 The diagram shown is another flowchart illustrating an adaptive lighting adjustment method based on driver and passenger interaction in an embodiment of this application.

[0077] S201. Receive newly uploaded sample images and preset emotion features from users.

[0078] During the initialization phase of the vehicle lighting adjustment system, the system provides users with an interface for uploading sample images. Users can select their favorite images and upload them to the system via a mobile application or the in-vehicle central control screen. These sample images can be static patterns or photographs, or dynamic video clips. Users can also preset one or more emotional characteristic tags for each sample image, such as warm, passionate, or cheerful.

[0079] S202. Load sample images and preset emotional features into the local visual acquisition subsystem and light control subsystem using over-the-air download technology.

[0080] Because the vehicle lighting adjustment system involves a large amount of sample image data, and the vehicle's storage and computing resources are relatively limited, the system employs Over-the-Air (OTA) technology to incrementally update sample images and preset emotional features. Specifically, when a user uploads a new sample image, the vehicle lighting adjustment system's cloud server packages the image data and emotional features into an update firmware, which is then downloaded using OTA technology while the vehicle is in sleep mode, completing the local system's data update.

[0081] In the above embodiments, the vehicle lighting adjustment system receives and processes newly uploaded sample images and preset emotional characteristics from the user, and updates the local system via over-the-air (OTA) download technology. This dynamic update mechanism ensures that the lighting adjustment system can continuously adapt to new user needs and environmental changes, enhancing the system's adaptability.

[0082] S203. Use image recognition algorithms to extract key visual elements from sample images.

[0083] After acquiring the sample images uploaded by the user, the vehicle lighting adjustment system performs semantic understanding and feature extraction on the image content to prepare for the subsequent generation of the lighting display scheme. Specifically, the system uses image recognition algorithms to quantize the colors of the sample images and extract the most frequently occurring dominant hues. For example, in a photo featuring a blue ocean, the algorithm automatically extracts representative colors such as sea blue and sky blue. Furthermore, attributes such as color saturation and brightness also affect the final visual effect of the lighting; the algorithm further analyzes the HSV components of these colors to guide the dynamic range setting of the lighting.

[0084] Furthermore, image recognition algorithms analyze the periodic variation patterns of pixels in an image using methods such as gradient transformation, thereby distinguishing different texture regions, such as sand, fuzz, and ripples. These texture features can be mapped to dynamic patterns in the lighting display scheme, creating a textured experience that matches the sample image. In addition, image recognition algorithms can also utilize edge detection, region segmentation, and contour matching techniques to extract significant geometric shapes from images, such as circles, triangles, and stars. This provides important layout references for lighting display schemes. For example, if the algorithm segments the circular outline of the flower head from a close-up image of a sunflower, it can use this as a prototype to design a radially arranged light pattern.

[0085] It should be noted that since vehicle headlights are typically composed of standardized LED modules, image recognition algorithms must consider hardware constraints when extracting key visual elements, such as the color gamut coverage, resolution, and dynamic range of individual modules. Only within the limits allowed by the hardware can the algorithm generate usable headlight control commands.

[0086] S204. Determine the control instructions for each LED in the light group based on the key visual elements to obtain the display scheme of the light group.

[0087] After the image recognition algorithm extracts the key visual elements of the sample image, the vehicle lighting adjustment system further maps these features such as color, texture, and shape to specific lighting control commands, thereby forming a complete lighting display scheme.

[0088] Specifically, the vehicle lighting adjustment system, based on the color gamut characteristics of LED lights, identifies several achievable color points on the chromaticity map that are closest to the dominant color tone of the sample image, and directly maps their RGB values ​​to the corresponding LED lights. For example, if the sample image is predominantly warm-toned, the algorithm will select the most vibrant colors in the warm-toned area and assign them to the ambient lighting display scheme. Next, the texture information of the sample image is used to add dynamic effects to the LED lights. Finally, based on the shape information extracted from the sample image, the spatial layout of the LED lights is determined.

[0089] S205. Determine one or more display atmospheres corresponding to the display scheme based on preset emotional characteristics.

[0090] Specifically, the vehicle lighting adjustment system pre-constructs a mapping dictionary that maps emotional characteristics to display atmospheres. The dictionary defines various common emotional characteristics and their common expressions in lighting semantics. For example, "warmth" typically corresponds to soft, yellowish lighting tones, primarily using slow gradient effects. "Passion," on the other hand, often uses vibrant warm colors such as red and orange, paired with fast-paced flashing light effects. After generating the lighting display scheme, the system uses the emotional characteristic tags of sample images to search for the corresponding display atmosphere in the mapping dictionary and makes minor adjustments to the display scheme to highlight its emotional tone.

[0091] In the above embodiments, the vehicle lighting adjustment system analyzes the sample images uploaded by users through image recognition algorithms, extracts key visual elements such as color, shape and theme, and generates a display scheme for the lighting group accordingly. This allows the lighting group to more accurately reflect the atmosphere and style in the image, thereby better meeting the user's personalized needs and emotional expression.

[0092] S206. Input the commonly used operation gestures of drivers, and select the first type of gestures to construct the function mapping relationship.

[0093] To improve the usability and interaction efficiency of the vehicle lighting control system, the system allows drivers to pre-register a set of commonly used gestures. These gestures can be habitual actions drivers perform during daily driving, such as waving, raising a finger, or opening the palm. The system then selects a first category of gestures from the registered gestures to establish a function mapping relationship. Function mapping associates specific gestures with specific functions of lighting display and control. These functions are typically high-frequency operations performed by the driver when using the lighting system, such as switching display schemes, adjusting brightness, and changing color themes. The system maps the first category of gestures one-to-one with these functions, creating an intuitive and easy-to-remember mapping relationship.

[0094] S207. Select the second type of gesture from the operation gestures and construct a custom mapping relationship.

[0095] The vehicle lighting adjustment system supports user-defined gestures and their association with display schemes. The system filters out a second type of gesture from the recorded gestures, allowing the user to map them to a specified display scheme. Unlike the first type of gesture, the second type does not trigger specific control functions but is used to quickly access a user-preferred display scheme.

[0096] Specifically, users can designate any recorded gesture as a second-type gesture and bind it to a preset display scheme in the mobile application. This makes the gesture exclusively for that display scheme. When the system recognizes the user making the preset gesture, it will directly switch the car's ambient lighting to the bound display scheme, eliminating the need for multiple steps of switching functions.

[0097] S208. Determine the mapping relationship between operation gestures and target display scheme based on function mapping relationship and custom mapping relationship.

[0098] Specifically, when the vehicle's lighting adjustment system detects a driver's gesture, it first determines whether the gesture belongs to the second category of gestures. If so, the current display scheme is directly switched to the target scheme bound to the gesture, and the corresponding control command is executed. If not, the system then determines whether the gesture belongs to the first category of gestures. If so, the gesture mapping control function is triggered, such as switching between previous / next schemes, increasing / decreasing brightness, etc. The system calculates the target display scheme based on the functional requirements and switches the current scheme to the target scheme. If it is neither the first nor the second category, no operation is triggered.

[0099] S209. Based on the mapping relationship and current emotional characteristics, determine the matching rules for the target display scheme and the target display atmosphere.

[0100] Specifically, the vehicle lighting adjustment system determines the target display scheme corresponding to the driver's current input gesture based on the gesture mapping relationship. One gesture may correspond to one or more alternative display schemes. Next, the system analyzes the emotional features inferred from the driver's facial expressions and matches them with the preset emotional features of each alternative display scheme. If the emotional features of a certain display scheme match the driver's current emotional state most closely, the system prioritizes that scheme as the final target display scheme and matches its corresponding display atmosphere parameters.

[0101] In the above embodiments, the vehicle lighting adjustment system can establish a mapping relationship between commonly used driver gestures and display schemes, enabling drivers to directly call preset display schemes and display atmospheres through specific gestures. This combines active control of gesture operation with passive adjustment of emotional characteristics, which simplifies the operation process, improves the system's response speed and ease of use, and makes lighting adjustment during driving more intuitive and convenient.

[0102] S210. Based on the collected facial expressions and gesture changes of the driver, match the target display scheme and target display atmosphere from the display scheme.

[0103] This step is the same as S103, and will not be repeated here.

[0104] S211. Name all display schemes.

[0105] Specifically, the vehicle lighting adjustment system uses a theme + style + serial number approach to generate a unique name for each display scheme. The theme reflects the core content or context the display scheme aims to convey, such as "starry sky," "forest," or "party." The style embodies the visual atmosphere and emotional tone of the display scheme, such as "warm," "dynamic," or "dreamy." The serial number distinguishes different display schemes within the same theme and is typically represented by numbers or letters.

[0106] S212. Match the driver's voice input information with the name, and match the current emotional characteristics with the preset emotional characteristics to determine the target display scheme and target display atmosphere.

[0107] Specifically, when the driver issues a voice command such as "Activate the Starry Sky Dream 2 solution," the vehicle's lighting adjustment system first acquires the audio signal through the onboard microphone array and preprocesses it, performing actions such as noise reduction and echo cancellation. Then, the voice recognition engine transcribes the optimized audio into text, extracting keywords such as "activate" and "Starry Sky Dream 2." The system performs a full-text match against these keywords in a naming index table to find the corresponding target display solution. If no exact match is found, the system can also use fuzzy matching and semantic parsing to intelligently infer the solution the driver is most likely to want to use.

[0108] Meanwhile, the vehicle's lighting adjustment system tracks and analyzes the driver's facial expressions in real time, extracting the emotional features contained within. When a voice command matches a target display scheme, the system calculates the similarity between the scheme's preset emotional features and the driver's current emotional state. If the two sets of features match highly, the system directly calls the scheme's built-in display parameters. If there is a certain deviation (such as exceeding a preset threshold), the system dynamically adjusts the display parameters to generate a display atmosphere that more closely reflects the driver's actual emotions. Taking the "Starry Night Dream 2" scheme as an example, if the system detects that the driver appears slightly tired with downturned lips, it may adjust the scheme's color temperature from a cool blue to a warm purple and reduce the speed of dynamic effects to create a more soothing and relaxing atmosphere.

[0109] In the above embodiments, the vehicle lighting adjustment system enhances the accuracy of display scheme selection and the ease of operation through real-time monitoring by the visual acquisition subsystem and dual verification via voice input. This multimodal interaction method improves the system's user-friendliness and interaction efficiency, enabling drivers to adjust the interior and exterior lighting atmosphere while maintaining driving attention.

[0110] S213. Determine the target lamp group area to be adjusted.

[0111] Specifically, each display scheme specifies a default target light group area when it is generated and invoked. In addition to the default area preset by the scheme, the vehicle lighting adjustment system also allows the driver to manually select or modify the target light group area. The driver can intuitively select the light group area to be illuminated through the visual interface on the in-vehicle central control screen and preview the display effect after selection in real time; there are no restrictions on this.

[0112] S214. Adjust the display color of each LED in the vehicle's light group according to the target light group control command, so that the light group display matches the target display scheme and target display atmosphere.

[0113] This step is the same as S104, and will not be repeated here.

[0114] In the above embodiments, before adjusting the LED light display color, the vehicle lighting adjustment system first determines the target light group area to be adjusted. This refined management improves the accuracy and adaptability of the lighting adjustment. By distinguishing the different needs of the vehicle's internal and external areas, the lighting effect can be controlled more precisely to adapt to different usage scenarios and driving conditions.

[0115] The vehicle lighting adjustment system of this invention is applied to electronic devices. Figure 3 A schematic diagram of the architecture of an electronic device suitable for implementing embodiments of the present invention is shown.

[0116] It should be noted that, Figure 3 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of use of the embodiments of the present invention.

[0117] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by instructions (computer programs), or by instructions (computer programs) controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor. The electronic device of this embodiment includes a storage medium and a processor, wherein the storage medium stores multiple instructions that can be loaded by the processor to execute any step of the method provided in the embodiments of the present invention.

[0118] Specifically, the storage medium and the processor are electrically connected directly or indirectly to enable data transmission or interaction. For example, these components can be electrically connected to each other via one or more signal lines. The storage medium stores computer-executable instructions that implement data access control methods, including at least one software functional module that can be stored in the storage medium in the form of software or firmware. The processor executes various functional applications and data processing by running the software program and module stored in the storage medium. The storage medium can be, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), etc. The storage medium stores the program, and the processor executes the program after receiving the execution instructions.

[0119] Furthermore, the software programs and modules within the aforementioned storage medium may also include an operating system, which may include various software components and / or drivers for managing system tasks (e.g., memory management, storage device control, power management, etc.) and can communicate with various hardware or software components to provide an operating environment for other software components. The processor may be an integrated circuit chip with signal processing capabilities. The aforementioned processor may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc., which can implement or execute the methods, steps, and logic flowcharts disclosed in this embodiment. The general-purpose processor may be a microprocessor or any conventional processor.

[0120] Since the instructions stored in the storage medium can execute the steps in any of the methods provided in the embodiments of the present invention, the beneficial effects of any of the methods provided in the embodiments of the present invention can be achieved, as detailed in the preceding embodiments, and will not be repeated here.

[0121] The above description is merely a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. A driver-passenger interaction-based adaptive lighting adjustment method, applied to a vehicle lighting adjustment system, comprising a visual acquisition subsystem and a lighting group control subsystem, characterized in that, The method includes: The display scheme for the light group is constructed based on the sample images uploaded by the user, and the display atmosphere corresponding to each display scheme is defined. The display scheme and the corresponding display atmosphere uniquely determine a set of light group control instructions. The light group includes multiple densely arranged LED lights, and the sample images are patterns or videos that the user wants to display. The steps of constructing the display scheme for the light group and the display atmosphere corresponding to each display scheme based on the sample images uploaded by the user include: The key visual elements in the sample images are extracted using an image recognition algorithm, including: analyzing the periodic change patterns of pixels in the image and distinguishing different texture regions; the key visual elements include color, shape and theme; when extracting key visual elements, the constraints of the lamp group hardware are considered, and the constraints include at least the color gamut coverage and resolution of a single LED lamp module. Based on the key visual elements, the control instructions for each LED in the light group are determined to obtain the display scheme of the light group, including: based on the color gamut characteristics of the LED, finding the achievable color point on the chromaticity diagram that is closest to the main color tone of the sample image, mapping its RGB value to the LED in the corresponding area; and using the texture information of the sample image to add dynamic effects to the LED. One or more display atmospheres corresponding to the display scheme are determined based on preset emotional characteristics, and the colors corresponding to different display atmospheres are not all the same; The visual acquisition subsystem monitors the driver's facial expressions and gestures in real time, and the visual acquisition subsystem is equipped with at least one computer vision sensing device; Based on the changes in facial expressions and gestures, a target display scheme and target display atmosphere are matched from the display schemes, and the corresponding target light group control command is determined; The display color of each LED in the vehicle's light group is adjusted according to the target light group control command so that the light group display matches the target display scheme and target display atmosphere.

2. The method according to claim 1, characterized in that, Before the step of matching the target display scheme and target display atmosphere from the display schemes based on the facial expressions and gesture changes, and determining the corresponding target light group control command, the method further includes: The driver's commonly used operating gestures are recorded, and a mapping relationship is established between the operating gestures and the target display scheme; The matching rules for the target display scheme and the target display atmosphere are determined based on the mapping relationship and the current emotional features, wherein the current emotional features are determined based on the facial expression.

3. The method according to claim 2, characterized in that, The step of constructing the mapping relationship between the operation gesture and the target display scheme specifically includes: The first type of gestures is selected from the operation gestures to construct a function mapping relationship. The function mapping relationship is used to switch and select the display scheme to obtain the target display scheme. A second type of gesture is selected from the operation gestures to construct a custom mapping relationship, which is used to directly lock the target display scheme; The mapping relationship between the operation gesture and the target display scheme is determined based on the function mapping relationship and the custom mapping relationship.

4. The method according to claim 1, characterized in that, Before the step of constructing the display scheme for the light group based on the sample images uploaded by the user, and the display atmosphere corresponding to each display scheme, the method further includes: Receive newly uploaded sample images and preset emotion features from users; The sample images and preset emotional features are loaded into the local visual acquisition subsystem and light control subsystem using over-the-air download technology.

5. The method according to claim 1, characterized in that, Before the step of adjusting the display color of each LED in the vehicle's headlight assembly according to the target headlight assembly control command to match the headlight assembly display with the target display scheme and target display atmosphere, the method further includes: Determine the target light group area to be adjusted, the target light group area including the vehicle exterior area and the vehicle interior area; The display scheme and display atmosphere of the target light group area are adjusted.

6. A vehicle lighting adjustment system, characterized in that, The vehicle lighting control system includes: one or more processors and a memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the vehicle lighting adjustment system to perform the method as described in any one of claims 1-5.

7. A computer-readable storage medium comprising instructions, characterized in that, When the instruction is executed on the vehicle lighting adjustment system, the vehicle lighting adjustment system performs the method as described in any one of claims 1-5.

8. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are run on the vehicle lighting adjustment system, the vehicle lighting adjustment system performs the method as described in any one of claims 1-5.

Images