Vehicle lighting control methods, devices, vehicles, and storage media

Abstract

This application relates to a vehicle lighting control method, device, vehicle, and storage medium. The method includes: extracting the user's current image emotion features from image data and extracting the user's current voice emotion features from sound data; calculating a first feature offset of the current image emotion features and a second feature offset of the current voice emotion features; if either the first or second feature offset is greater than a preset offset threshold, determining the user's current emotion type based on the image data and sound data, and matching a corresponding lighting control strategy according to the current emotion type, so as to control the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy. This solves the technical problem in related technologies where in-vehicle lighting can only achieve simple dimming and on / off operations, unable to be adjusted according to actual driving conditions and user needs, affecting the user experience and posing certain safety hazards.

Description

Technical Field

[0001] This application relates to the field of vehicle control technology, and in particular to a lighting control method, device, vehicle, and storage medium for a vehicle. Background Technology

[0002] In related technologies, in-vehicle lighting systems have the following problems:

[0003] Lack of intelligence and interactivity: Most current in-vehicle lighting systems can only perform simple dimming and on / off operations, and cannot intelligently adjust the brightness, color, and mode of the lighting based on specific emotions. This makes the lighting systems unable to meet users' needs for intelligence and personalization.

[0004] Insufficient consideration for driving safety: Current in-vehicle lighting systems cannot dynamically adapt and adjust, which may affect the user's focus and comfort, and have a certain impact on driving safety.

[0005] In summary, the relevant technologies for in-vehicle lighting only allow for simple dimming and on / off operations, and cannot be adjusted according to actual driving conditions and user needs, which affects the user experience and poses certain safety hazards, and needs to be improved. Summary of the Invention

[0006] This application provides a vehicle lighting control method, device, vehicle, and storage medium to solve the technical problem in the related art that the interior lighting can only achieve simple dimming and switching operations, and cannot be adjusted according to actual driving conditions, user needs, etc., which affects the user experience and poses certain safety hazards.

[0007] A first aspect of this application provides a vehicle lighting control method, comprising the following steps: acquiring image data and sound data of a user; extracting the user's current image emotion features from the image data and extracting the user's current sound emotion features from the sound data; calculating a first feature offset between the current image emotion features and the image emotion features at the previous moment, and calculating a second feature offset between the current sound emotion features and the sound emotion features at the previous moment; if either the first feature offset or the second feature offset is greater than a preset offset threshold, determining the user's current emotion type based on the image data and the sound data, and matching a corresponding lighting control strategy according to the current emotion type, so as to control the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy.

[0008] Optionally, in one embodiment of this application, the method further includes: accumulating the duration of the lighting control strategy currently used by the vehicle; if the duration is longer than a preset duration, determining the user's current emotion type based on the image data and the sound data, and determining whether the theoretical lighting control strategy corresponding to the current emotion type is consistent with the lighting control strategy currently used by the vehicle; if the theoretical lighting control strategy corresponding to the current emotion type is inconsistent with the lighting control strategy currently used by the vehicle, controlling the vehicle's lighting system to perform corresponding lighting control actions using the theoretical lighting control strategy; otherwise, continuing to execute the lighting control strategy currently used by the vehicle.

[0009] Optionally, in one embodiment of this application, if the first feature offset or the second feature offset is greater than a preset offset threshold, the method further includes: obtaining weather information of the current location of the vehicle; combining the weather information, the external environmental parameters of the vehicle, and the internal environmental parameters of the vehicle, determining whether the current image emotion feature and / or the current sound emotion feature meets a preset environmental emotion change condition; if the preset environmental emotion change condition is met, determining the vehicle's environmental adjustment strategy based on the weather information, the external environmental parameters, and the internal environmental parameters, and correcting the lighting control strategy according to the environmental condition strategy, so as to control the vehicle to perform corresponding environmental adjustment actions and lighting actions based on the environmental adjustment strategy and the corrected lighting control strategy.

[0010] Optionally, in one embodiment of this application, after controlling the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy, the method further includes: receiving a user's lighting parameter modification instruction; responding to the lighting parameter modification instruction control and replacing the lighting parameters in the lighting control strategy with the modified lighting parameters.

[0011] Optionally, in one embodiment of this application, after acquiring the user's image data and sound data, the method further includes: determining the user's identity based on the image data and sound data; determining whether the user is a user with preset permissions based on the identity; if the user is the user with preset permissions, extracting the current image emotion features and the current sound emotion features; otherwise, pushing a permission authentication command to a preset terminal, and setting the user as a temporary user or prohibiting the execution of the lighting control strategy based on the response result of the preset terminal.

[0012] A second aspect of this application provides a vehicle lighting control device, comprising: a first acquisition module for acquiring image data and sound data of a user; an extraction module for extracting current image emotion features of the user from the image data and current sound emotion features of the user from the sound data; a calculation module for calculating a first feature offset between the current image emotion features and the image emotion features at the previous moment, and calculating a second feature offset between the current sound emotion features and the sound emotion features at the previous moment; and a first control module for determining the current emotion type of the user based on the image data and the sound data when either the first feature offset or the second feature offset is greater than a preset offset threshold, and matching a corresponding lighting control strategy according to the current emotion type, so as to control the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy.

[0013] Optionally, in one embodiment of this application, it further includes: an accumulation module, used to accumulate the duration of the lighting control strategy currently used by the vehicle; a first judgment module, used to determine the current emotion type of the user based on the image data and the sound data when the duration is greater than a preset duration, and to determine whether the theoretical lighting control strategy corresponding to the current emotion type is consistent with the lighting control strategy currently used by the vehicle; and a second control module, used to control the lighting system of the vehicle to perform corresponding lighting control actions using the theoretical lighting control strategy when the theoretical lighting control strategy corresponding to the current emotion type is inconsistent with the lighting control strategy currently used by the vehicle; otherwise, to continue executing the lighting control strategy currently used by the vehicle.

[0014] Optionally, in one embodiment of this application, it further includes: a second acquisition module, used to acquire weather information of the current location of the vehicle; a second judgment module, used to combine the weather information, the external environmental parameters of the vehicle, and the internal environmental parameters of the vehicle to determine whether the current image emotion features and / or the current sound emotion features meet preset environmental emotion change conditions; and a third control module, used to determine the environmental adjustment strategy of the vehicle based on the weather information, the external environmental parameters, and the internal environmental parameters when the preset environmental emotion change conditions are met, and to modify the lighting control strategy according to the environmental condition strategy, so as to control the vehicle to perform corresponding environmental adjustment actions and lighting actions based on the environmental adjustment strategy and the modified lighting control strategy.

[0015] Optionally, in one embodiment of this application, it further includes: a receiving module, configured to receive a user's lighting parameter modification instruction; and a modification module, configured to respond to the lighting parameter modification instruction control and replace the lighting parameters in the lighting control strategy with the modified lighting parameters.

[0016] Optionally, in one embodiment of this application, it further includes: an identification module, configured to determine the user's identity based on the image data and the sound data; a determination module, configured to determine whether the user is a user with preset permissions based on the identity; and a fourth control module, configured to extract the current image emotion features and the current sound emotion features if the user is the user with preset permissions, otherwise, push a permission authentication command to a preset terminal, and set the user as a temporary user with permissions or prohibit the execution of the lighting control strategy based on the response result of the preset terminal.

[0017] A third aspect of this application provides a vehicle, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the vehicle lighting control method as described in the above embodiments.

[0018] A fourth aspect of this application provides a computer-readable storage medium storing computer instructions for causing the computer to perform the vehicle lighting control method as described in the above embodiments.

[0019] A fifth aspect of this application provides a computer program product, including a computer program that, when executed, implements the above-described vehicle lighting control method.

[0020] This application embodiment can extract the user's current image emotion features from image data and the user's current voice emotion features from sound data, and determine the feature offset of these two emotion features compared to the previous moment. This allows for a determination of whether the current lighting control strategy needs to be changed. If a change is needed, the user's current emotion type is determined based on the image and sound data, and a corresponding lighting control strategy is matched according to the current emotion type. This allows the vehicle's lighting system to execute corresponding lighting control actions, enabling the vehicle's lighting system to automatically adjust according to the user's emotional changes, thereby improving the user's mood and driving experience, reducing driver fatigue, and enhancing driving safety. This solves the technical problem in related technologies where in-vehicle lighting can only achieve simple dimming and on / off operations, unable to adjust according to actual driving conditions and user needs, affecting the user experience and posing certain safety hazards.

[0021] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0022] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0023] Figure 1 This is a flowchart of a vehicle lighting control method according to an embodiment of this application;

[0024] Figure 2 This is a schematic diagram illustrating the principle of a vehicle lighting control method according to an embodiment of this application;

[0025] Figure 3 This is a flowchart of a vehicle lighting control method according to an embodiment of this application;

[0026] Figure 4 This is a schematic diagram of the structure of a vehicle lighting control device according to an embodiment of this application;

[0027] Figure 5 This is a structural schematic diagram of a vehicle provided according to an embodiment of this application. Detailed Implementation

[0028] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0029] The following description, with reference to the accompanying drawings, describes a vehicle lighting control method, device, vehicle, and storage medium according to embodiments of this application. Addressing the technical problems mentioned in the background art, where in-vehicle lighting can only achieve simple dimming and on / off operations, unable to be adjusted according to actual driving conditions and user needs, thus affecting user experience and posing certain safety hazards, this application provides a vehicle lighting control method. In this method, the user's current image emotional features are extracted from image data, and the user's current voice emotional features are extracted from sound data. The feature offsets of these two emotional features compared to the previous moment are determined, thereby determining whether the current lighting control strategy needs to be changed. If a change is needed, the user's current emotional type is determined based on the image and sound data, and a corresponding lighting control strategy is matched according to the current emotional type. This allows the vehicle's lighting system to execute corresponding lighting control actions, enabling the vehicle's lighting system to automatically adjust according to changes in the user's emotions, thereby improving the user's mood and driving experience, reducing driving fatigue, and enhancing driving safety. This solves the technical problem in related technologies where in-vehicle lighting can only achieve simple dimming and on / off operations, and cannot be adjusted according to actual driving conditions and user needs, thus affecting the user experience and posing certain safety hazards.

[0030] Specifically, Figure 1 This is a schematic flowchart of a vehicle lighting control method provided in an embodiment of this application.

[0031] like Figure 1 As shown, the lighting control method for this vehicle includes the following steps:

[0032] In step S101, the user's image data and audio data are acquired.

[0033] In actual implementation, embodiments of this application can utilize in-vehicle devices, such as vehicle cameras and vehicle speakers, to acquire user image and sound data.

[0034] Optionally, in one embodiment of this application, after obtaining the user's image data and sound data, the method further includes: determining the user's identity based on the image data and sound data; determining whether the user is a user with preset permissions based on the identity; if the user is a user with preset permissions, extracting the current image emotion features and the current sound emotion features; otherwise, pushing a permission authentication command to a preset terminal, and setting the user as a temporary user or prohibiting the execution of lighting control policies based on the response result of the preset terminal.

[0035] In some embodiments, the present application embodiments can determine the user's identity based on facial features in image data and voiceprint features in sound data, i.e., whether it matches the facial features and voiceprint features in pre-stored identity data, thereby determining whether the user is an authorized user.

[0036] If the user is a qualified user, subsequent emotion recognition can be performed, and the interior lighting can be adjusted.

[0037] If the user is not an authorized user, an authorization authentication command can be pushed to the terminal associated with the vehicle, such as the owner's mobile terminal or the vehicle manufacturer's terminal associated with the vehicle before it officially rolled off the production line. Based on the terminal's response, if the response is "agree to this authorization authentication," temporary authorization is granted to the user; if the response is "disagree to this authorization authentication," subsequent lighting adjustments to the vehicle are prohibited.

[0038] In step S102, the user's current image emotion features are extracted from the image data, and the user's current voice emotion features are extracted from the sound data.

[0039] As one possible approach, embodiments of this application can extract the user's current image emotion features from image data, such as extracting facial emotion features from facial features, extracting emotion features from user actions, and determining the user's current image emotion features through comprehensive analysis, such as big data analogy.

[0040] Similarly, embodiments of this application can extract the user's current voice emotion features from the sound data, such as extracting the user's voice waveform, sound frequency, volume, emotional keywords, and other emotional features, thereby obtaining the user's current voice emotion features.

[0041] In step S103, the first feature offset between the current image emotion feature and the image emotion feature at the previous moment is calculated, and the second feature offset between the current voice emotion feature and the voice emotion feature at the previous moment is calculated.

[0042] Furthermore, embodiments of this application can determine whether a user's emotions have changed based on the offset of image emotion features and the offset of sound emotion features, and then adjust the lighting control strategy after the emotion changes.

[0043] In step S104, if the first feature offset or the second feature offset is greater than a preset offset threshold, the user's current emotion type is determined based on the image data and sound data, and the corresponding lighting control strategy is matched according to the current emotion type, so as to use the lighting control strategy to control the vehicle's lighting system to perform the corresponding lighting control action.

[0044] If either the offset of the image emotion feature or the offset of the sound emotion feature exceeds a certain threshold, the embodiments of this application can determine that the user's emotion has changed, thereby determining the user's current emotion type based on the image data and sound data, and then matching the corresponding lighting control strategy based on the current emotion type.

[0045] For example, when the current emotion type is excitement or agitation, the lighting control strategy of this application embodiment can be to adjust the overall lighting tone of the vehicle interior to a cool tone; when the current emotion type is sadness or frustration, the lighting control strategy of this application embodiment can be to adjust the overall lighting tone of the vehicle interior to a warm tone.

[0046] The preset offset threshold can be set by those skilled in the art according to the actual situation, and no specific restrictions are imposed here.

[0047] Optionally, in one embodiment of this application, the method further includes: accumulating the duration of the lighting control strategy currently used by the vehicle; if the duration is longer than a preset duration, determining the user's current emotion type based on image data and sound data, and determining whether the theoretical lighting control strategy corresponding to the current emotion type is consistent with the lighting control strategy currently used by the vehicle; if the theoretical lighting control strategy corresponding to the current emotion type is inconsistent with the lighting control strategy currently used by the vehicle, then using the theoretical lighting control strategy to control the vehicle's lighting system to perform corresponding lighting control actions; otherwise, continuing to execute the lighting control strategy currently used by the vehicle.

[0048] It is understandable that a user's emotions may not be sudden changes. When a user's emotions are changing slowly, such as when fatigue gradually deepens, it is difficult to accurately identify the change in the user's emotions by comparing the amount of change with the emotional characteristics of the previous moment.

[0049] Therefore, the embodiments of this application can accumulate the duration of the currently used lighting control strategy, so that when the duration exceeds a certain value, the user's emotions are reviewed based on the user's image data and sound data. If the review results are consistent, the currently used lighting control strategy is continued to be used. If the review results are inconsistent, the lighting control strategy is adjusted so that the interior lighting can always match the user's emotional changes.

[0050] Optionally, in one embodiment of this application, if the first feature offset or the second feature offset is greater than a preset offset threshold, the method further includes: obtaining weather information of the current location of the vehicle; combining the weather information, the vehicle's external environmental parameters, and the vehicle's internal environmental parameters to determine whether the current image emotion features and / or the current sound emotion features meet preset environmental emotion change conditions; if the preset environmental emotion change conditions are met, then determining the vehicle's environmental adjustment strategy based on the weather information, external environmental parameters, and internal environmental parameters, and correcting the lighting control strategy according to the environmental condition strategy, so as to control the vehicle to perform corresponding environmental adjustment actions and lighting actions based on the environmental adjustment strategy and the corrected lighting control strategy.

[0051] In practice, changes in a user's emotional characteristics may be related to the environment. For example, when the environment is cold, the identified emotions may be tension or other emotions affected by the temperature; when the environment is hot, the identified emotions may be anxiety or other emotions affected by the temperature. In this case, simply adjusting the interior lighting of the vehicle cannot regulate the user's emotions.

[0052] Therefore, embodiments of this application can combine weather information, external environmental parameters of the vehicle, and internal environmental parameters of the vehicle to determine whether the weather has affected the user's emotions. For example, if the weather information indicates rainy weather, this may cause the user to feel drowsy, sad, or have other emotions. In this case, if the identified emotional characteristics match the emotional characteristics caused by rainy weather, it can be determined that the preset environmental emotional change conditions are met. Similarly, if both the outside and inside temperatures of the vehicle are low, and the user is identified to be shivering or having facial tremors based on image data, and to have a trembling voice based on sound data, it can be determined that the preset environmental emotional change conditions are met.

[0053] This application embodiment can determine the vehicle's environmental adjustment strategy, such as starting the vehicle's air conditioning or adjusting the vehicle's internal and external air circulation, when the preset environmental mood change conditions are met, in order to improve the user's current driving conditions and correct the currently used lighting control strategy so that the lighting control strategy matches the environmental adjustment strategy, thereby achieving the purpose of quickly adjusting the user's mood.

[0054] For example, when the environmental control strategy is to turn on the air conditioner for heating, the overall light color tone in the lighting control strategy can be changed to a warm color tone to provide warmth to users both physically and visually, thereby improving their comfort.

[0055] It should be noted that the preset environmental emotional change conditions can be set by those skilled in the art according to the actual situation, and no specific restrictions are imposed here.

[0056] Optionally, in one embodiment of this application, after controlling the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy, the method further includes: receiving a user's lighting parameter modification instruction; responding to the lighting parameter modification instruction control and replacing the lighting parameters in the lighting control strategy with the modified lighting parameters.

[0057] As one possible implementation, embodiments of this application can also accept user commands to modify lighting parameters, thereby adjusting the lighting control strategy according to user-defined parameters to make the lighting control strategy more in line with user needs.

[0058] Combination Figure 2 and Figure 3 As shown, the working principle of the vehicle lighting control method of this application embodiment will be described in detail with reference to one embodiment.

[0059] like Figure 2 As shown, the embodiments of this application can be implemented using the following structure in actual execution. This structure may include: an emotion perception module A, a camera A1, a microphone A2, an AI server A3, an emotion analysis module B, an AIClient (AI library) B1, a database B2, a lighting control module C, and an in-vehicle intelligent system D.

[0060] Specifically, the emotion perception module A can capture the facial expressions of users inside the vehicle through camera A1 and identify their emotional state in real time using image processing technology. Technically, this includes facial detection, expression recognition, and emotion classification, using algorithms such as deep learning to automatically identify and analyze the user's facial emotions. It also captures the user's voice through microphone A2 and uses sound processing technology to determine the user's tone and emotional state. Technically, this includes speech recognition, emotion analysis, and speech synthesis, using acoustic models and semantic analysis to automatically identify and classify the user's voice.

[0061] Among them, sensor data acquisition: The emotion perception module A collects data on the in-vehicle environment through multiple sensors installed in the vehicle, such as camera A1 and microphone A2. Camera A1 is used to capture the facial expressions of passengers in the vehicle, and microphone A2 is used to record the sound inside the vehicle.

[0062] Data preprocessing: The collected sensor data needs to be preprocessed to extract useful features and reduce interference. Facial emotion recognition requires preprocessing steps such as face detection, image enhancement, and feature extraction, while voice recognition requires background noise removal and speech feature extraction.

[0063] Data transmission: After preprocessing, the emotion perception module A sends the collected data to the emotion analysis module B. Data transmission can be performed via internal bus or wireless communication to ensure compatibility with vehicle infotainment systems with different processing capabilities.

[0064] The emotion analysis module B, used in comprehensive analysis technology, considers facial expression features such as eye wrinkles, upturned or downturned corners of the mouth, as well as the intensity and duration of the expression. By using image processing and computer vision techniques, these facial features are extracted and analyzed, and compared and matched with known emotion patterns to infer the user's possible emotional state. In terms of vocal emotion recognition, the comprehensive emotion analysis technology focuses on features such as vocal frequency, pitch, speech rate, and emotional tone. By using speech signal processing and machine learning techniques, these vocal features can be extracted and analyzed, and compared and matched with known emotion patterns to determine the user's current emotional state. The key to comprehensive emotion analysis technology lies in integrating and combining information from facial and vocal emotions. This application embodiment can weight and combine the results of the two emotion recognition methods to obtain more accurate and reliable emotion analysis results.

[0065] Among them, facial emotion analysis: The emotion analysis module B uses facial emotion recognition algorithms and models to analyze the collected facial expression data. This includes steps such as facial feature extraction, expression classification, and emotion state judgment to determine the current user's emotional state, such as happiness, fatigue, anxiety, etc.

[0066] Voice Emotion Analysis: The emotion analysis module B utilizes voice recognition algorithms and models to analyze the collected voice data. This involves technologies such as speech feature extraction, speech emotion classification, and tone judgment to identify the user's tone and emotional state, such as happiness, anger, or frustration.

[0067] Comprehensive Emotion Analysis: Module B integrates the results of facial and vocal emotion analysis to arrive at a comprehensive assessment of the user's current emotion. This involves weighting various data points, using a rule engine, and employing machine learning algorithms to consider multiple emotional factors and generate the final emotion analysis result.

[0068] The lighting control module C is used to intelligently adjust the brightness, color, and mode of the in-vehicle lighting system based on the output of the emotion perception module A, including the control of various lighting devices such as incandescent lamps, LED lamps, and ambient lights, in order to enhance the user's mood and comfort.

[0069] Among these features, lighting parameter adjustment: Based on the emotion analysis results, the lighting control module C can adjust parameters such as brightness, color, and mode of the vehicle's interior lighting system. For example, when a user's mood is detected to be low, the lighting brightness can be increased and a soft, warm color tone can be selected to improve the user's mood.

[0070] Lighting control: Lighting control translates received instructions into specific operating signals, controlling the on / off status and operating mode of various lighting modules inside the vehicle. This may involve the control of various lighting devices such as incandescent lamps, LED lights, and ambient lighting.

[0071] Real-time Response: The lighting control module C can respond in real time to changes in the emotion analysis results and dynamically adjust based on the continuously updated emotion analysis results from the emotion analysis module B. This ensures that the in-vehicle lighting system can adapt to changes in the user's emotions in a timely manner, providing a more comfortable and pleasant lighting effect.

[0072] like Figure 3 As shown, when the in-vehicle lighting system uses emotion-sensing technology, the overall control process can be divided into the following steps:

[0073] Step S1: Facial emotion recognition.

[0074] First, the facial expressions of users inside the vehicle are monitored in real time using devices such as camera A1. Facial emotion recognition is performed on the monitored video images, and image processing technology is used to identify the user's emotional state. This process involves steps such as facial detection, feature extraction, and expression classification, and finally, the pre-processed data is sent to the emotion analysis module B.

[0075] Step S2: Voice emotion recognition.

[0076] Meanwhile, the in-vehicle microphone A2 captures the user's voice. Speech recognition and emotion analysis technologies are used to identify the user's tone and emotional state. This includes processing steps such as speech recognition, feature extraction, and NLP (Natural Language Processing).

[0077] Step S3: Comprehensive Emotional Analysis.

[0078] At this point, the emotion data generated from facial emotion recognition and voice recognition will be integrated and comprehensively analyzed to determine the user's emotional state. This comprehensive analysis utilizes a series of algorithms and models, including feature selection, emotion classification, and emotion recognition, considering the consistency and weight of facial and vocal emotions to identify the user's emotions and categorize them into corresponding emotion types, such as happiness, sadness, and anger, thus generating the final emotion analysis result.

[0079] Step S4: Lighting control.

[0080] Based on the final analysis results of the comprehensive user emotion analysis, the lighting control module C can adjust the brightness, color, and mode of the vehicle's interior lighting system. For example, for a user in a pleasant mood, the system can use soft and bright light to enhance comfort; while for a user who is tired or anxious, it may use soft and dim light to soothe their emotions.

[0081] In summary, the embodiments of this application can recognize users' facial and vocal emotions in real time, enabling a more accurate grasp of their emotional state and thus more precise control of the in-vehicle lighting system, improving user comfort and driving safety. The facial and vocal emotion recognition technologies employed in these embodiments can perform emotion perception and lighting control without interfering with the user. The intelligent lighting control technology used in these embodiments can adjust the in-vehicle lighting in real time according to the user's emotional state, enhancing the user's mood and driving experience and reducing driving fatigue. Based on a microservice architecture, these embodiments can flexibly match in-vehicle hosts with different computing capabilities. When the host's computing power is weak, the analysis module can be cloudified, resulting in a highly versatile system.

[0082] The embodiments of this application can bring great potential and competitive advantage to the future automotive industry and other context-aware lighting systems, improve driving comfort and safety levels, and enhance the overall user experience.

[0083] The vehicle lighting control method proposed in this application extracts the user's current image emotion features from image data and the user's current voice emotion features from sound data. It then determines the feature offset of these two emotion features compared to the previous moment, thereby determining whether the current lighting control strategy needs to be changed. If a change is needed, it determines the user's current emotion type based on the image and sound data, matches the corresponding lighting control strategy according to the current emotion type, and uses the lighting control strategy to control the vehicle's lighting system to perform corresponding lighting control actions. This allows the vehicle's lighting system to automatically adjust according to the user's emotional changes, thereby improving the user's mood and driving experience, reducing driver fatigue, and enhancing driving safety. This solves the technical problem in related technologies where in-vehicle lighting can only achieve simple dimming and on / off operations, unable to adjust according to actual driving conditions and user needs, affecting the user experience and posing certain safety hazards.

[0084] Next, with reference to the accompanying drawings, a vehicle lighting control device according to an embodiment of this application is described.

[0085] Figure 4 This is a block diagram of a vehicle lighting control device according to an embodiment of this application.

[0086] like Figure 4As shown, the vehicle's lighting control device 10 includes: a first acquisition module 100, an extraction module 200, a calculation module 300, and a first control module 400.

[0087] Specifically, the first acquisition module 100 is used to acquire the user's image data and sound data.

[0088] The extraction module 200 is used to extract the user's current image emotion features from image data and the user's current voice emotion features from sound data.

[0089] The calculation module 300 is used to calculate the first feature offset between the current image emotion feature and the image emotion feature at the previous moment, and to calculate the second feature offset between the current sound emotion feature and the sound emotion feature at the previous moment.

[0090] The first control module 400 is used to determine the user's current emotion type based on image data and sound data when the first feature offset or the second feature offset is greater than a preset offset threshold, and to match the corresponding lighting control strategy according to the current emotion type, so as to control the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy.

[0091] Optionally, in one embodiment of this application, the vehicle lighting control device 10 further includes: an accumulation module, a first judgment module, and a second control module.

[0092] The cumulative module is used to accumulate the duration of the lighting control strategy currently used by the vehicle.

[0093] The first judgment module is used to determine the user's current emotion type based on image data and sound data when the duration exceeds the preset duration, and to determine whether the theoretical lighting control strategy corresponding to the current emotion type is consistent with the lighting control strategy currently used by the vehicle.

[0094] The second control module is used to control the vehicle's lighting system to perform corresponding lighting control actions when the theoretical lighting control strategy corresponding to the current mood type is inconsistent with the vehicle's current lighting control strategy; otherwise, it continues to execute the vehicle's current lighting control strategy.

[0095] Optionally, in one embodiment of this application, the vehicle lighting control device 10 further includes: a second acquisition module, a second judgment module, and a third control module.

[0096] The second acquisition module is used to acquire weather information of the current location of the vehicle.

[0097] The second judgment module is used to combine weather information, vehicle external environmental parameters and vehicle internal environmental parameters to determine whether the current image emotion characteristics and / or current sound emotion characteristics meet the preset environmental emotion change conditions.

[0098] The third control module is used to determine the vehicle's environmental adjustment strategy based on weather information, external environmental parameters, and internal environmental parameters when the preset environmental mood change conditions are met, and to modify the lighting control strategy according to the environmental condition strategy, so as to control the vehicle to perform corresponding environmental adjustment actions and lighting actions based on the environmental adjustment strategy and the modified lighting control strategy.

[0099] Optionally, in one embodiment of this application, the vehicle lighting control device 10 further includes a receiving module and a modification module.

[0100] The receiving module is used to receive user commands to modify lighting parameters.

[0101] The modification module is used to respond to lighting parameter modification commands and replace the lighting parameters in the lighting control strategy with the modified lighting parameters.

[0102] Optionally, in one embodiment of this application, the vehicle lighting control device 10 further includes: an identification module, a determination module, and a fourth control module.

[0103] The identification module is used to determine the user's identity based on image and sound data.

[0104] The determination module is used to determine whether a user has preset permissions based on their identity identifier.

[0105] The fourth control module is used to extract the current image emotion features and the current sound emotion features when the user is a user with preset permissions; otherwise, it pushes a permission authentication command to a preset terminal and, based on the response of the preset terminal, sets the user as a temporary user or prohibits the execution of lighting control policies.

[0106] It should be noted that the foregoing explanation of the vehicle lighting control method embodiment also applies to the vehicle lighting control device of this embodiment, and will not be repeated here.

[0107] The vehicle lighting control device proposed in this application can extract the user's current image emotion features from image data and the user's current voice emotion features from sound data. It determines the feature offset of these two emotion features compared to the previous moment, thereby determining whether the current lighting control strategy needs to be changed. If a change is needed, it determines the user's current emotion type based on the image and sound data, matches the corresponding lighting control strategy according to the current emotion type, and uses the lighting control strategy to control the vehicle's lighting system to perform corresponding lighting control actions. This allows the vehicle's lighting system to automatically adjust according to the user's emotional changes, thereby improving the user's mood and driving experience, reducing driver fatigue, and enhancing driving safety. This solves the technical problem in related technologies where in-vehicle lighting can only achieve simple dimming and on / off operations, unable to adjust according to actual driving conditions and user needs, affecting the user experience and posing certain safety hazards.

[0108] Figure 5 A schematic diagram of the structure of a vehicle provided in an embodiment of this application. The vehicle may include:

[0109] The memory 501, the processor 502, and the computer program stored on the memory 501 and capable of running on the processor 502.

[0110] When the processor 502 executes the program, it implements the vehicle lighting control method provided in the above embodiments.

[0111] Furthermore, the vehicle also includes:

[0112] Communication interface 503 is used for communication between memory 501 and processor 502.

[0113] The memory 501 is used to store computer programs that can run on the processor 502.

[0114] The memory 501 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.

[0115] If the memory 501, processor 502, and communication interface 503 are implemented independently, then the communication interface 503, memory 501, and processor 502 can be interconnected via a bus to complete communication between them. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of representation, Figure 5 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0116] Optionally, in a specific implementation, if the memory 501, processor 502, and communication interface 503 are integrated on a single chip, then the memory 501, processor 502, and communication interface 503 can communicate with each other through an internal interface.

[0117] Processor 502 may be a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application.

[0118] This embodiment also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-described vehicle lighting control method.

[0119] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the vehicle lighting control method provided in this embodiment of the invention.

[0120] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0121] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0122] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or N executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0123] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0124] It should be understood that the various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0125] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0126] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0127] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A method for controlling vehicle lighting, characterized in that, Includes the following steps: Acquire user's image and audio data; Extract the user's current image emotion features from the image data, and extract the user's current voice emotion features from the sound data; Calculate the first feature offset between the current image emotion feature and the image emotion feature at the previous moment, and calculate the second feature offset between the current voice emotion feature and the voice emotion feature at the previous moment; If either the first feature offset or the second feature offset is greater than a preset offset threshold, the user's current emotion type is determined based on the image data and the sound data. A corresponding lighting control strategy is then matched according to the current emotion type, so as to control the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy.

2. The method according to claim 1, characterized in that, Also includes: The duration of the current lighting control strategy used by the vehicle is accumulated; If the duration exceeds the preset duration, the user's current emotion type is determined based on the image data and the sound data, and it is determined whether the theoretical lighting control strategy corresponding to the current emotion type is consistent with the lighting control strategy currently used by the vehicle. If the theoretical lighting control strategy corresponding to the current mood type is inconsistent with the lighting control strategy currently used by the vehicle, the theoretical lighting control strategy is used to control the vehicle's lighting system to perform the corresponding lighting control action; otherwise, the current lighting control strategy currently used by the vehicle continues to be executed.

3. The method according to claim 1, characterized in that, If either the first feature offset or the second feature offset is greater than a preset offset threshold, the method further includes: Obtain the weather information of the current location of the vehicle; By combining the weather information, the vehicle's external environmental parameters, and the vehicle's internal environmental parameters, it is determined whether the current image emotion features and / or the current sound emotion features meet preset environmental emotion change conditions. If the preset environmental mood change conditions are met, the vehicle's environmental adjustment strategy is determined based on the weather information, the external environmental parameters, and the internal environmental parameters. The lighting control strategy is then modified according to the environmental adjustment strategy, so that the vehicle can perform corresponding environmental adjustment and lighting actions based on the environmental adjustment strategy and the modified lighting control strategy.

4. The method according to claim 1, characterized in that, After controlling the vehicle's lighting system to perform corresponding lighting control actions using the aforementioned lighting control strategy, the method further includes: Receive user commands to modify lighting parameters; The system responds to the lighting parameter modification command and replaces the lighting parameters in the lighting control strategy with the modified lighting parameters.

5. The method according to claim 1, characterized in that, After acquiring the user's image and audio data, the process also includes: Based on the image data and the sound data, the user's identity is determined; Based on the identity identifier, determine whether the user is a user with preset permissions; If the user is a user with preset permissions, then the current image emotion features and the current sound emotion features are extracted; otherwise, a permission authentication command is pushed to a preset terminal, and based on the response result of the preset terminal, the user is set as a temporary permission user or the execution of the lighting control strategy is prohibited.

6. A vehicle lighting control device, characterized in that, include: The first acquisition module is used to acquire the user's image and audio data; The extraction module is used to extract the user's current image emotion features from the image data and the user's current voice emotion features from the sound data; The calculation module is used to calculate the first feature offset between the current image emotion feature and the image emotion feature at the previous moment, and to calculate the second feature offset between the current voice emotion feature and the voice emotion feature at the previous moment. The first control module is configured to determine the user's current emotion type based on the image data and the sound data when the first feature offset or the second feature offset is greater than a preset offset threshold, and to match a corresponding lighting control strategy according to the current emotion type, so as to control the vehicle's lighting system to perform corresponding lighting control actions using the lighting control strategy.

7. The apparatus according to claim 6, characterized in that, Also includes: The accumulation module is used to accumulate the duration of the lighting control strategy currently used by the vehicle; The first judgment module is used to determine the current emotion type of the user based on the image data and the sound data when the duration exceeds the preset duration, and to determine whether the theoretical lighting control strategy corresponding to the current emotion type is consistent with the lighting control strategy currently used by the vehicle. The second control module is used to control the vehicle's lighting system to perform corresponding lighting control actions using the theoretical lighting control strategy when the theoretical lighting control strategy corresponding to the current mood type is inconsistent with the vehicle's currently used lighting control strategy; otherwise, it continues to execute the vehicle's currently used lighting control strategy.

8. The apparatus according to claim 6, characterized in that, Also includes: The second acquisition module is used to acquire the weather information of the current location of the vehicle; The second judgment module is used to combine the weather information, the vehicle's external environmental parameters and the vehicle's internal environmental parameters to determine whether the current image emotion features and / or the current sound emotion features meet the preset environmental emotion change conditions. The third control module is used to determine the vehicle's environmental adjustment strategy based on the weather information, the external environmental parameters, and the internal environmental parameters when the preset environmental mood change conditions are met, and to modify the lighting control strategy according to the environmental adjustment strategy, so as to control the vehicle to perform corresponding environmental adjustment actions and lighting actions based on the environmental adjustment strategy and the modified lighting control strategy.

9. A vehicle, characterized in that, include: A memory, a processor, and a computer program stored in the memory and executable on the processor, the processor executing the program to implement the lighting control method for a vehicle as described in any one of claims 1-5.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, The program is executed by the processor to implement the vehicle lighting control method as described in any one of claims 1-5.

Images