A method, system, medium and product for automatic control of vehicle-mounted lamps

Abstract

A method, system, medium and product for automatic control of vehicle-mounted lamps, relating to the field of machine learning. The method comprises: obtaining a user control instruction table of the current main driving user; when the control instruction of the current main driving user is monitored, determining the instruction content corresponding to the control instruction; in the case that the target vehicle-mounted lamp corresponding to the instruction content fails, determining the target fault level of the target vehicle-mounted lamp; according to the target fault level, determining the brightness range of the target vehicle-mounted lamp; obtaining one or more simulation control schemes and their corresponding lighting effect similarities through a vehicle simulation model; in the case that the lighting effect similarity of the simulation control scheme is higher than a preset similarity threshold, selecting the simulation control scheme with the highest lighting effect similarity as a replacement control scheme; and sending a replacement control instruction to the vehicle-mounted lamp. The implementation of the technical solution provided by the present application reduces the impact of vehicle-mounted lamp failures on lighting effects.

Description

Technical Field

[0001] The present application relates to the field of G06F30 / 27 machine learning, and in particular to a method, system, medium and product for automatic control of vehicle-mounted lamps. Background Art

[0002] With the rapid development of the automobile industry and the increasing demand for automobile safety and comfort, the functions and intelligence of vehicle lamps are increasingly attracting attention. At the same time, the rapid progress of automation technology and sensor technology provides technical support for the intelligent control of vehicle lamps.

[0003] At present, users can directly control the vehicle lamps automatically through fixed voice control commands or gesture control commands, which improves the efficiency and convenience of controlling the vehicle lamps to a certain extent.

[0004] However, when a vehicle lamp fails while the vehicle is driving, even though the vehicle lamp receives the user's voice control commands or gesture control commands and performs corresponding operations, the lighting effect of the vehicle lamp cannot achieve the expected lighting effect, thereby affecting the user's field of vision and increasing the risk of traffic accidents. Summary of the invention

[0005] The present application provides a method, system, medium and product for automatically controlling a vehicle lamp, which are used to reduce the impact of a vehicle lamp failure on the lighting effect.

[0006] In a first aspect, the present application provides a method for automatic control of vehicle-mounted lamps, the method comprising: obtaining a user control instruction table of the current main driver user; the user control instruction table comprises user control instructions and their corresponding instruction contents; the user control instructions are used to control the vehicle-mounted lamps; when a first user control instruction of the current main driver user is monitored, based on the user control instruction table, determining a first instruction content corresponding to the first control instruction; in the event that a target vehicle-mounted lamp corresponding to the first instruction content fails, determining a target fault level of the target vehicle-mounted lamp; the target vehicle-mounted lamp is at least one of the vehicle-mounted lamps, and the target fault level comprises level one and level two, level one indicates that the lamp cannot light up at all, and level two indicates that it can light up but the brightness is not enough to reach the level of the first lamp. the brightness in the instruction content; according to the target fault level, determining the brightness range of the target vehicle lamp; inputting the first control instruction content, the target vehicle lamp and the brightness range of the target vehicle lamp into the vehicle simulation model to obtain one or more simulated control schemes and their corresponding lighting effect similarities; the vehicle simulation model can simulate the lighting effects of different control schemes of the vehicle in a real environment, and calculate the similarity between the simulated lighting effect and the lighting effect of the first control instruction content; in the case that the lighting effect similarity of the simulated control scheme is higher than the preset similarity threshold, selecting the simulated control scheme with the highest lighting effect similarity as the replacement control scheme; according to the replacement control scheme, sending the replacement control instruction to the vehicle lamp.

[0007] By adopting the above technical solution, the vehicle-mounted lamps are automatically adjusted by monitoring the voice commands or gesture commands issued by the user, thereby improving the level of automated control and the convenience of use of the vehicle-mounted lamps. When a fault in the vehicle-mounted lamp in the user control command is detected, a replacement control scheme can be obtained through the vehicle simulation model. The vehicle-mounted lamps are controlled according to the replacement control scheme, so that the lighting effect of the vehicle-mounted lamps can be as consistent as possible with the lighting effect expected by the user, reducing the impact of the fault of the vehicle-mounted lamps on the lighting effect, thereby reducing the risk of traffic accidents and ensuring the safety of vehicle driving.

[0008] In combination with some embodiments of the first aspect, in some embodiments, after the step of obtaining the user control instruction table of the current main driving user, the method further includes: when the interaction data between the current main driving user and the vehicle-mounted lamp is monitored, based on the interaction data, determining the control method of the current main driving user issuing the control instruction; the interaction data includes the control instruction issued by the current main driving user and its corresponding second instruction content, and the control method of issuing the control instruction; the control method includes clicking the touch screen, voice command control and gesture command control; when the control method is clicking the touch screen, based on the user driving behavior within a preset time range before and after the time corresponding to the time when the current main driving user issues the instruction, through behavior analysis The module obtains a second user control instruction of the current main driving user; the second user control instruction includes a voice instruction and a gesture instruction; the second user control instruction and the second instruction content are stored in the user control instruction table; when the control mode is the voice instruction control or the gesture instruction control, it is determined whether the current main driving user continues to adjust the lighting effect of the vehicle-mounted lamp by clicking the touch screen after the vehicle-mounted lamp executes the control instruction; if so, based on the voice instruction in the voice instruction control or the gesture instruction in the gesture instruction control and the third instruction content, the user control instruction table is updated; the third instruction content is the operation that the vehicle-mounted lamp needs to perform to achieve the lighting effect adjusted by the current main driving user.

[0009] By adopting the above technical solution, the user's user control instruction table is updated in real time by monitoring the interaction data between the user and the vehicle-mounted lamps, so that the user control instruction table is more in line with the user's usage habits, thereby improving the convenience and personalization of the user's control of the vehicle-mounted equipment.

[0010] In combination with some embodiments of the first aspect, in some embodiments, after the step of determining the first instruction content corresponding to the first control instruction based on the user control instruction table when the first user control instruction of the current main driving user is monitored, the method also includes: determining whether the first user control instruction is an adjustment instruction based on the first instruction content; the adjustment instruction is used to adjust the brightness or lighting angle of the vehicle-mounted lamp; if so, obtaining the vehicle driving data of the current main driving user; the vehicle driving data includes driving environment information, driving speed, driving route, driving destination, and working status of the vehicle-mounted lamp; the driving environment information includes the light intensity inside and outside the vehicle, the weather conditions outside the vehicle, and other object information around the vehicle; the other object information includes location information of other vehicles, pedestrians and obstacles; determining the adjustment parameter value of the vehicle-mounted lamp according to the vehicle driving data and the vehicle-mounted lamp adjustment habit of the current main driving user; the vehicle-mounted lamp adjustment habit is obtained based on the historical vehicle driving data of the current main driving user, including lighting brightness adjustment habit and lighting angle adjustment habit; based on the adjustment parameter value and the first instruction content, updating the first instruction content.

[0011] By adopting the above technical solution, when there is no specific adjustment parameter value of the vehicle-mounted lamp in the control instruction issued by the user, the appropriate adjustment parameter value can be automatically determined according to the actual driving situation and the user's adjustment habits, thereby improving the intelligence and humanization of the use of vehicle-mounted lamps and better meeting the lighting needs of users in different scenarios. When there is a specific adjustment parameter value of the vehicle-mounted lamp in the control instruction issued by the user, it can be verified whether the adjustment parameter value is suitable for execution, ensuring that the adjustment operation of the vehicle-mounted lamp meets the requirements of the current actual driving scene and will not cause safety hazards or affect driving comfort due to unreasonable parameter settings, thereby ensuring the safety of vehicle driving.

[0012] In combination with some embodiments of the first aspect, in some embodiments, after the step of obtaining the user control instruction table of the current main driving user, the method also includes: obtaining the fatigue driving value, health status value and mood status value of the current main driving user; determining whether the fatigue driving value, the health status value and the mood status value are all within preset thresholds; if not, executing a warning strategy; the warning strategy includes a warning voice prompt and turning on the hazard warning lights; the warning voice prompt is used to warn the current main driving user that the current state is not suitable for continuing to drive the vehicle.

[0013] By adopting the above technical solution, when it is detected that the driving state of the main driver is not suitable for continuing driving, the user is reminded through voice prompts, and other vehicle drivers are reminded to pay attention and avoid through hazard warning lights, thereby reducing the risk of traffic accidents and ensuring the safety of vehicle driving.

[0014] In combination with some embodiments of the first aspect, in some embodiments, after the step of executing the early warning strategy if not, the method further includes: calculating the driving state value of the current main driver based on the fatigue driving value, the health status value and the mood status value; determining the adjustment control instruction of the vehicle-mounted lamp based on the driving state value and the vehicle driving data; the adjustment control instruction adjusts the driving state of the current main driver by adjusting the vehicle-mounted lamp; and sending the adjustment control instruction to the vehicle-mounted lamp.

[0015] By adopting the above technical solution, when the user's driving state is not suitable for continuing driving and there is no place to park around the user or the user still insists on continuing to drive the vehicle, the vehicle-mounted lighting is automatically adjusted according to the user's driving state and the vehicle's driving data. The user's current driving state is adjusted by adjusting the vehicle-mounted lighting, helping the user to concentrate on driving until the user's driving state returns to normal or the vehicle stops, thereby reducing the risk of traffic accidents and ensuring the safety of vehicle driving.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after the step of obtaining the user control instruction table of the current main driver, the method also includes: obtaining driving environment information in the vehicle driving data of the current main driver; determining the driving risk level according to the weather conditions outside the vehicle in the driving environment information; the driving risk level includes a low risk level and a high risk level; when the driving risk level is a high risk level, predicting the vehicle lighting adjustment plan of the current main driver based on the vehicle driving data and historical vehicle driving data; the vehicle lighting adjustment plan includes a predicted adjustment location and its corresponding predicted adjustment instruction; when the current main driver is not detected to have issued the predicted adjustment instruction corresponding to the predicted adjustment location before the vehicle arrives at the predicted adjustment location, sending the predicted adjustment instruction corresponding to the predicted adjustment location to the vehicle lighting.

[0017] By adopting the above technical solution, when the driving risk level is high, it automatically assists users in controlling the vehicle lamps. When the user issues an erroneous instruction or misses an instruction, it automatically operates according to the predicted adjustment plan at the appropriate time to maintain a good driving lighting environment, reduce driving risks caused by problems such as uncomfortable lighting, and improve overall driving safety and driving experience.

[0018] In combination with some embodiments of the first aspect, in some embodiments, when the first user control instruction of the current main driver is monitored, after the step of determining the first instruction content corresponding to the first control instruction based on the user control instruction table, the method also includes: updating the frequency of the current main driver user issuing erroneous control instructions and missing control instructions according to the vehicle driving data and the first instruction content; determining whether the frequency of the current main driver user issuing erroneous control instructions and missing control instructions exceeds a preset frequency; if so, giving a voice prompt to the current main driver if the first user control instruction issued by the current main driver is erroneous; the voice prompt content includes the correct control instruction and the reason for issuing the instruction; and updating the first instruction content according to the correct control instruction.

[0019] By adopting the above technical solution, when it is detected that the user has issued erroneous control instructions multiple times or has missed issuing control instructions, it automatically intervenes and provides the user with correct operation guidance through voice prompts. This can not only help the user correct the current erroneous operation in time and avoid potential traffic safety risks caused by erroneous instructions or missed instructions, but also to a certain extent assist the user to improve his familiarity with various driving operations, fundamentally reduce the frequency of subsequent erroneous instructions or missed instructions, and ensure that the entire driving process is safer.

[0020] In a second aspect, an embodiment of the present application provides an automatic control system for vehicle-mounted lighting, including vehicle-mounted lighting, sensors, cameras, microphones, speakers and a vehicle controller, wherein the vehicle controller includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the automatic control system for vehicle-mounted lighting to perform the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, comprising instructions. When the above instructions are executed on a vehicle-mounted lighting automation control system, the above-mentioned vehicle-mounted lighting automation control system executes the method described in the first aspect and any possible implementation method of the first aspect.

[0022] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on a vehicle lighting automation control system, the vehicle lighting automation control system executes the method described in the first aspect and any possible implementation of the first aspect.

[0023] It can be understood that the vehicle-mounted lighting automation control system provided in the second aspect, the storage medium provided in the third aspect, and the computer program product provided in the fourth aspect are all used to execute the method provided by the present invention. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method, and will not be repeated here.

[0024] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages: 1. This application automatically adjusts the vehicle-mounted lamps by monitoring the voice commands or gesture commands issued by the current main driver, thereby improving the level of automated control and ease of use of the vehicle-mounted lamps. At the same time, when a fault in the vehicle-mounted lamp in the user control command is detected, a replacement control scheme is obtained through the vehicle simulation model, and the vehicle-mounted lamps are controlled according to the replacement control scheme, so that the lighting effect of the vehicle-mounted lamps can be as consistent as possible with the lighting effect expected by the user, reducing the impact of the fault of the vehicle-mounted lamps on the lighting effect, thereby reducing the risk of traffic accidents and ensuring the safety of vehicle driving.

[0025] 2. This application monitors the driving status of the current main driver in real time. When the driving status of the current main driver is not suitable for continuing driving, it immediately reminds the current main driver and reminds other vehicle drivers to avoid through hazard warning lights to avoid traffic accidents. At the same time, the vehicle lights can be automatically adjusted according to the driving status of the current main driver and the driving data of the vehicle. The user's current driving status can be adjusted by adjusting the vehicle lights, helping the user to concentrate on driving, reducing the risk of traffic accidents, and ensuring the safety of vehicle driving.

[0026] 3. This application automatically assists the current main driver in controlling the vehicle lights. When the current main driver issues an erroneous command or misses an instruction, the application automatically sends the correct command to control the vehicle lights, thereby maintaining a good driving lighting environment and reducing driving risks caused by problems such as uncomfortable lighting, thereby ensuring the vehicle's driving safety when the driving risk level is high. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a structural diagram of a system architecture to which the vehicle-mounted lamp automatic control method in the embodiment of the present application can be applied; Figure 2 This is a flow chart of the automatic control method of the vehicle-mounted lamp in the embodiment of the present application; Figure 3 is another flow chart of the automatic control method of the vehicle-mounted lamp in the embodiment of the present application; Figure 4 is another flow chart of the automatic control method of the vehicle-mounted lamp in the embodiment of the present application; Figure 5 is another flow chart of the automatic control method of the vehicle-mounted lamp in the embodiment of the present application; Figure 6 It is a schematic diagram of an exemplary hardware structure of the vehicle lighting automation control system in the embodiment of the present application. DETAILED DESCRIPTION

[0028] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions, unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations comprising one or more listed items.

[0029] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as suggesting or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0030] Figure 1 It is a structural diagram of a system architecture to which the vehicle-mounted lamp automatic control method in the embodiment of the present application can be applied.

[0031] See also Figure 1 The vehicle-mounted lighting automatic control system includes a vehicle controller, vehicle-mounted lighting, a sensor, a camera, a microphone and a speaker.

[0032] As the core component of the system, the vehicle controller is used to identify and process the control instructions issued by the user and send control instructions to the vehicle lamps. The vehicle lamps are used to receive the control instructions sent by the vehicle controller and execute the control instructions. The sensor is used to collect data such as the light intensity inside and outside the vehicle and the light intensity of the vehicle lamps, and send the collected data to the vehicle controller. The camera is used to collect visual information such as the user's face and gestures, and transmit this data to the vehicle controller. The microphone is used to collect the user's voice information and transmit the voice information to the vehicle controller so that the device can recognize and process the voice information. The speaker is used to send prompt sounds or voice feedback to the user when the system performs certain operations.

[0033] After receiving the user's visual and voice information collected by the camera and microphone, the vehicle controller will identify and process the information, extract the control instructions issued by the user, and then determine whether the control instructions issued by the user are compliant through the data collected by the sensor. If the control instructions are compliant, they will be sent to the on-board lamps, so that the on-board lamps execute the control instructions to achieve the lighting effect expected by the user. At the same time, after the on-board lamps execute the control instructions, the instructions are sent to the speaker, so that it sends a prompt sound to the user to confirm that the instruction has been executed.

[0034] Among them, vehicle-mounted lighting covers interior and exterior lighting, including headlights, fog lights, turn signals, brake lights, reversing lights, position lights, interior ceiling lights, reading lights, and ambient lights.

[0035] Through the above system architecture, the vehicle-mounted lighting automation control system can accurately identify the voice and gesture commands issued by the user, and send the commands to the vehicle-mounted lighting to execute the corresponding commands, thereby realizing intelligent control of the vehicle-mounted lighting.

[0036] However, if a control instruction is sent to the vehicle lamp when a fault occurs, even though the vehicle lamp receives the control instruction and performs a corresponding operation, the lighting effect of the vehicle lamp cannot achieve the lighting effect expected by the user, and may also affect the user's field of vision, increasing the risk of traffic accidents.

[0037] By adopting the automated control method for vehicle lamps in the embodiment of the present application, when a vehicle lamp fails, a replacement control plan can be formulated according to the failure condition of the vehicle lamp. By controlling the vehicle lamp through the replacement control plan, the lighting effect of the vehicle lamp can be made as consistent as possible with the lighting effect expected by the user, thereby reducing the impact of the failure of the vehicle lamp on the lighting effect, thereby reducing the risk of traffic accidents and ensuring the safety of vehicle driving.

[0038] Combine the following Figure 2 To illustrate the method of the embodiment of the present application.

[0039] See also Figure 2 , which is a flow chart of the automatic control method of vehicle-mounted lamps in an embodiment of the present application.

[0040] S201, obtaining a user control instruction table of the current primary driver.

[0041] The personal information of the current main driver user is obtained through face recognition, and then it is determined whether there is user information in the cloud database that matches the personal information of the current main driver user based on the recognized personal information. If it matches, the user control instruction table corresponding to the personal information of the current main driver user in the cloud database is obtained; if it does not match, the original control instruction table is created in the cloud database as the user control instruction table of the current main driver user.

[0042] The user control instruction table includes user control instructions and their corresponding instruction contents. User control instructions are used to control vehicle-mounted lamps, including voice instructions and gesture instructions, etc. The original control instruction table includes basic control instructions and their corresponding basic instruction contents.

[0043] Specifically, the vehicle lighting automation control system uses the camera inside the vehicle to capture the facial features of the current main driver, such as the facial contours, facial proportions, eye distance and other key feature point information, and then digitizes these captured feature information and compares them one by one with the user facial feature data stored in the cloud database. If matching user information is found after the comparison, the user control instruction table of the current main driver is directly obtained from the cloud database; if matching user information is found after the comparison, the original control instruction table is created in the cloud database as the user control instruction table of the current main driver.

[0044] S202: When a first user control instruction of the current main driver is monitored, determine a first instruction content corresponding to the first control instruction based on a user control instruction table.

[0045] Real-time monitoring is performed to determine whether the current main driving user issues a first user control instruction. When the current main driving user issues the first user control instruction, the first instruction content of the first user control instruction is searched in the user control instruction table.

[0046] The first user control instruction is one of all the user control instructions in the user control instruction table.

[0047] Specifically, the vehicle-mounted lighting automation control system obtains the voice information and gesture movements of the current main driving user in real time through the camera and microphone inside the vehicle. After obtaining the voice information and gesture movements, the obtained data is recognized and processed to determine whether the current main driving user has issued a first user control instruction.

[0048] For voice information, the voice is first processed through the voice preprocessing module to effectively remove interference factors such as environmental noise in the car (such as tire noise, wind noise generated by the vehicle, and the sound of other equipment running, etc.), echo, etc., so that the voice signal is clearer and convenient for subsequent accurate recognition. Then, the preprocessed voice signal is accurately converted into the corresponding text content through the voice recognition module. Finally, the user control instruction table is searched to see if there is a user control instruction that matches the text content. If it matches, it means that the current main driving user has issued the first user control instruction, and the instruction content of the first user control instruction is obtained; if it does not match, it means that the current main driving user has not issued the first user control instruction.

[0049] Among them, the speech recognition module can be built based on a deep neural network (DNN), a convolutional neural network (CNN) or a long short-term memory network (LSTM), or can be built based on a hybrid architecture of a deep neural network (DNN) and a long short-term memory network (LSTM), which is not limited here.

[0050] For gestures, the image containing gestures obtained by the in-car camera is first processed, and the image resolution, contrast and other parameters are adjusted to make the image clearer and facilitate subsequent feature extraction and analysis. Then, edge detection algorithms (such as the Canny edge detection algorithm) are used to accurately outline the outline of the hand, and shape description algorithms (such as the Hu moment algorithm) are used to accurately describe the shape of the fingers and the overall shape characteristics of the gesture. At the same time, the dynamic changes of gestures are analyzed by combining optical flow methods and other means, including the direction, speed, amplitude and other feature information of the action, so as to completely extract the key features of the gesture. Then, the extracted gesture features are compared and matched with the gesture instruction feature templates pre-stored in the user control instruction table. In this process, the similarity between the feature vectors is calculated (for example, using the cosine similarity and other calculation methods) to determine whether the gesture conforms to a preset gesture instruction for controlling the vehicle-mounted lamps. If the comparison result is a match, it means that the current main driving user has issued a first user control instruction, and the instruction content of the first user control instruction is obtained; if the comparison result is a mismatch, it means that the current main driving user has not issued the first user control instruction.

[0051] In some embodiments, when there are multiple users in the vehicle, the microphone array combined with voiceprint recognition technology can be used to accurately extract the voice information of the current main driver from the acquired voice information. The microphone array focuses on the sound of the main driver through sound source localization and beamforming, and initially separates the main driver's voice; then through voiceprint recognition, it compares the pre-stored main driver's voiceprint features to accurately filter out the main driver's voice, and then determines whether to issue the first user control command.

[0052] S203: When a target vehicle lamp corresponding to the first instruction content fails, determine a target failure level of the target vehicle lamp.

[0053] A target vehicle lamp corresponding to the first instruction content is determined, and it is judged whether the target vehicle lamp is faulty. If the target vehicle lamp is faulty, a target fault level of the target vehicle lamp is determined.

[0054] The first instruction includes the vehicle lamps that execute the user instructions and the corresponding specific operations, such as turning on the headlights, turning on the headlights and rear fog lights, and adjusting the brightness of the reading lights in the car to 80%. The target vehicle lamp is at least one of the vehicle lamps. The target fault level includes level one and level two. Level one means that the target vehicle lamp cannot light up at all, and level two means that it can light up but the brightness is not enough to reach the lighting brightness in the first instruction content.

[0055] Specifically, the target vehicle lamp is determined according to the content of the first instruction, and a control instruction corresponding to the content of the first instruction is sent to the target vehicle lamp. The illumination brightness of the target vehicle lamp is obtained through the light sensor, and it is determined whether the illumination brightness of the target vehicle lamp reaches the illumination brightness in the content of the first instruction. If it can be reached, it means that the target vehicle lamp is not faulty; if it cannot be reached, it means that the target vehicle lamp is faulty, and the target fault level of the target vehicle lamp is further determined.

[0056] When there is only one target vehicle lamp, if the obtained lighting brightness is 0, the target fault level is level one; if the obtained lighting brightness is greater than 0, but the actual brightness does not meet the requirements compared with the lighting brightness standard corresponding to the lamp required in the first instruction content, the target fault level is level two.

[0057] When there are multiple target vehicle lamps, if all the target vehicle lamps cannot light up at all (that is, all the lighting brightness obtained is 0), the target fault level is level one; if some of the target vehicle lamps cannot light up at all, but other lamps can light up (that is, some of the lighting brightness obtained is 0), the target fault level is level two; if all the target vehicle lamps can light up, further compare the actual lighting brightness of each target vehicle lamp with the lighting brightness required by the corresponding instruction: if the brightness of any target vehicle lamp is not enough to meet the lighting brightness requirement in the first instruction content, the target fault level is level two.

[0058] In some embodiments, for vehicles that can automatically adjust the lighting angle of vehicle-mounted lamps, when judging whether the vehicle-mounted lamps are faulty, in addition to considering the problem of lighting brightness, it is also necessary to consider whether the vehicle-mounted lamps can accurately adjust the lighting angle. At the same time, in order to accurately obtain the fault condition of the vehicle-mounted lamps, the target fault level must be further subdivided. For example, the first level indicates that the target vehicle-mounted lamp cannot light up at all, the second level indicates that it can light up but the brightness is not enough to reach the lighting brightness in the first instruction content, the third level indicates that there is a problem with the lighting angle and the target vehicle-mounted lamp cannot light up at all, the fourth level indicates that there is a problem with the lighting angle and the target vehicle-mounted lamp can light up but the brightness is not enough to reach the lighting brightness in the first instruction content, and the fifth level indicates that there is a problem with the lighting angle and the brightness of the target vehicle-mounted lamp can reach the lighting brightness in the first instruction content.

[0059] S204: Determine the brightness range of the target vehicle lamp according to the target fault level.

[0060] If the target fault level is level one, the brightness range of the target vehicle lamp is 0; if the target fault level is level two, the brightness range of the target vehicle lamp is determined based on the illumination brightness of the target vehicle lamp collected by the light sensor.

[0061] Specifically, when there is only one target vehicle lamp, if the target fault level is level one, the brightness range of the target vehicle lamp is 0; if the target fault level is level two, the illumination brightness of the target vehicle lamp collected by the light sensor is obtained, and the illumination brightness is determined to be the maximum illumination brightness that the vehicle lamp can reach, and the brightness range of the target vehicle lamp is obtained from 0 to the maximum illumination brightness. When there are multiple target vehicle lamps, the brightness range of each target vehicle lamp is obtained in turn according to the above method.

[0062] S205: Input the first control instruction content, the target vehicle lamp, and the brightness range of the target vehicle lamp into a vehicle simulation model to obtain one or more simulation control schemes and their corresponding lighting effect similarities.

[0063] The vehicle simulation model can simulate the lighting effects of different control schemes of the vehicle in a real environment, and calculate the similarity between the simulated lighting effect and the lighting effect of the first control instruction content.

[0064] Specifically, before using the vehicle simulation model, the model needs to be trained with a large amount of data so that it can simulate the lighting effects of various control schemes.

[0065] First, prepare vehicle-related data. This can be done through professional 3D modeling software combined with precise measurements of the actual vehicle. From the overall appearance of the vehicle to the specific shape and size of each component, it must be accurately presented. In particular, it is important to clarify the specific position coordinates of the vehicle lamps on the vehicle body to ensure that the position information error is extremely small. At the same time, for vehicle lamps, it is necessary to use professional optical testing equipment to measure their brightness range, lighting range, etc. under a variety of standard environments (such as standard darkroom environments, different preset distances, etc.), and record in detail the brightness range that the lamps can achieve, the angle range that the emitted light can cover, and the farthest effective lighting distance and other parameters, to form a complete vehicle lamp lighting characteristic data file.

[0066] Second, collect actual lighting effect data of different control schemes. Arrange a dedicated test team to carry out testing in a variety of real environments. These real environments cover different road conditions (such as flat urban roads, rugged mountain roads, sloping viaducts, etc.) and various weather conditions (such as clear and cloudless days, nights, light rain, heavy snow, dense fog, etc.). In each environment, let the vehicle adopt different lighting control schemes (such as different brightness adjustments of low beams, various combinations of high beams turned on alone or in conjunction with fog lights), and use high-precision light sensors and image acquisition equipment to record the actual effects of vehicle lighting under the corresponding control scheme, such as the shape of the specific area covered by the light, the distribution of light intensity, and the light and shadow comparison with the surrounding environment, so as to build a rich database of actual lighting effects of different control schemes.

[0067] Third, build and train the vehicle simulation model. Use the acquired vehicle 3D model data, vehicle lamp related data and actual lighting effect data to build the basic architecture of the vehicle simulation model. Select a suitable simulation modeling platform (such as some professional automotive engineering simulation software), set the parameters such as vehicle 3D model, lamp position, brightness range and lighting range, so that it has the basic conditions for simulating vehicle entities. Then, use machine learning algorithms (such as neural network algorithms, etc.) to input a large amount of actual lighting effect data of different control schemes into the model as training samples, so that the model can continuously learn and analyze the relationship between the control scheme and the actual lighting effect in different samples, adjust its internal calculation logic and parameter weights, and after multiple rounds of iterative training, the model can accurately simulate the lighting effects corresponding to different control schemes in different real environments based on the input vehicle 3D model, vehicle lamp position, brightness range, lighting range and other information.

[0068] After the first control instruction content, the target vehicle lamp and the brightness range of the target vehicle lamp are input into the trained vehicle simulation model, the model will first simulate the target lighting effect that the vehicle needs to achieve based on the first control instruction content, the preset vehicle 3D model, the preset vehicle lamp position, the preset standard brightness range of each lamp in the vehicle lamp and the preset lighting range of the vehicle lamp. Then, according to the brightness range of the target vehicle lamp, the standard brightness range of the target vehicle lamp is replaced to obtain the brightness range of the replaced vehicle lamp. Then, the controllable vehicle lamp is determined according to the type of the target vehicle lamp. When the type of the target vehicle lamp is an interior lamp, the model will take the interior lamp in the vehicle lamp as a controllable vehicle lamp. When the type of the target vehicle lamp is an exterior lamp or a mixed lamp (i.e., both interior lamps and exterior lamps), the model will take all lamps in the vehicle lamp as controllable vehicle lamps. After that, the model will input the controllable vehicle lamps into the solution generation module, and the module will generate one or more simulation control schemes based on the controllable vehicle lamps, the achievable operations of these lamps (such as turning on, off, adjusting brightness, etc.), and the brightness range of the replaced vehicle lamps. After obtaining the simulation control scheme, the model will simulate the lighting effects corresponding to these simulation control schemes based on the simulation control scheme, the preset vehicle 3D model, the preset vehicle lamp position, the brightness range of the replaced vehicle lamps, and the preset lighting range of the vehicle lamps. Finally, through the preset similarity calculation algorithm (for example, a comprehensive similarity calculation method that can be constructed based on multiple factors such as the overlap of the illumination area, the difference in light intensity, and the consistency of light and shadow distribution), the lighting effects corresponding to each simulation control scheme are compared and analyzed with the target lighting effect, so as to calculate the similarity value of the lighting effects of each simulation control scheme, so as to evaluate whether the simulation control scheme meets the expected requirements.

[0069] S206: When there is a simulation control scheme whose lighting effect similarity is higher than a preset similarity threshold, select the simulation control scheme with the highest lighting effect similarity as the replacement control scheme.

[0070] According to the similarity of the lighting effects of each simulated control scheme, it is determined whether there is a simulated control scheme whose lighting effect similarity is higher than a preset similarity threshold. If there is a simulated control scheme whose lighting effect similarity is higher than the preset similarity threshold, the simulated control scheme with the highest lighting effect similarity is selected as the replacement control scheme.

[0071] Among them, if the similarity of the lighting effect of the simulated control scheme is lower than the preset similarity threshold, it means that the lighting effect when the simulated control scheme is executed is not much different from the lighting effect when the simulated control scheme is not executed, and may even have a negative impact.

[0072] Specifically, according to the similarity of the lighting effects of each simulated control scheme, it is determined whether there is a simulated control scheme whose lighting effect similarity is higher than the second preset similarity threshold. If there is, the simulated control scheme with the highest lighting effect similarity is selected as the replacement control scheme; if not, a voice prompt is given to the user.

[0073] S207: Send a replacement control instruction to the vehicle-mounted lamp according to the replacement control scheme.

[0074] According to the replacement control scheme, a corresponding replacement control instruction is generated, and the replacement control instruction is sent to the vehicle-mounted lamp.

[0075] Specifically, the vehicle lamps to be adjusted and the operation contents to be performed in the replacement control scheme are extracted, and replacement control instructions for each vehicle lamp to be adjusted are generated according to the operation contents. Through the established communication connection, the generated replacement control instructions are sent in sequence to each vehicle lamp to be adjusted in a prescribed communication protocol format.

[0076] After the instruction is sent, the light sensor can be used to detect whether the brightness of each on-board lamp to be adjusted reaches the brightness of the corresponding on-board lamp in the replacement control scheme. If the brightness of the on-board lamp to be adjusted does not reach the brightness of the corresponding on-board lamp in the replacement control scheme, and the difference between the brightness of the two exceeds the preset threshold, it means that the on-board lamp to be adjusted is also faulty, and the on-board lamp to be adjusted is also added to the target on-board lamp, and steps S203-S207 are re-executed; if the brightness of the on-board lamp to be adjusted does not reach the brightness of the corresponding on-board lamp in the replacement control scheme, or the brightness of the on-board lamp to be adjusted does not reach the brightness of the corresponding on-board lamp in the replacement control scheme, and the difference between the brightness of the two does not exceed the preset threshold, it means that the actual lighting effect of the on-board lamp after the replacement control instruction is executed is consistent with the expected effect.

[0077] In the embodiment of the present application, the vehicle-mounted lamps can be automatically adjusted by monitoring the user control instructions issued by the user. When a fault is detected in the vehicle-mounted lamp in the user control instruction, a replacement control scheme can be obtained through the vehicle simulation model. The vehicle-mounted lamps are controlled according to the replacement control scheme, so that the lighting effect of the vehicle-mounted lamps can be made as consistent as possible with the lighting effect expected by the user, reducing the impact of the fault of the vehicle-mounted lamps on the lighting effect, thereby reducing the risk of traffic accidents and ensuring the safety of vehicle driving.

[0078] Combine the following Figure 3 To further illustrate the method of the embodiment of the present application.

[0079] See also Figure 3 , is another flow chart of the method for automatic control of vehicle-mounted lamps in an embodiment of the present application.

[0080] S301: Obtain a user control instruction table of the current main driver.

[0081] S302: Monitor the first user control command of the current main driver.

[0082] S303: When a first user control instruction of the current main driver is monitored, a first instruction content corresponding to the first control instruction is determined based on the user control instruction table.

[0083] Steps S301-S303 and Figure 2 Steps S201 - S202 in the illustrated embodiment are similar, and the descriptions of steps S201 - S202 may be referred to, and will not be repeated here.

[0084] S304: Update the frequency of erroneous control instructions and missed control instructions issued by the current main driver according to the vehicle driving data and the first instruction content.

[0085] Specifically, first determine the predicted driving path, the predicted position range where instructions need to be issued, and the corresponding predicted instruction content that needs to be issued based on the driving path and driving destination in the vehicle driving data. Then, determine whether the address of the current instruction is within the predicted position range. If so, determine whether the actual driving path is consistent with the predicted driving path. If consistent, determine whether the content of the first instruction issued by the user is correct based on the predicted instruction content. If not, update the recorded frequency and increase the frequency by one; if not, determine whether the instruction issued by the user is correct based on the actual driving path. If not, update the recorded frequency and increase the frequency by one. If not, determine whether the instruction issued by the user is correct based on the actual driving path and driving environment information. If not, update the recorded frequency and increase the frequency by one.

[0086] At the same time, based on the predicted position range, it is determined whether the current driver has missed issuing a control command. When the vehicle is within the predicted position range and no control command issued by the current driver is detected, it means that the current driver has missed issuing a control command. The user is directly reminded that the control command has been missed, and the recorded frequency is updated, increasing the frequency by one.

[0087] S305: Determine whether the frequency of the current primary driver user issuing erroneous control instructions and missing control instructions exceeds a preset frequency.

[0088] If the frequency exceeds the preset frequency, execute step S306; if the frequency does not exceed the preset frequency, execute step S313.

[0089] S306: Determine whether the first user control instruction issued by the current main driver is wrong.

[0090] If yes, execute step S307; if no, execute step S313.

[0091] The method for determining whether the instruction is wrong in step S306 is similar to the method in the above step S304. Please refer to the description in step S304 and will not be repeated here.

[0092] S307: Providing voice prompts to the current driving user.

[0093] The voice prompt content includes the correct control command and the reason for issuing the command.

[0094] Specifically, the correct control command to be issued and the reason for issuing the command are determined by combining the driving path and driving environment information in the vehicle driving data. Voice prompts are used to remind the current driver of the correct command to be issued and why the command is issued, so that the user can clearly know the inappropriateness of his or her own operation and correct it in time.

[0095] S308: Update the first instruction content according to the correct control instruction.

[0096] According to the instruction content of the correct control instruction, all the contents in the first instruction content are directly replaced.

[0097] S309: Based on the first instruction content, determine whether the first user control instruction is an adjustment instruction.

[0098] If the first user control instruction is an adjustment instruction, step S310 is executed; if the first user control instruction is not an adjustment instruction, step S313 is executed.

[0099] The adjustment instruction is used to adjust the brightness or lighting angle of the vehicle-mounted lamp.

[0100] Specifically, the operation content of the vehicle lamp in the first instruction content is extracted to identify whether the operation content contains relevant expressions for changing the brightness or lighting angle of the vehicle lamp. If it does, it means that the first user control instruction is an adjustment instruction; if not, it means that the first user control instruction is not an adjustment instruction.

[0101] S310: Obtain vehicle driving data of the current main driver.

[0102] Among them, vehicle driving data includes driving environment information, driving speed, driving route, driving destination, and the working status of vehicle lamps. Driving environment information includes the light intensity inside and outside the vehicle, the weather conditions outside the vehicle, and other object information around the vehicle. Other object information includes the location information of other vehicles, pedestrians, and obstacles.

[0103] Specifically, for light intensity, the vehicle's built-in light sensor can be used to collect data on the vehicle's internal and external light intensity. For the vehicle's external weather conditions, meteorological sensors (raindrop sensors, humidity sensors, temperature sensors, etc.) can be placed on the roof, front of the vehicle, etc., combined with intelligent camera image recognition to determine the vehicle's external weather conditions, and the vehicle's external weather conditions can also be obtained by obtaining weather forecast information. For other object information, the vehicle's onboard radar and camera can be used to detect the positions of other vehicles, pedestrians, and obstacles around the vehicle. For driving speed, the speed sensors at the wheels and gearbox can be used to measure the driving speed in real time. For the driving path, the vehicle's onboard navigation system receives satellite positioning signals, records the driving path, and combines the inertial measurement unit to ensure continuity when necessary. For the driving destination, the destination address entered by the user into the navigation system is obtained. For the working status of the vehicle-mounted lamps, current, voltage, and light sensors are installed near them or on the power supply lines, and the lamp feedback signals are received at the same time to grasp their working status.

[0104] S311. Determine adjustment parameter values ​​of the vehicle lamps according to the vehicle driving data and the vehicle lamp adjustment habits of the current main driver.

[0105] The vehicle lighting adjustment habits are obtained based on the historical vehicle driving data of the current main driver, including lighting brightness adjustment habits and lighting angle adjustment habits. For example, the headlight brightness is often adjusted to 70% in the evening, the headlights are often adjusted to 100% and the fog lights are adjusted to 50% when entering a tunnel; the headlight angle is often lowered by 10 degrees when encountering oncoming vehicles, and the headlight angle is often adjusted 15 degrees inward before entering a curve.

[0106] Specifically, when the first instruction content does not contain a specific adjustment parameter value, it is determined whether the parameter to be adjusted by the current main driver is the brightness of the vehicle lamp or the lighting angle. When the parameter to be adjusted is brightness, if the vehicle lamp to be adjusted is an interior lamp, an adjustable brightness range is determined based on the light intensity inside and outside the vehicle to ensure that the adjusted brightness does not affect the user's driving, and then the specific adjustment parameter value is determined based on the lighting brightness adjustment habit; if the vehicle lamp to be adjusted is an exterior lamp, an adjustable brightness range is determined based on other object information around the vehicle to ensure that the adjusted brightness does not affect the user's driving, and does not affect other vehicles and pedestrians around, and then the specific adjustment parameter value is determined based on the lighting brightness adjustment habit.

[0107] When the parameter to be adjusted is the lighting angle, if the vehicle-mounted lamp that adjusts the lighting angle is an interior lamp, the specific adjustment parameter value is determined directly according to the lighting angle adjustment habit; if the vehicle-mounted lamp that adjusts the lighting angle is an exterior lamp, an adjustable angle range is determined based on information about objects around the vehicle, bends in the driving path, etc., to ensure that the adjustment will not affect the user's driving, nor will it affect other vehicles and pedestrians around, and then the specific adjustment parameter value is determined according to the lighting angle adjustment habit.

[0108] In some embodiments, when the first instruction content includes a specific adjustment parameter value, an adjustable adjustment parameter value range is determined based on the vehicle driving data, and it is determined whether the adjustment parameter value is within the range. If so, the original adjustment parameter value is determined as the current adjustment parameter value; if not, a new adjustment parameter value is determined as the current adjustment parameter value.

[0109] S312: Update the first instruction content based on the adjustment parameter value and the first instruction content.

[0110] The adjustment parameter value is added to the first instruction content to improve the first instruction content, or the original adjustment parameter value in the first instruction content is replaced according to the adjustment parameter value.

[0111] S313: When a target vehicle lamp corresponding to the first instruction content fails, determine a target fault level of the target vehicle lamp.

[0112] S314: Determine the brightness range of the target vehicle lamp according to the target fault level.

[0113] S315: Input the first control instruction content, the target vehicle lamp, and the brightness range of the target vehicle lamp into the vehicle simulation model to obtain one or more simulation control schemes and their corresponding lighting effect similarities.

[0114] S316: When there is a simulation control scheme whose lighting effect similarity is higher than a preset similarity threshold, select the simulation control scheme with the highest lighting effect similarity as the replacement control scheme.

[0115] S317: Send a replacement control instruction to the vehicle-mounted lamp according to the replacement control scheme.

[0116] Steps S313-S317 and Figure 2 Steps S203 to S207 in the illustrated embodiment are similar, and the descriptions of steps S203 to S207 may be referred to, and will not be repeated here.

[0117] S318: Monitor the interaction data between the current driver and the vehicle-mounted lighting fixtures.

[0118] The vehicle lighting automation control system monitors in real time whether the current main driver user issues control instructions to the vehicle lighting. When it is detected that the current main driver user issues a control instruction, it determines the control method for issuing the control instruction and identifies the second instruction content.

[0119] Among them, the interaction data includes the control instructions issued by the current main driver and the corresponding second instruction content, and the control method of issuing the control instructions. The control method includes clicking the touch screen, voice command control, and gesture command control.

[0120] Specifically, when the control method is to click the touch screen, the touch sensing module built into the vehicle-mounted lighting automation control system will accurately capture the operation position and click action type (such as single click, double click, long press, etc.) on the touch screen, and determine the corresponding second instruction content based on the preset mapping relationship between the touch screen operation and the instruction content.

[0121] When the control method is voice command control, the voice recognition module in the vehicle lighting automation control system will start quickly, collect the voice commands issued by the main driver, and convert the voice signal into text content through the voice analysis algorithm, and then match it with the pre-stored voice command template to accurately identify the second command content.

[0122] When the control method is gesture command control, the camera and other sensing devices equipped in the vehicle lighting automation control system will capture the gestures of the main driver in real time, and use image recognition and gesture analysis technology to determine key elements such as the shape, direction and movement trajectory of the gesture, and then clarify the content of the second instruction based on the set correspondence rules between gestures and instructions.

[0123] S319: When the interaction data between the current main driver and the vehicle-mounted lamps is monitored, a control method for the current main driver to issue a control command is determined based on the interaction data.

[0124] When the interaction data between the current main driver and the vehicle-mounted lamps is monitored, the control method of the current main driver issuing the control command in the interaction data is obtained.

[0125] S320: When the control method is clicking the touch screen, based on the user driving behavior within a preset time range before and after the time corresponding to the time when the current main driving user issues the instruction, the second user control instruction of the current main driving user is obtained through the behavior analysis module.

[0126] Specifically, the voice information and gesture information collected by the camera and microphone within a preset time range before and after the time corresponding to the instruction issued by the current main driver user are obtained. For voice information, the user's voice information and gesture information are analyzed by the behavior analysis module, and the keywords related to the second instruction content in the voice information are extracted. With reference to the voice instructions in the user control instruction table, the extracted keywords are summarized to generate new voice instructions. For gesture actions, the gesture actions related to the second instruction content in the gesture information are extracted by the behavior analysis module, and the degree of association is calculated, and the gesture action with the highest degree of association is used as the new gesture instruction. Finally, the new voice instruction and the new gesture instruction are combined to obtain the second user control instruction.

[0127] S321. Store the second user control instruction and the second instruction content into the user control instruction table.

[0128] Check whether there is a user control instruction and its corresponding instruction content in the user control instruction table that matches the second user control instruction and the second instruction content. If they match, replace the original user control instruction and its corresponding instruction content; if they do not match, directly add the second user control instruction and the second instruction content to the user control instruction table.

[0129] S322: When the control mode is voice command control, determine whether the current main driver continues to adjust the lighting effect of the vehicle lamp by clicking the touch screen after the vehicle lamp executes the control command.

[0130] If yes, execute step S323; if no, execute step S319.

[0131] Specifically, it is monitored whether the current main driving user issues a control instruction to the vehicle-mounted lamp. When it is monitored that the current main driving user issues a control instruction, the control method for issuing the control instruction is determined and the content of the fourth instruction is identified. At the same time, the time interval between the time when the current instruction is issued and the time when the previous instruction is issued is calculated. If the control method is clicking the touch screen, and the time interval is within the preset time interval, it is determined that the current main driving user continues to adjust the lighting effect of the vehicle-mounted lamp by clicking the touch screen after the vehicle-mounted lamp executes the control instruction; if the control method is clicking the touch screen, and the time interval is not within the preset time interval, it is determined that the current main driving user does not continue to adjust the lighting effect of the vehicle-mounted lamp by clicking the touch screen after the vehicle-mounted lamp executes the control instruction; if the control method is voice command control or gesture command control, it is determined that the current main driving user does not continue to adjust the lighting effect of the vehicle-mounted lamp by clicking the touch screen after the vehicle-mounted lamp executes the control instruction.

[0132] S323: Based on the voice instruction and the third instruction content in the voice instruction control, update the user control instruction table.

[0133] The third instruction content is obtained according to the second instruction content and the fourth instruction content, and the instruction content corresponding to the voice instruction in the user control instruction table is replaced with the third instruction content.

[0134] Among them, the third instruction content is the operations that the vehicle lamps need to perform to achieve the lighting effect adjusted by the current main driver user.

[0135] S324: When the control mode is gesture command control, determine whether the current main driver continues to adjust the lighting effect of the vehicle lamp by clicking the touch screen after the vehicle lamp executes the control command.

[0136] If yes, execute step S325; if no, execute step S319.

[0137] Step S324 is similar to the above-mentioned step S322. Please refer to the description in step S322, which will not be repeated here.

[0138] S325: Update the user control instruction table based on the gesture instruction and the third instruction content in the gesture instruction control.

[0139] The third instruction content is obtained according to the second instruction content and the fourth instruction content, and the instruction content corresponding to the gesture instruction in the user control instruction table is replaced with the third instruction content.

[0140] In the embodiment of the present application, when it is detected that the current main driving user has issued wrong control instructions for many times or missed control instructions, it automatically intervenes and provides the current main driving user with correct operation guidance through voice prompts, avoiding potential traffic safety risks caused by wrong instructions or missed instructions, and ensuring the safety of the entire driving process. When it is monitored that there is no specific adjustment parameter value of the vehicle-mounted lamp in the control instruction issued by the current main driving user, the appropriate adjustment parameter value is automatically determined according to the actual driving situation and the user's adjustment habits, which improves the intelligence and humanization of the use of vehicle-mounted lamps. When it is monitored that there is a specific adjustment parameter value of the vehicle-mounted lamp in the control instruction issued by the current main driving user, it is verified whether the adjustment parameter value is suitable for execution, ensuring that the adjustment operation of the vehicle-mounted lamp not only meets the requirements of the current actual driving scene, but also does not cause safety hazards or affect driving comfort due to unreasonable parameter settings. When the vehicle-mounted lamp in the user control instruction fails, a replacement control scheme is obtained through the vehicle simulation model, and the vehicle-mounted lamp is controlled according to the replacement control scheme, which can make the lighting effect of the vehicle-mounted lamp as consistent as possible with the lighting effect expected by the user, reduce the impact of the failure of the vehicle-mounted lamp on the lighting effect, and ensure the safety of vehicle driving. At the same time, by monitoring the interaction data between the current main driver and the vehicle-mounted lighting, the user's user control command table is updated in real time, making the user control command table more in line with the user's usage habits and facilitating the user to control the vehicle-mounted equipment.

[0141] In the above embodiments, when a vehicle-mounted lamp fails, a replacement control scheme is formulated to reduce the impact of the failure of the vehicle-mounted lamp on the lighting effect, so that the actual lighting effect is as consistent as possible with the expected lighting effect, thereby reducing the risk of traffic accidents. However, in actual applications, the user's poor driving state may easily confuse the command content corresponding to the voice and gesture commands, resulting in the issuance of wrong commands. Even if the user's command is accurately executed, it is not the command the user wants to execute, which leads to a large gap between the actual lighting effect and the lighting effect expected by the user, increasing the risk of traffic accidents. In order to further reduce the risk of traffic accidents, in some embodiments, after the execution is completed, Figure 3 In the illustrated embodiment, after step S301, the following steps S402-S407 may also be executed to promptly remind the user when the user's driving state is poor to avoid dangerous driving.

[0142] See also Figure 4 , is another flow chart of the method for automatic control of vehicle-mounted lamps in an embodiment of the present application.

[0143] S401: Obtain a user control instruction table of the current primary driver.

[0144] Step S401 and Figure 2 Step S201 in the illustrated embodiment is similar, and the description in step S201 may be referred to, which will not be repeated here.

[0145] S402: Obtain the fatigue driving value, health status value, and mood status value of the current main driver.

[0146] The fatigue driving value, health status value and mood status value of the current main driver are obtained in real time. The lower the fatigue driving value, the higher the fatigue driving degree of the current main driver; the lower the health status value, the worse the health status of the current main driver; the lower the mood status value, the worse the mood of the current main driver.

[0147] Specifically, for the fatigue driving value, the camera installed in the car can monitor the user's facial features such as blinking frequency and yawning frequency, combined with factors such as driving time, and calculate the specific fatigue driving value by setting weights to determine the user's current fatigue level.

[0148] For the health status value, the basic health data such as heart rate and blood pressure are obtained through the smart bracelet worn by the current driver or the device installed in the car that can monitor the user's health status, and then a preliminary score is obtained for each data based on the normal range of these data. The corresponding weight is given according to the importance of each data to health. The health status value of the current main driver is calculated based on the weight and the preliminary score of each data to understand whether his body is in good condition.

[0149] For the mood state value, the intelligent voice interaction system is used to identify the user's speech intonation, speaking speed, tone and other characteristics, and at the same time, combined with the strength and frequency of the action when operating the vehicle, the mood state value of the main driver at the moment is analyzed according to the pre-set emotion analysis model to understand his emotional state. In addition, the user's current mood state can be inferred from the multimedia playback records in the car, such as frequent switching of songs, adjustment of volume and other operations, making the evaluation of the mood state value more comprehensive and accurate.

[0150] S403: Determine whether the fatigue driving value, the health status value, and the mood status value are all within preset thresholds.

[0151] If yes, execute step S402 to continue to obtain the fatigue driving value, health status value and mood status value of the current main driver; if no, execute step S404 to execute the early warning strategy.

[0152] S404. Execute early warning strategy.

[0153] When the fatigue driving value, health status value and mood status value are not within the preset thresholds, it means that the driving state of the current main driver is poor, and continuing to drive the vehicle will easily cause a traffic accident. At this time, the current main driver is prompted through voice that the current driving state is not suitable for continuing to drive the vehicle, and a command to turn on the hazard warning lights is sent to remind other vehicles to pay attention to avoid it.

[0154] Among them, the warning strategies include warning voice prompts and turning on hazard warning lights. The warning voice prompts are used to warn the current driver that the current state is not suitable for continuing to drive the vehicle.

[0155] S405: Calculate the driving state value of the current main driver.

[0156] Specifically, weights are set according to the degree of influence of the fatigue driving value, the health status value, and the mood status value on the driving status, and the driving status value of the current main driving user is obtained according to the weight calculation.

[0157] S406: Determine adjustment control instructions for the vehicle lamps based on the driving state value and the vehicle driving data.

[0158] Among them, the adjustment control instruction adjusts the driving status of the current main driver by adjusting the vehicle lighting.

[0159] Specifically, the difference between the current driving state value and the preset optimal driving state value is calculated. If the difference is large, it means that the user's current overall state is far from the ideal state. At this time, the adjustable brightness range of the interior lamps is determined in combination with the vehicle driving data to ensure that the adjusted brightness will not affect the user's driving. According to the brightness range, the brightness of the interior lamps is adjusted to the adjustable maximum brightness to enhance the user's alertness. At the same time, according to information such as the current vehicle speed, road environment (such as highways, ordinary urban roads, curves, etc.) in the vehicle driving data, the color of the vehicle lamps is adjusted accordingly. For example, when the vehicle speed is fast and it is on a highway section at night, the interior atmosphere lights are switched to a more eye-catching blue, and the visual stimulation of color is used to further remind the user to concentrate and drive carefully. In addition, the vehicle lamps can also be controlled to flash in a way to enhance the prompt effect on the user, so that the user's driving state is closer to the ideal state.

[0160] When the difference is at a medium level, it means that the user's state has deviated to a certain extent but is not very serious. At this time, the adjustable brightness range of the interior lights is determined in combination with the vehicle driving data to ensure that the adjusted brightness will not affect the user's driving. According to the brightness range, the brightness of the interior lights is appropriately brightened, such as increasing the brightness to a medium-high level in the adjustable range, and using moderately enhanced light to make the user's visual perception clearer, reducing the distraction that may be caused by poor condition. At the same time, the color tone of the vehicle-mounted lights is fine-tuned based on the road type, surrounding traffic conditions and other information in the vehicle driving data. For example, on ordinary roads with moderate traffic flow, the color of the ambient light can be adjusted to a warm orange, creating a relatively comfortable environment with a certain reminder effect, prompting users to better concentrate on driving tasks and bring the user's driving state closer to the ideal state.

[0161] If the difference is small, it means that the user's overall state is close to the optimal state. At this time, the adjustable brightness range of the interior lamps is determined in combination with the vehicle driving data to ensure that the adjusted brightness does not affect the user's driving. According to the brightness range, the brightness of the interior lamps is appropriately adjusted. For example, the brightness can be adjusted to a low level in the adjustable range. This can not only maintain a good visual experience in the interior environment, but also play a certain auxiliary reminder role to maintain a good state for the user.

[0162] S407: Send an adjustment control instruction to the vehicle-mounted lamp.

[0163] Determine whether the vehicle lamp corresponding to the adjustment control instruction is faulty. If faulty, make a replacement control plan, and send the replacement control instruction to the vehicle lamp according to the replacement control plan; if no faulty occurs, directly send the adjustment control instruction to the vehicle lamp.

[0164] In some embodiments, when an adjustment control instruction is sent to a vehicle lamp and a control instruction issued by a user is monitored at the same time, the control instruction issued by the user is executed first, and then the adjustment control instruction is updated according to the status of the vehicle lamp that has executed the user instruction, and then the adjustment control instruction is sent to the vehicle lamp.

[0165] In the embodiment of the present application, when it is detected that the driving state of the main driver is not suitable for continuing driving, the user is reminded through voice prompts, and the hazard warning lights are used to remind other vehicle drivers to pay attention to avoid, so as to avoid traffic accidents. At the same time, if there is no parking space around the current main driver or the user still insists on continuing to drive the vehicle, the vehicle-mounted lights are automatically adjusted according to the user's driving state and the vehicle's driving data, and the user's current driving state is adjusted by adjusting the vehicle-mounted lights, helping the user to concentrate on driving until the user's driving state returns to normal or the vehicle stops, thereby reducing the risk of traffic accidents.

[0166] In some special driving environments, such as driving in heavy rain or snow, users need to concentrate on observing the conditions of other objects around the vehicle, so they have no more energy to control the vehicle lights. At this time, users are prone to giving wrong instructions or missing instructions, and they cannot find out in the first time, which leads to a large gap between the actual lighting effect and the lighting effect expected by the user, increasing the risk of traffic accidents. In order to further reduce the risk of traffic accidents, in some embodiments, after executing Figure 3 In the illustrated embodiment, after step S301, the following steps S502-S506 may also be executed to automatically assist the user in controlling the vehicle-mounted lamps in special driving environments.

[0167] See also Figure 5 , is another flow chart of the method for automatic control of vehicle-mounted lamps in an embodiment of the present application.

[0168] S501: Obtain a user control instruction table of the current primary driver.

[0169] Step S501 and Figure 2 Step S201 in the illustrated embodiment is similar, and the description in step S201 may be referred to, which will not be repeated here.

[0170] S502: Acquire driving environment information from vehicle driving data of the current main driver.

[0171] Acquire the driving environment information from the vehicle driving data of the current main driver in real time.

[0172] S503: Determine the driving risk level according to the weather conditions outside the vehicle in the driving environment information.

[0173] Among them, driving risk levels include low risk level and high risk level.

[0174] Specifically, if the weather condition is sunny, cloudy or light rain, which does not affect normal driving operations, the driving risk level is determined to be a low risk level; if the weather condition is heavy rain, heavy snow or strong wind, which seriously affects normal driving operations, the driving risk level is determined to be a high risk level.

[0175] S504: Determine whether the driving risk level is a high risk level.

[0176] If the driving risk level is a high risk level, execute step S505; if the driving risk level is not a high risk level, execute step S502 to continue to obtain the driving environment information in the vehicle driving data of the current main driver.

[0177] S505: Based on the vehicle driving data and historical vehicle driving data, predict the vehicle lighting adjustment plan of the current main driver.

[0178] Among them, the vehicle-mounted lighting adjustment plan includes the predicted adjustment location and its corresponding predicted adjustment instructions.

[0179] Specifically, the driving route and destination in the vehicle driving data are obtained, and based on the historical vehicle driving data, the specific adjustment operations of the vehicle lighting by the current main driver at the same or similar driving route and destination in the past are checked. For example, I have passed a winding mountain road with multiple continuous bends to the same destination many times before. Each time before entering the bend, I would fine-tune the illumination direction of the exterior headlights in advance so that they rotate with the angle of the bend, and the interior ambient lights are also appropriately brightened to increase alertness. Then, the next time you drive on this route to the destination, when you approach these bends, you can accurately use the bends as the predicted adjustment locations based on historical habits, and the corresponding predicted adjustment instructions will also adjust the illumination direction of the exterior headlights and brighten the ambient lights as before, ensuring driving safety and comfort.

[0180] S506: When the current main driver user does not detect a prediction adjustment instruction corresponding to the prediction adjustment location before the vehicle arrives at the prediction adjustment location, the prediction adjustment instruction corresponding to the prediction adjustment location is sent to the vehicle-mounted lamp.

[0181] When the vehicle arrives at the predicted adjustment location and no predicted adjustment instruction corresponding to the predicted adjustment location is detected by the current main driver, it is determined whether the vehicle lamp corresponding to the predicted adjustment instruction is faulty. If a fault occurs, a replacement control plan is prepared, and the replacement control instruction is sent to the vehicle lamp according to the replacement control plan; if no fault occurs, the predicted adjustment instruction is directly sent to the vehicle lamp.

[0182] Specifically, the vehicle's location information is obtained in real time through the vehicle's positioning device, and the vehicle's current location is compared with the previously predicted adjustment location to clarify the distance relationship between the two.

[0183] When it is determined that the vehicle is approaching the predicted adjustment location, the current main driver is continuously monitored to see whether he has issued the corresponding adjustment command. If the user has not issued the predicted adjustment command corresponding to the predicted adjustment location before the vehicle arrives at the predicted adjustment location, the vehicle lighting automation control system will determine whether the vehicle lighting corresponding to the predicted adjustment command has a fault according to the pre-set predicted adjustment command corresponding to the predicted adjustment location. If a fault occurs, a replacement control plan is prepared, and the replacement control command is sent to the vehicle lighting according to the replacement control plan; if no fault occurs, the predicted adjustment command is directly sent to the vehicle lighting.

[0184] In some embodiments, since the predicted vehicle lighting adjustment scheme is different from the adjustment operation required during actual driving, in order to more accurately adjust the vehicle lighting to suit the actual driving conditions, the predicted adjustment instructions can be adaptively adjusted in real time in combination with the vehicle driving data.

[0185] In an embodiment of the present application, in some special driving environments, even if the current main driver issues an erroneous instruction or misses an instruction, the system can automatically operate according to the predictive adjustment plan at the appropriate time to maintain a good driving lighting environment, reduce driving risks caused by problems such as uncomfortable lighting, and improve overall driving safety and driving experience.

[0186] The above describes the automatic control method of the vehicle lamp in the embodiment of the present application. The following describes in detail the automatic control system of the vehicle lamp in the embodiment of the present application in combination with the above-mentioned automatic control method of the vehicle lamp.

[0187] See also Figure 6 , which is a schematic diagram of an exemplary hardware structure of a vehicle-mounted lighting automation control system in an embodiment of the present application.

[0188] In some embodiments, the vehicle-mounted lamp automatic control system 600 includes a computer device, which can be a terminal device. The computer device includes a processor 601, a memory 602, a sensor module 603, a communication module 604, an input device 605 and an output device 606 connected through a system bus. Among them, the processor 601 of the computer device is used to provide computing and control capabilities. The memory 602 of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database is used to store data. The sensor module 603 of the computer device is used to collect data such as the light intensity and vehicle speed of the vehicle-mounted lamp. The communication module 604 of the computer device is used to send control instructions to the vehicle-mounted lamp. The input device 605 of the computer device is used to receive control instructions issued by the user. The output device 606 of the computer device is used to output voice prompt information. When the computer program is executed by the processor 601, the vehicle-mounted lamp automatic control method in the embodiment of the present application is implemented.

[0189] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0190] In some embodiments of the present application, a computer-readable storage medium is provided, including instructions. When the instructions are executed on the vehicle-mounted lighting automation control system 600, the vehicle-mounted lighting automation control system 600 can execute the vehicle-mounted lighting automation control method in the embodiments of the present application.

[0191] In some embodiments of the present application, a computer program product is also provided. When the computer program product runs on the vehicle lighting automation control system 600, the vehicle lighting automation control system 600 executes the vehicle lighting automation control method in the embodiments of the present application.

[0192] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0193] As used in the above embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0194] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0195] Those skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.

Claims

1. A method for automatically controlling a vehicle-mounted lamp, characterized in that: include: Get the user control command table of the current main driver; The user control instruction table includes user control instructions and corresponding instruction contents; The user control command is used to control the vehicle-mounted lamp; When a first user control instruction of the current main driver is detected, determining a first instruction content corresponding to the first control instruction based on the user control instruction table; In the case that a target vehicle lamp corresponding to the first instruction content fails, determining a target fault level of the target vehicle lamp; The target vehicle lamp is at least one of the vehicle lamps; the target fault level includes level one and level two, level one means that the lamp cannot light up at all, and level two means that the lamp can light up but the brightness is not enough to reach the brightness in the first instruction content; Determining the brightness range of the target vehicle lamp according to the target fault level; Inputting the first control instruction content, the target vehicle lamp and the brightness range of the target vehicle lamp into a vehicle simulation model to obtain one or more simulated control schemes and their corresponding lighting effect similarities; the vehicle simulation model can simulate the lighting effects of different control schemes of the vehicle in a real environment, and calculate the similarity between the simulated lighting effect and the lighting effect of the first control instruction content; In the case where there is a simulation control scheme whose lighting effect similarity is higher than a preset similarity threshold, selecting the simulation control scheme with the highest lighting effect similarity as a replacement control scheme; According to the replacement control scheme, a replacement control instruction is sent to the vehicle-mounted lamp.

2. The method according to claim 1, characterized in that After the step of obtaining the user control instruction table of the current main driver, the method further includes: When the interaction data between the current main driving user and the vehicle-mounted lamp is monitored, the control mode of the control command issued by the current main driving user is determined based on the interaction data; the interaction data includes the control command issued by the current main driving user and the corresponding second command content, and the control mode of issuing the control command; the control mode includes clicking the touch screen, voice command control and gesture command control; When the control mode is the clicking of the touch screen, based on the driving behavior of the user within the preset time range before and after the time corresponding to the time when the current main driving user issues the instruction, the second user control instruction of the current main driving user is obtained through the behavior analysis module; the second user control instruction includes a voice instruction and a gesture instruction; storing the second user control instruction and the second instruction content in the user control instruction table; When the control mode is the voice command control or the gesture command control, determining whether the current main driver continues to adjust the lighting effect of the vehicle-mounted lamp by clicking the touch screen after the vehicle-mounted lamp executes the control command; If so, the user control instruction table is updated based on the voice instructions in the voice command control or the gesture instructions in the gesture command control and the third instruction content; the third instruction content is the operation that the vehicle lamp needs to perform to achieve the lighting effect adjusted by the current main driver user.

3. The method according to claim 1, characterized in that After the step of determining, based on the user control instruction table, a first instruction content corresponding to the first control instruction when the first user control instruction of the current main driver is monitored, the method further includes: Based on the content of the first instruction, determining whether the first user control instruction is an adjustment instruction; the adjustment instruction is used to adjust the brightness or lighting angle of the vehicle-mounted lamp; If yes, obtain the vehicle driving data of the current main driver; the vehicle driving data includes driving environment information, driving speed, driving route, driving destination, and working status of the vehicle-mounted lamps; the driving environment information includes the light intensity inside and outside the vehicle, the weather conditions outside the vehicle, and other object information around the vehicle; the other object information includes the location information of other vehicles, pedestrians, and obstacles; Determining the adjustment parameter value of the vehicle lamp according to the vehicle driving data and the vehicle lamp adjustment habit of the current main driving user; the vehicle lamp adjustment habit is obtained according to the historical vehicle driving data of the current main driving user, including the lighting brightness adjustment habit and the lighting angle adjustment habit; The first instruction content is updated based on the adjustment parameter value and the first instruction content.

4. The method according to claim 1, characterized in that: After the step of obtaining the user control instruction table of the current main driver, the method further includes: Obtaining the fatigue driving value, health status value and mood status value of the current main driver; Determining whether the fatigue driving value, the health status value, and the mood status value are all within preset thresholds; If not, the warning strategy is executed; the warning strategy includes a warning voice prompt and turning on the hazard warning lights; the warning voice prompt is used to warn the current main driver that the current state is not suitable for continuing to drive the vehicle.

5. The method according to claim 4, characterized in that After the step of executing the early warning strategy if no, the method further comprises: Calculate the driving state value of the current main driver based on the fatigue driving value, the health state value and the mood state value; Based on the driving state value and the vehicle driving data, determining an adjustment control instruction of the vehicle-mounted lamp; the adjustment control instruction adjusts the driving state of the current main driving user by adjusting the vehicle-mounted lamp; The adjustment control instruction is sent to the vehicle-mounted lamp.

6. The method according to claim 1, characterized in that After the step of obtaining the user control instruction table of the current main driver, the method further includes: Acquire driving environment information from vehicle driving data of the current main driver; Determine a driving risk level according to the weather conditions outside the vehicle in the driving environment information; the driving risk level includes a low risk level and a high risk level; When the driving risk level is a high risk level, based on the vehicle driving data and historical vehicle driving data, predicting the vehicle lamp adjustment plan of the current main driver; the vehicle lamp adjustment plan includes a predicted adjustment location and its corresponding predicted adjustment instruction; When the current main driver is not detected to have issued the predicted adjustment instruction corresponding to the predicted adjustment location before the vehicle arrives at the predicted adjustment location, the predicted adjustment instruction corresponding to the predicted adjustment location is sent to the vehicle-mounted lamp.

7. The method according to claim 1, characterized in that After the step of determining, based on the user control instruction table, a first instruction content corresponding to the first control instruction when the first user control instruction of the current main driver is monitored, the method further includes: updating the frequency of erroneous control instructions and missed control instructions issued by the current main driver according to the vehicle driving data and the first instruction content; Determining whether the frequency of the current main driver user issuing erroneous control instructions and missing control instructions exceeds a preset frequency; If yes, then in the case that the first user control instruction issued by the current main driving user is wrong, a voice prompt is given to the current main driving user; the voice prompt content includes the correct control instruction and the reason for issuing the instruction; According to the correct control instruction, the first instruction content is updated.

8. An automatic control system for vehicle-mounted lamps, characterized in that: It includes vehicle-mounted lamps, sensors, cameras, microphones, speakers, and a vehicle controller, wherein the vehicle controller includes: one or more processors and memories; The memory is coupled to the one or more processors, and the memory is used to store computer program codes, wherein the computer program codes include computer instructions, and the one or more processors call the computer instructions to enable the vehicle-mounted lighting automation control system to execute the method as described in any one of claims 1-7.

9. A computer-readable storage medium storing computer instructions, characterized in that: When the computer instructions are executed on the vehicle-mounted lighting automation control system, the vehicle-mounted lighting automation control system executes the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is run on a vehicle-mounted lighting automation control system, the vehicle-mounted lighting automation control system is enabled to execute the method according to any one of claims 1 to 7.

Images