Control method and device of information display module and electronic equipment

Abstract

The invention discloses a control method and device of an information display module and electronic equipment, and belongs to the technical field of vehicles. The method is applied to a vehicle, and a plurality of tail lamps with different functions and an information display module for displaying interaction prompt information in real time are arranged at the tail of the vehicle. Specifically, the method comprises the following steps: acquiring driver state information, vehicle state information and vehicle environment information corresponding to a first vehicle; inputting the driver state information, the vehicle state information and the vehicle environment information into a target multi-modal model to generate first interaction information; and based on the first interaction information, controlling an information display module to display the interaction prompt information in real time. According to the technical characteristics disclosed by the invention, the interaction prompt information can be automatically displayed to the rear vehicle in real time according to the driver state information, the vehicle state information and the vehicle environment information, so that the control flexibility and scene adaptability of the information display module are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a control method and device of an information display module and an electronic device. BACKGROUND

[0002] The automobile tail light is a safety signal device carried on the vehicle, which can interact with other vehicles. It is mainly used to realize the basic functions of warning and reminding. The traditional tail light includes rear position light, brake light, turn signal light, etc. With the development of automobile intelligence, some vehicles have added intelligent tail light display devices, which can display beautiful patterns or preset text information to enrich the vehicle interaction mode.

[0003] However, in the related art, the display content of the intelligent tail light is essentially preset content, whether it is a fixed car sticker text or a condition-triggered prompt, there is a defect that the scene coverage is limited, which cannot adapt to complex and variable driving environments, and cannot automatically generate interactive prompt information through the vehicle tail light according to different scenes. SUMMARY

[0004] The present application provides a control method and device of an information display module and an electronic device, which aims to solve the problem of lack of flexibility and scene adaptability in triggering and controlling the vehicle tail light.

[0005] In a first aspect, a control method of an information display module is provided, which is applied to a vehicle. The tail of the vehicle is provided with a plurality of tail lights with different functions, and an information display module for real-time display of interactive prompt information. The method comprises the following steps: Obtaining driver state information, vehicle state information and vehicle environment information corresponding to a first vehicle; Inputting the driver state information, vehicle state information and vehicle environment information into a target multi-modal model to generate first interactive information; Based on the first interactive information, controlling the information display module to real-time display the interactive prompt information.

[0006] In some embodiments, the information display module is a dot matrix tail light; the interactive prompt information includes at least one of dot matrix text information and dot matrix symbol information; Based on the first interactive information, controlling the information display module to real-time display the interactive prompt information, comprising: Vector converting the first interactive information to obtain dot matrix control instructions; Based on the dot matrix control instructions, controlling the information display module to real-time display the dot matrix text information and / or the dot matrix symbol information.

[0007] In some embodiments, vector converting the first interactive information to obtain dot matrix control instructions comprises: Obtain the vector conversion database and the display resolution of the dot matrix taillights; the vector conversion database includes at least one of text, numbers, and symbols, and the conversion mapping relationship between them and the dot matrix data; Based on the transformation mapping relationship and display resolution, the first interactive information is vectorized to obtain dot matrix control instructions.

[0008] In some embodiments, the method further includes: A taillight trigger command is generated based on the first interactive information, so that while the information display module displays interactive prompt information in real time, at least one of the multiple taillights is triggered based on the taillight trigger command.

[0009] In some embodiments, the information display module is a dot matrix taillight, which has multiple trigger modes. The method further includes: Adjust the trigger mode of the dot matrix taillights based on vehicle environment information.

[0010] In some embodiments, after the control information display module displays interactive prompts in real time based on the first interactive information, the method includes: Obtain the vehicle driving information corresponding to the second vehicle; Vehicle driving information is input into the target multimodal model to generate second interactive information; Based on the second interactive information, the control information display module updates and displays interactive prompts in real time.

[0011] In some embodiments, driver state information, vehicle state information, and vehicle environment information are input into a target multimodal model to generate first interaction information, including: Based on a preset structured template, driver status information, vehicle status information, and vehicle environment information are processed in a structured manner to obtain structured statement information. The structured statement information is input into the target multimodal model to generate the first interaction information.

[0012] Secondly, a control device for an information display module is also provided, applied to a vehicle. The vehicle has multiple taillights with different functions at its rear, and an information display module for real-time display of interactive prompts. The device includes: The information acquisition module is used to acquire driver status information, vehicle status information, and vehicle environment information corresponding to the first vehicle. The signal generation module is used to generate the first interaction information by taking the input target multimodal model from the driver status information, vehicle status information and vehicle environment information. The module control module is used to control the information display module to display interactive prompts in real time based on the first interactive information.

[0013] Thirdly, an electronic device is provided, comprising a processor and a memory for storing processor-executable instructions, wherein the processor executes the instructions to implement the steps of the control method for the information display module of any of the above embodiments.

[0014] Fourthly, a computer-readable storage medium is provided, on which a computer program is stored, the computer program being loaded by a processor to execute the steps of the control method for the information display module of any of the above embodiments.

[0015] The beneficial effects of this application include: By integrating multi-dimensional data on driver status, vehicle status, and surrounding environment, and in conjunction with a target multimodal model to generate the first interactive information, it can adapt to various driving scenarios such as normal driving, congestion warning, and emergency braking. It also enables the information display module to automatically generate corresponding interactive prompts without manual intervention, providing comprehensive scenario coverage and strong real-time performance. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a flowchart illustrating the control method for the information display module provided in an exemplary embodiment of this application; Figure 2 This is a flowchart illustrating the prompt information provided in an exemplary embodiment of this application. Figure 3 This is an example diagram illustrating the display of interactive prompts by an information display module provided in an exemplary embodiment of this application; Figure 4 This is a schematic diagram of the structure of the control device for the information display module provided in an exemplary embodiment of this application; Figure 5 This is a schematic diagram of the structure of the electronic device provided in an exemplary embodiment of this application. Detailed Implementation

[0018] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0019] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the stated features. In the description of this application, "multiple" means two or more, unless otherwise explicitly specified.

[0020] "A and / or B" includes the following three combinations: A only, B only, and a combination of A and B.

[0021] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0022] Automotive taillights are an indispensable safety component during vehicle operation, primarily used to provide basic functions such as warning and alerting. Traditional taillights typically include rear position lights, brake lights, turn signals, rear fog lights, and reversing lights, and are triggered manually by the user inside the vehicle. For example, the brake lights are activated by the driver pressing the brake pedal.

[0023] With the development of automotive intelligence, some vehicles have added smart taillight display devices that can display dazzling patterns or pre-set text information to enrich rear-end interaction. However, the content displayed by smart taillights in these technologies is essentially all pre-set, resulting in limited scenario coverage and an inability to adapt to complex and ever-changing driving environments. For example, when encountering unforeseen scenarios such as sudden road accidents, severe weather (heavy rain, dense fog), or abnormal driver behavior, the smart taillights in these technologies cannot generate interactive information corresponding to the driving scenario in real time.

[0024] Furthermore, although some smart taillights exist that allow manual editing of the dot-matrix taillight display content via mobile devices for personalized adjustments, this process still relies on manual input or drawing by the driver. It cannot achieve automatic generation without human intervention, and the edited content is unrelated to the real-time driving environment, vehicle status, and driver status. This results in insufficient real-time interaction and accuracy, failing to meet the safety interaction needs in complex driving scenarios.

[0025] In this application, by acquiring driver status information, vehicle status information, and vehicle environment information during vehicle operation, and combining this with a target multimodal model to generate first interactive information, it can adapt to various driving scenarios such as normal driving, congestion warning, and emergency braking. Based on the first interactive information, the automated control information display module automatically generates corresponding interactive prompts without manual intervention, providing comprehensive scenario coverage and strong real-time performance.

[0026] On one hand, this application provides a control method for an information display module, which can be applied to a vehicle. The vehicle has multiple taillights with different functions at its rear, and an information display module for displaying interactive prompts in real time. The execution entity of this control method for the information display module can be a vehicle-mounted in-vehicle processor or any other terminal capable of implementing the control method for the information display module. Figure 1 As shown, a control method for an information display module may specifically include the following steps: Step S101: Obtain the driver status information, vehicle status information, and vehicle environment information corresponding to the first vehicle.

[0027] In some embodiments, the first vehicle may be a self-driving vehicle. Driver status information, vehicle status information, and vehicle environment information can be acquired in real time at every moment to ensure that the generation of interactive prompts is scene-appropriate and real-time. When the first vehicle is in a stable driving state, driver status information, vehicle status information, and vehicle environment information can also be acquired based on a preset period, thereby ensuring scene-appropriateness of interactive prompts while reducing computational load. A stable driving state can refer to the first vehicle traveling at a uniform speed for a period of time without lane changes, acceleration, deceleration, or other changes.

[0028] Specifically, driver status information is used to infer the driver's level of concentration, fatigue, or emotional fluctuations. Multiple sensors can be pre-installed in the vehicle to achieve real-time, non-contact detection of the driver's status. For example, a camera facing the driver can be installed in the driver's seat, sound sensors can be installed in the cabin, and grip force sensors can be installed on the steering wheel. The driver's current status is then assessed and driver status information is generated. Monitoring and assessment indicators can include at least: gaze direction, to determine if the driver's gaze has been deviating from the road for an extended period; eye condition, such as blinking frequency and eyelid closure duration to assess fatigue; driver head posture; steering wheel grip strength; and the tone of voice of people inside the vehicle.

[0029] In a specific embodiment, the driver's status information at the current moment or in the current driving scenario can be determined through the aforementioned monitoring and evaluation indicators. For example, if frequent head turns are detected, it can be determined that there is a dangerous driving situation, and the driver's status information can be "The driver's head posture changes frequently, and there is currently a dangerous driving situation." Or, if facial feature analysis detects that the driver is yawning or has shifty eyes, it can be determined that there is fatigue driving, and the driver's status information can be "There is currently fatigue driving." This module is an automated and real-time source of "the driver's own status," requiring no manual input whatsoever. Or, if voice tone analysis detects that the driver is emotionally agitated, which may lead to aggressive driving, the driver's status information can be "Aggressive driving may occur."

[0030] In other embodiments, for vehicles equipped with sound sensors, driver status information may also include occupant attribute information and emergency situation information. Occupant attribute information may include elderly people, children, pregnant women, and other persons with disabilities. Emergency situation information may indicate physical discomfort among occupants. Specifically, if the sound of an infant crying in the cabin is detected, indicating that the vehicle may contain children, the generated driver status information will include occupant attribute information in addition to the driving situation. For example, driver status information could be: "Currently experiencing fatigue while driving; there is a child in the vehicle." When driver voice information and / or voice information from other occupants is detected, indicating that there is a person in the vehicle experiencing physical discomfort requiring immediate medical attention, driver status information could be: "Occupants in the vehicle require medical attention."

[0031] Vehicle status information, used to represent the signal status of the vehicle control system and its various controllers, can be obtained in real time from the vehicle's CAN bus. For example, obtaining the brake pedal opening and deceleration value can generate vehicle status information such as "rapid deceleration / emergency braking." Key monitoring parameters can include at least: current vehicle speed, longitudinal acceleration / deceleration (especially during rapid acceleration or deceleration), lateral acceleration reflecting the intensity of turning or lane changing, turn signal switch status, brake pedal depth, gear information, and hazard warning light status.

[0032] For vehicle environmental information, sensors such as front-view cameras, rear-view cameras, side-view cameras, and millimeter-wave radar can be used to collect information about the vehicle's surroundings in real time and continuously. For example, the front-view camera can identify the type of vehicle ahead, pedestrians, traffic signs, lane lines, and congestion conditions; the rear-view camera can identify the model / brand of vehicles following behind, the distance between vehicles, and the relative speed.

[0033] Specifically, the road conditions identified by the forward-facing camera include, but are not limited to, traffic participants (vehicles, pedestrians, non-motorized vehicles), traffic light status, road obstacles, traffic signs (speed limits, construction, school zones), and weather conditions (rain, snow, fog).

[0034] The features of following vehicles identified by the rearview camera can include vehicle type (truck, car, special vehicle), brand logo, relative distance and speed, as well as the driving behavior of the following vehicle (such as frequent lane changes, following too closely).

[0035] Radar data can be used for precise distance and speed measurement, especially in adverse weather or at night to supplement the limitations of visual sensors. For example, it can receive V2X feedback data from vehicles behind in real time, and then adjust the brightness, frequency, and shape of the information display module to optimize the interactive experience.

[0036] Vehicle environmental information is generated by extracting elements from the vehicle's surroundings. For example, if the surrounding information includes a minor obstacle in front, a speed limit sign, a vehicle of brand A behind, and the distance between the two vehicles is less than 50 meters, the generated vehicle environmental information could be "minor obstacle, speed limit sign, brand A, too close distance".

[0037] Step S102: Input the driver status information, vehicle status information, and vehicle environment information into the target multimodal model to generate the first interaction information.

[0038] In one specific embodiment, the aforementioned target multimodal model can be an AIGC (Artificial Intelligence Generated Content) multimodal large model. An AIGC model is an artificial intelligence model capable of processing multiple types of data and automatically generating target content to generate first interactive information based on input driver state information, vehicle state information, and vehicle environment information.

[0039] The first interactive information appears in the form of natural language, such as text and symbols. The number of characters and symbols is limited by the physical size of the information display module. Typically, the text information can be set to no more than 20 characters to ensure conciseness and readability.

[0040] Specifically, step S102 involves inputting driver state information, vehicle state information, and vehicle environment information into the target multimodal model to generate the first interaction information, including: Based on a preset structured template, driver status information, vehicle status information, and vehicle environment information are processed in a structured manner to obtain structured statement information. The structured statement information is input into the target multimodal model to generate the first interaction information.

[0041] In some embodiments, before inputting driver status information, vehicle status information, and vehicle environment information into the target multimodal model, this information needs to be structured so that the data input into the target multimodal model each time has the same format, thereby facilitating model recognition and processing and improving the convenience and accuracy of generating the first interaction information.

[0042] The preset structured templates are usually pre-defined. They can also be adaptively modified within the preset framework according to user needs. For example, a preset structured template could be "Current Scene: {Environment Description}, Own Vehicle is {Vehicle Status Description}, Front Vehicle is {Vehicle Status Description}, Rear Vehicle is {Vehicle Status Description}, Driver May be {Driver Status Description}".

[0043] Specifically, driver status information, vehicle status information, and vehicle environment information all include multiple elements. For example, if the driver status information is "potentially fatigued driving," then fatigued driving can be considered an element. Or, for example, if the vehicle environment information is "an obstacle obstructing passage is present ahead, and the obstacle is continuously moving," then a dynamic obstacle can be considered an element. Therefore, it can be considered that extracting elements from the above information for driver status information, vehicle status information, and vehicle environment information involves integrating the extracted elements into structured statement information based on a preset structured template. The environment description corresponds to the element extraction result of vehicle environment information, the vehicle status description corresponds to the element extraction result of vehicle status information, and the driver status description corresponds to the element extraction result of driver status information.

[0044] Furthermore, since vehicle environment information can also include information such as the vehicle's speed and the speeds and distances of vehicles in front and behind, the preset structured template can also include information corresponding to the vehicles in front and behind. For example, elements extracted based on vehicle environment information may also include the speed of the vehicle in front and the distance to the vehicle behind.

[0045] In a specific embodiment, role identities, task descriptions, rules, and constraints can be pre-defined for the target multimodal model, enabling it to output compliant first interactive information based on structured statement information. For example, the role identity could be a vehicle safety communication assistant, the task description could be generating a short prompt for the driver of the following vehicle, and the rules and constraints could be user-friendly, prioritize safety warnings, limit the number of Chinese characters to no more than x, and avoid ambiguity. In this case, the structured statement information serves as the input information for the current scenario, and the first interactive information is generated based on this input information, along with the role identity, task description, rules, and constraints.

[0046] Step S103: Based on the first interactive information, control the information display module to display interactive prompts in real time.

[0047] In some embodiments, the information display module can be a dot-matrix taillight, such as a dot-matrix LED light. The interactive prompt information includes at least one of dot-matrix text information and dot-matrix symbol information, corresponding to the first interactive information. When the first interactive information is text information, the interactive prompt information is dot-matrix text information; when the first interactive information is symbol information, the interactive prompt information is dot-matrix symbol information. Based on this, please refer to... Figure 2 Step S103 may include: Step S201: Perform vector conversion on the first interactive information to obtain dot matrix control commands; Step S202: Based on the dot matrix control command, the control information display module displays dot matrix text information and / or dot matrix symbol information in real time.

[0048] In some embodiments, since the first interactive information is text information and the information display module is a dot matrix taillight with multiple LED beads, the first interactive information needs to be converted into dot matrix information to adapt to the information display module. The dot matrix control command is used to control the lighting and extinguishing of multiple LED beads in the dot matrix taillight, so that the dot matrix taillight can display interactive prompt information based on the dot matrix control command.

[0049] Specifically, step S201 includes: Obtain the vector conversion database and the display resolution of the dot matrix taillights; the vector conversion database includes at least one of text, numbers, and symbols, and the conversion mapping relationship between them and the dot matrix data; Based on the transformation mapping relationship and display resolution, the first interactive information is vectorized to obtain dot matrix control instructions.

[0050] In some embodiments, the vector conversion database stores conversion mapping relationships between commonly used Chinese characters, numbers, symbols, and dot matrix data. Based on these mapping relationships, text information and symbol information can be converted into dot matrix text information and dot matrix symbol information adapted to dot matrix taillights. Furthermore, since the resolution of the dot matrix taillights also affects the display effect of the dot matrix data, the display resolution of the dot matrix taillights must be considered when performing vector conversion on the first interactive information to ensure that the dot matrix text information and dot matrix symbol information generated based on dot matrix control commands are clearly distinguishable.

[0051] In other embodiments, the control method for the information display module further includes: generating a taillight trigger command based on the first interactive information, so that while the information display module displays interactive prompt information in real time, at least one of the multiple taillights is triggered based on the taillight trigger command.

[0052] Specifically, since the rear of the vehicle is equipped with multiple taillights with different functions, such as side marker lights, turn signals, and brake lights, at least one of these taillights can be triggered synchronously or asynchronously with the information display device. The taillight trigger command is used to activate at least one of the multiple taillights with different functions.

[0053] For example, when the interactive prompt message displayed on the information display device is "There is a minor obstacle ahead, this vehicle should brake to avoid it," the brake lights can be activated simultaneously. That is, the taillight trigger command generated based on the first interactive information is used to simultaneously trigger the brake lights to illuminate.

[0054] Alternatively, when the interactive prompt message is "This vehicle will turn right in 500m," the right turn signal can be triggered asynchronously. That is, the interactive prompt message is first displayed on the information display device, and the right turn signal is triggered when the first vehicle turns left. In other words, the taillight trigger command generated based on the first interactive information is used to asynchronously or with a delay to trigger the turn signal to illuminate.

[0055] By generating taillight trigger commands based on the first interaction information, traditional taillights (position lights, turn signals, and brake lights) can be automatically activated without user intervention, thereby improving driving safety. Specifically, this embodiment allows other vehicles to promptly notice changes in the vehicle's driving status. On one hand, it can prevent accidents caused by improper driving, such as frequent lane changes without manual turn signal activation leading to rear-end collisions. On the other hand, as a redundancy feature, it also prevents following vehicles from being unable to promptly execute the vehicle's driving status due to malfunctions in related control mechanisms, such as a turn signal lever failure preventing manual activation of the turn signals.

[0056] In other embodiments, as another conventional taillight triggering method, a preset prompt message-taillight triggering mapping table can be used. This mapping table can include the mapping relationship between preset prompt messages and a certain type of taillight, as well as at least one of the corresponding taillight flashing frequency and brightness intensity. When the generated interactive prompt message matches the preset prompt message in the mapping table by more than 80%, a taillight triggering command can be generated based on the mapping relationship, flashing frequency, and brightness intensity. For example, when the interactive prompt message is "Sorry for the slightly sudden braking," the brake lights can be simultaneously flashed once more at a gentle frequency. In this case, the taillight triggering command is: brake lights, gentle frequency, flash once. Alternatively, when the interactive prompt message is a warning message "Please maintain a safe distance," the rear fog lights or side marker lights can be simultaneously illuminated at a high brightness to attract the attention of following vehicles. The triggering command is: rear fog lights (or side marker lights), high brightness.

[0057] In other embodiments, the matrix taillights can be configured to have multiple trigger modes. The control method for the information display module further includes adjusting the trigger mode of the matrix taillights based on vehicle environmental information.

[0058] Specifically, the trigger mode can be set according to the illumination intensity of the matrix taillights. For example, the trigger mode can include strong brightness, bright brightness, and weak brightness. Vehicle environment information can also include ambient light intensity information, and the trigger mode of the matrix taillights can be adaptively adjusted based on the ambient light intensity information to ensure that interactive prompts are clearly visible. For example, when the ambient light is strong, the trigger mode can be adjusted to strong brightness.

[0059] By dynamically adjusting the number and brightness of LED beads based on ambient brightness and interaction requirements, the system can prioritize low-energy LED bead combinations while ensuring the flexibility and diversity of interactive prompts, thus achieving energy savings without affecting the interactive effect.

[0060] In other embodiments, after the control information display module displays interactive prompts in real time based on the first interactive information, the method includes: Obtain the vehicle driving information corresponding to the second vehicle; Vehicle driving information is input into the target multimodal model to generate second interactive information; Based on the second interactive information, the control information display module updates and displays interactive prompts in real time.

[0061] Specifically, the second vehicle is the vehicle traveling behind the first vehicle. When both vehicles are traveling in the same direction, the direction of travel is taken as the forward direction, and the vehicle located behind the first vehicle is the second vehicle. The vehicle's driving information can be included in the vehicle environment information obtained in step S101, or it can be obtained a second time through the millimeter-wave radar of the first vehicle.

[0062] When the intent of the interactive prompt is to remind the following vehicle to adjust its driving status, the interactive prompt can be updated in real time based on the following vehicle's driving information. For example, the intent of the interactive prompt is to remind the following vehicle that the distance is too close and a safe driving distance needs to be increased. After displaying this interactive prompt to the second vehicle, the second vehicle's driving information (specifically, its speed information) can be retrieved again, and based on the speed information, it can be determined whether the second vehicle should make adjustments such as slowing down to ensure a safe driving distance. Based on the determination result, the interactive prompt is updated in real time and displayed to the second vehicle. Alternatively, if the interactive information still has the same intent, the second vehicle's driving information (specifically, the distance information between the first and second vehicles) can be retrieved again, and based on the distance information, it can be determined whether the second vehicle should make adjustments such as slowing down to ensure a safe driving distance. Based on the determination result, the interactive prompt is updated in real time and displayed to the second vehicle.

[0063] Specifically, if the second vehicle makes adjustments and restores the safe driving distance to a safe value, the interactive prompt message can be updated to express gratitude to the second vehicle in a friendly manner. If the second vehicle makes adjustments but does not restore the safe driving distance to a safe value, the interactive prompt message can be updated to express a friendly desire for the second vehicle to make further adjustments. If the second vehicle does not make any adjustments, the interactive prompt message can be updated to express a friendly desire for the second vehicle to cooperate and make adjustments in a timely manner.

[0064] By adjusting and updating interactive prompts in real time based on the driving information of vehicles behind, the interactive prompts can be made more suitable for the current scenario, thereby improving driving safety.

[0065] Furthermore, the embodiments described in this application are exemplary, and the specific forms and expressive intentions of the interactive prompts are not described in detail. Based on the embodiments of this application, the specific forms of the interactive prompts can be further diversified. For example, in addition to dot-matrix text information and dot-matrix symbol information, they can also include emoticons formed from dot-matrix data. The expressive intentions of the interactive prompts can also be further diversified. For example, in addition to reminding following vehicles to drive safely and indicating changes in the driving status of the following vehicle, they can also include various personalized interactions with following vehicles, such as greeting the following vehicle or outputting... Figure 3 The interactive prompt message shown is: "Hello, owner of brand X vehicle".

[0066] In some embodiments, an exemplary operating environment is provided for the control method of the information display module disclosed in this application as follows: The in-vehicle intelligent cockpit can use the QAM8797 as the main control SOC (System on Chip). The QNX system runs on the main control SOC as a foundation and handles hardware drivers. A virtual machine runs within the QNX system and boots the Android system from within the virtual machine. The target multimodal model runs on the TPU (tensor processing unit) core of the main control SOC and is booted via the QNX system.

[0067] The control method for the information display module provided in this application can achieve the following technical effects: First, this application comprehensively collects driving-related data (driver status information, vehicle status information, and vehicle environment information), and combines it with the dynamic reasoning and generation capabilities of the AIGC large model. It can adapt to various scenarios such as normal driving, congestion warning, emergency braking, and special weather, and automatically generate corresponding interactive information without manual intervention. The scenario coverage is comprehensive and the real-time performance is strong.

[0068] Secondly, this application collects vehicle environmental data, including data on the vehicles in front and behind, thus enabling automatic identification of potential risks such as following too closely and proactively generating interactive prompts to the following vehicles, thereby improving driving safety. Simultaneously, this application incorporates driver status information, enabling timely identification of unsafe driving states such as dangerous driving, fatigued driving, and aggressive driving, and displaying relevant interactive prompts to the following vehicles, further enhancing driving safety.

[0069] Finally, in this application, the entire process of generating interactive prompts requires no manual input or editing by the driver. It is based entirely on the collected information to automatically complete perception, decision-making, generation, and display. This not only reduces the safety hazard of distracted driving due to operating the taillights, but also ensures the scene adaptability and real-time performance of the interactive prompts to the driving scenario.

[0070] On the other hand, this application also proposes a control device for an information display module, applied to a vehicle. The vehicle has multiple taillights with different functions at its rear, and an information display module for displaying interactive prompts in real time. Please refer to [link to relevant documentation]. Figure 4 The control device for the information display module includes: The information acquisition module 410 is used to acquire driver status information, vehicle status information and vehicle environment information corresponding to the first vehicle; The signal generation module 420 is used to generate the first interactive information by taking the input target multimodal model from the driver state information, vehicle state information and vehicle environment information. The module control module 430 is used to control the information display module to display interactive prompts in real time based on the first interactive information.

[0071] This application also proposes an electronic device. For example... Figure 5 As shown, the electronic device includes a processor and a memory for storing processor-executable instructions, wherein the processor executes the instructions to implement the steps of any of the above embodiments of the method.

[0072] This embodiment also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the steps of any of the methods in the above embodiments.

[0073] In the embodiments of this application, the storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM), etc.

[0074] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0075] The control method, device, and electronic device for an information display module provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A control method for an information display module, applied to a vehicle, wherein the rear of the vehicle is equipped with multiple taillights with different functions, and an information display module for real-time display of interactive prompts, characterized in that... The method includes: Obtain the driver status information, vehicle status information, and vehicle environment information corresponding to the first vehicle; The driver state information, the vehicle state information, and the vehicle environment information are input into the target multimodal model to generate the first interaction information; Based on the first interactive information, the information display module is controlled to display the interactive prompt information in real time.

2. The method according to claim 1, characterized in that, The information display module is a dot-matrix taillight; the interactive prompt information includes at least one of dot-matrix text information and dot-matrix symbol information. The step of controlling the information display module to display the interactive prompt information in real time based on the first interactive information includes: The first interactive information is vectorized to obtain dot matrix control commands; Based on the dot matrix control command, the information display module is controlled to display the dot matrix text information and / or the dot matrix symbol information in real time.

3. The method according to claim 2, characterized in that, The step of performing vector conversion on the first interactive information to obtain dot matrix control commands includes: Obtain the vector conversion database and the display resolution of the dot matrix taillight; the vector conversion database includes at least one of text, numbers and symbols, and the conversion mapping relationship between them and the dot matrix data; Based on the transformation mapping relationship and the display resolution, the first interactive information is vector-converted to obtain the dot matrix control command.

4. The method according to claim 1, characterized in that, The method further includes: A taillight trigger command is generated based on the first interactive information, so that while the information display module displays the interactive prompt information in real time, at least one of the multiple taillights is triggered based on the taillight trigger command.

5. The method according to claim 1, characterized in that, The information display module is a dot matrix taillight, which has multiple trigger modes; The method further includes: Based on the vehicle environment information, the trigger mode of the dot matrix taillights is adjusted.

6. The method according to claim 1, characterized in that, After controlling the information display module to display the interactive prompt information in real time based on the first interactive information, the method includes: Obtain the vehicle driving information corresponding to the second vehicle; The vehicle driving information is input into the target multimodal model to generate the second interactive information; Based on the second interactive information, the information display module is controlled to update and display the interactive prompt information in real time.

7. The method according to claim 1, characterized in that, The step of inputting the driver state information, the vehicle state information, and the vehicle environment information into the target multimodal model to generate the first interaction information includes: Based on a preset structured template, the driver status information, the vehicle status information, and the vehicle environment information are processed in a structured manner to obtain structured statement information; The structured statement information is input into the target multimodal model to generate the first interaction information.

8. A control device for an information display module, applied to a vehicle, wherein the rear of the vehicle is provided with multiple taillights of different functions, and an information display module for real-time display of interactive prompts, characterized in that... The device includes: The information acquisition module is used to acquire driver status information, vehicle status information, and vehicle environment information corresponding to the first vehicle. The signal generation module is used to generate first interactive information by taking the input target multimodal model from the driver state information, the vehicle state information, and the vehicle environment information; The module control module is used to control the information display module to display the interactive prompt information in real time based on the first interactive information.

9. An electronic device, characterized in that, The electronic device includes a processor and a memory for storing processor-executable instructions, wherein the processor executes the instructions to implement the steps of the control method for the information display module according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the steps of the control method for the information display module according to any one of claims 1 to 7.

Images