An interface display method and device, a vehicle, and a storage medium

Abstract

The application relates to an interface display method and device, a vehicle and a storage medium. The method comprises the following steps: in the case that a first interface is displayed on a terminal of an in-vehicle machine of a vehicle, acquiring a target parameter information set corresponding to the vehicle, the target parameter information set comprising at least two of eye movement information of a driver in the vehicle, a steering angle information of a steering wheel in the vehicle and a vehicle speed information of the vehicle; determining a driving distraction degree of the driver in the process of driving the vehicle based on the target parameter information set; correcting the first interface by using the driving distraction degree to obtain a corrected first interface; and displaying the corrected first interface on the terminal of the in-vehicle machine. The application avoids the drawbacks that the traditional static layout mode still maintains the original visual layout and ignores the driving safety in the distraction state of the driver, and ensures the driving safety of the driver under the premise of not affecting the basic information transmission and interaction function of the machine interface.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, specifically to an interface display method, device, vehicle, and storage medium. Background Technology

[0002] With the rapid development of smart cockpit technology, the information display and interaction functions of in-vehicle infotainment systems are becoming increasingly rich. Drivers frequently need to access navigation guidance, vehicle status, entertainment information, and other content through the infotainment system interface while driving. Currently, the interface display method of in-vehicle infotainment systems is usually based on rendering based on a preset static layout template. However, the above method often only pursues visual experience during the interface display process, ignoring the impact of the interface display on driving safety, and thus failing to guarantee driving safety. Summary of the Invention

[0003] One objective of this application is to provide an interface display method that avoids the drawbacks of traditional static layout methods that maintain the original visual layout while ignoring driving safety when the driver is distracted. It ensures the driving safety of the vehicle driver without affecting the basic information transmission and interaction functions of the vehicle interface. Another objective of this application is to provide an interface display device. A third objective of this application is to provide a vehicle. A fourth objective of this application is to provide a storage medium.

[0004] To achieve the above objectives, firstly, this application provides a method for displaying an interface, comprising: When the vehicle's in-vehicle terminal displays the first interface, the target parameter information set corresponding to the vehicle is obtained. The target parameter information set includes at least two of the following: the driver's eye movement information, the steering wheel angle information, and the vehicle speed information. Based on the target parameter information set, determine the degree of driver distraction during the driving of the vehicle; The first interface is corrected based on the degree of driver distraction to obtain a corrected first interface; The corrected first interface is displayed on the vehicle's infotainment terminal.

[0005] To achieve the above objectives, in a second aspect, this application provides an interface display device, comprising: The acquisition module is used to acquire a target parameter information set corresponding to the vehicle when the first interface is displayed on the in-vehicle terminal. The target parameter information set includes at least two of the following: the eye movement information of the driver in the vehicle, the steering wheel angle information in the vehicle, and the vehicle speed information. The determination module is used to determine the degree of driver distraction of the vehicle driver during the driving process based on the target parameter information set; The correction module is used to correct the first interface based on the degree of driver distraction to obtain the corrected first interface. The display module is used to display the corrected first interface on the vehicle terminal.

[0006] To achieve the above objectives, in a third aspect, this application also provides a vehicle, including: a processor and a memory, wherein the processor is configured to execute an interface display program stored in the memory to implement the interface display method described above.

[0007] To achieve the above objectives, in a fourth aspect, this application also provides a storage medium storing one or more programs, which can be executed by one or more processors to implement the interface display method described above.

[0008] The beneficial effects of this application are as follows: This application provides an interface display method. When the in-vehicle terminal displays a first interface, it acquires a target parameter information set including at least two of the following: driver eye movement information, steering wheel angle information, and vehicle speed information. Based on this target parameter information set, it determines the driver's level of distraction. Then, it uses this level of distraction to dynamically correct and re-display the currently displayed first interface. This achieves a safety-adaptive adjustment of the in-vehicle terminal interface based on the driver's level of distraction during driving. It avoids the drawbacks of traditional static layout methods that maintain the original visual layout and ignore driving safety when the driver is distracted. It ensures the driver's driving safety without affecting the basic information transmission and interaction functions of the in-vehicle interface. Attached Figure Description

[0009] Figure 1 This diagram illustrates a flowchart of an interface display method provided in an embodiment of this application. Figure 2 This diagram illustrates a flowchart of another interface display method provided in an embodiment of this application. Figure 3 This diagram illustrates a flowchart of a first interface display method provided in an embodiment of this application. Figure 4 This diagram illustrates a flowchart of another first interface display method provided in an embodiment of this application. Figure 5 This diagram illustrates a flowchart of yet another interface display method provided in an embodiment of this application. Figure 6 This is a flowchart illustrating another interface display method provided in an embodiment of this application; Figure 7 This diagram illustrates the structure of an interface display device provided in an embodiment of this application. Figure 8 This illustration shows a structural diagram of a vehicle provided in an embodiment of this application. Detailed Implementation

[0010] The embodiments of this application will be described below with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of this application from the content disclosed in this specification. This application can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of this application. It should be understood that the preferred embodiments are only for illustrating this application and are not intended to limit the scope of protection of this application.

[0011] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of this application. Therefore, the drawings only show the components related to this application and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0012] To facilitate understanding of the embodiments of this application, the following will provide further explanation and description with reference to the accompanying drawings and specific embodiments. These embodiments do not constitute a limitation on the embodiments of this application.

[0013] refer to Figure 1 , Figure 1 This application provides a flowchart illustrating a method for displaying an interface. The method includes the following steps: S101: When the first interface is displayed on the in-vehicle terminal, obtain the target parameter information set corresponding to the vehicle.

[0014] In this embodiment, the vehicle terminal refers to an in-vehicle electronic device installed inside the vehicle to provide information display and human-computer interaction functions to the driver and passengers. For example, the vehicle terminal can be the central control screen inside the vehicle.

[0015] The first interface refers to the in-vehicle interactive interface currently displayed on the vehicle terminal. It is usually composed of multiple interface elements (i.e., function cards, such as navigation cards, music cards, vehicle status cards, etc.) arranged according to the element attribute information (such as style and layout) of the interface elements to convey visual content such as navigation guidance, vehicle status, and entertainment information to the vehicle driver.

[0016] The target parameter information set includes at least two of the following: driver's eye movement information, steering wheel angle information, and vehicle speed information. There are two combination types among the target parameter information in the set: a first combination type, where the target parameter information set includes eye movement information, steering wheel angle information, and vehicle speed information; and a second combination type, where the target parameter information includes steering wheel angle information and vehicle speed information. By distinguishing between these two different combination types, subsequent corrections to the first interface can be performed when eye movement information fails or when no eye movement monitoring device (such as a DMS camera) is installed in the vehicle, thus ensuring driver safety.

[0017] Eye movement information typically includes real-time eye movement data at the current moment and historical eye movement data from a first preset time period prior to the current moment. The first preset time period can be set according to actual needs, for example, it can be 5 seconds. Both real-time and historical eye movement information are information collected by eye movement monitoring equipment that reflects the eye movement state of the vehicle driver, which is actually the direction of the driver's gaze.

[0018] The steering angle information includes real-time steering angle information at the current moment and historical steering angle information within a second preset time period prior to the current moment. The second preset time period can be set according to actual needs, for example, it can be 3 seconds. Both real-time and historical steering angle information are collected by the steering wheel rotation angle by a steering angle sensor installed inside the steering wheel.

[0019] Vehicle speed information includes real-time vehicle speed at the current moment and historical vehicle speed information within a third preset time period prior to the current moment. The third preset time period can be set according to actual needs, for example, it can be 5 seconds. Both real-time and historical vehicle speed information are collected by speed sensors installed inside the vehicle.

[0020] Specifically, while displaying the in-vehicle interactive interface (first interface) normally, the vehicle terminal obtains the driver's eye movement information through eye movement monitoring equipment and pre-stored historical eye movement information, obtains the steering wheel angle information through corner sensors and pre-stored historical corner angle information, and obtains the vehicle speed information through vehicle speed sensors and pre-stored historical vehicle speed information.

[0021] S102: Based on the target parameter information set, determine the degree of driver distraction during vehicle operation.

[0022] In this embodiment, the degree of driver distraction can be understood as the index value of the driver's attention deviating from safe driving during the driving process.

[0023] Specifically, when the combination type between the target parameter information in the target parameter information set is the first combination type, the eye movement information, turning angle information, and vehicle speed information included in the target parameter information set are fused to obtain the degree of driver distraction during the driving process; when the combination type between the target parameter information in the target parameter information set is the second combination type, the turning angle information and vehicle speed information included in the target parameter information set are fused to obtain the degree of driver distraction during the driving process.

[0024] S103: The first interface is corrected based on the driver's level of distraction to obtain a corrected first interface.

[0025] In this embodiment, after obtaining the degree of driver distraction, the degree of driver distraction is compared with the corresponding threshold. When it is determined that the current driver of the vehicle is in a high state of distraction, a safety correction is performed on the first interface. During the correction process, the complete interface file is not reloaded, but only the interface that needs to be modified in the current first interface is dynamically modified locally (for example, modifying the element attribute information of the interface elements in the first interface) to obtain the corrected first interface.

[0026] S104: The corrected first interface is displayed on the vehicle's infotainment system.

[0027] In this embodiment, after the above-mentioned correction operations are completed, the affected interface elements are immediately redrawn or rearranged, so that the corrected interface content is displayed on the vehicle terminal in real time. The driver can obtain a safety-enhanced interface that adapts to their current attention level and reduces visual load without any manual operation during driving.

[0028] This embodiment provides an interface display method. When the in-vehicle infotainment terminal displays a first interface, it acquires a target parameter information set including at least two of the following: driver eye movement information, steering wheel angle information, and vehicle speed information. Based on this target parameter information set, it determines the driver's level of distraction and then uses this level of distraction to dynamically correct and re-display the currently displayed first interface. This achieves a safety-adaptive adjustment of the in-vehicle infotainment terminal interface based on the driver's level of distraction during driving. It avoids the drawbacks of traditional static layout methods that maintain the original visual layout and ignore driving safety when the driver is distracted. This ensures the driver's driving safety without affecting the basic information transmission and interaction functions of the in-vehicle infotainment interface.

[0029] refer to Figure 2 , Figure 2 This is a flowchart illustrating another interface display method provided in an embodiment of this application. The interface display method provided in this embodiment includes the following steps: S201: When the first interface is displayed on the in-vehicle terminal, obtain the target parameter information set corresponding to the vehicle.

[0030] In this embodiment, obtaining the target parameter information set corresponding to the vehicle can be referred to in step S101 above, and will not be repeated here. (See reference...) Figure 3 As shown, the first interface is displayed in the following way: S301: Responds to the interface display command corresponding to the vehicle driver and obtains the vehicle's driving status information and the environmental information of the vehicle's environment.

[0031] S302: Based on the interface display instructions, driving status information and environmental information, determine the interface scene intent required by the vehicle driver.

[0032] S303: Send the interface scene intent to the cloud so that the cloud can determine the interface theme information of the target interface and the initial interface information corresponding to the first interface based on the interface scene intent.

[0033] S304: Receives interface theme information and initial interface information sent from the cloud.

[0034] S305: Based on the interface theme information, initial interface information, and preset structure information, the first interface is rendered and displayed on the vehicle terminal.

[0035] Regarding steps S301 to S305 above, the interface display command can be understood as a control command actively triggered by the vehicle driver to generate and display the target vehicle interface. It can be initiated through voice interaction, screen touch, etc. For example, the interface display command could be "Help me create an interface suitable for long-distance driving".

[0036] Driving status information can be understood as a collection of relevant information about the vehicle's real-time driving status, including vehicle speed, location information, remaining fuel / battery level, and driving destination.

[0037] Environmental information can be understood as a collection of relevant information about the external environment in which the vehicle is located, including time information, current weather, light intensity, etc., which can be obtained in real time through vehicle networking modules and environmental sensors.

[0038] Interface scene intent can be understood as a structured scene descriptor that represents the driver's current expectations for the functions and style of the in-vehicle interface, obtained through comprehensive analysis of interface display instructions, driving status information and environmental information. This scene descriptor includes multiple dimensions such as interface scene type identifier, function priority sequence, and visual style preference, in order to transform multi-source heterogeneous input information into a unified semantic representation that can be directly understood and processed by the cloud.

[0039] The cloud refers to a computing and storage platform deployed on a remote server to receive uploaded interface scene intents, perform computationally intensive tasks of theme generation and element attribute information (i.e., style and layout) strategy calculations, and return the generated results to the vehicle terminal, thereby realizing an end-to-cloud collaborative interface generation architecture.

[0040] Interface theme information refers to a set of information generated and distributed by the cloud to define the overall visual style of the first interface, including wallpaper image resources, icon resource packs, main color schemes, etc., to give the first interface a visual tone and meet the personalized aesthetic needs of vehicle drivers.

[0041] Initial interface information refers to the set of element attribute information generated and distributed by the cloud to define each interface element in the first interface, including the starting coordinates of each interface element in the grid system, the number of grids occupied, the visibility status, text color, text size, etc., so as to provide specific layout and style parameters for rendering the first interface in addition to the visual theme.

[0042] The preset structure information is used to represent the nesting structure between various interface elements in the first interface, and it is stored locally on the vehicle terminal in XML format. The nesting structure can be understood as which sub-interface elements are included within each interface element and the parent-child hierarchy between these sub-interface elements, so as to provide the basic structural framework of the interface, ensure functional integrity and stability, and not change with the styles and information delivered from the cloud.

[0043] Specifically, when a vehicle driver triggers an interface display command using a voice wake-up word combined with natural language instructions, semantic analysis is performed on the interface display command. Simultaneously, the vehicle's driving status information and the environmental information of the vehicle's surroundings are acquired. The semantic analysis results of the interface display command, the driving status information, and the environmental information are then input into a pre-defined multimodal fusion model.

[0044] The multimodal fusion model extracts features from various modalities. For example, it maps long-distance driving instructions in the interface display to scene type labels and correlates destination information, driving range, and ambient lighting data. A cross-modal attention mechanism is used to semantically align and fuse these features, generating a structured scene descriptor (i.e., the interface scene intent). For instance, this scene descriptor might include a scene type identifier of "long-distance driving mode," a function priority sequence of navigation first, driving range information second, and entertainment functions last, and a visual style preference of dark theme and high contrast.

[0045] The interface scene intent is uploaded to the cloud. After receiving the interface scene intent, the cloud calls a generative visual model based on a diffusion model to generate a high-resolution wallpaper image that meets the requirements based on the scene type identifier and visual style preferences. Simultaneously, a suitable icon resource package is selected or generated from the icon resource library. A color clustering algorithm is used to extract the main color tone from the wallpaper image, and a complete color scheme is generated through optimization using a color psychology model. All of the above constitute the interface theme information. It should be noted that determining the interface theme information through visual models and color clustering algorithms can refer to existing technologies, and will not be elaborated upon in this embodiment.

[0046] Furthermore, based on the functional priority sequence and grid system parameters, the cloud determines the initial layout information of each interface element in the first interface, including the starting coordinates of each card in the grid, the number of grid cells occupied, and the visibility status. It also determines the initial style information of each interface element in conjunction with the theme color scheme. This initial layout information and initial style information together constitute the initial interface information. After obtaining the initial interface information, the cloud sends it to the vehicle's infotainment system.

[0047] The vehicle terminal receives the initial interface information sent from the cloud and renders and displays the first interface on the vehicle terminal based on the interface theme information, the initial interface information and the preset structure information.

[0048] The multimodal fusion model described above can be trained as follows: A training sample set is generated based on large-scale user scenario interaction logs stored in a cloud-based knowledge base. Each training sample in the set includes a voice command associated with a complete interface request, driving status information, environmental information, and manually labeled scene intent tags. Features are extracted from each modality data in each training sample. Voice commands are converted into semantic embedding vectors using a pre-trained language model (which can be selected according to actual needs). The numerical features of driving status and environmental information are normalized and mapped to feature vectors through a fully connected layer. The feature vectors of each modality are input into a cross-modal attention fusion layer. The semantic embedding vector is used as the query vector, and attention-weighted summation is performed with the state feature vector and the environmental feature vector to obtain the fused scene semantic vector. The scene semantic vector is input into a scene type classification head, a function priority ranking head, and a visual style preference regression head, respectively. Supervised training is performed using a multi-task joint loss function to obtain the multimodal fusion model. This multimodal fusion model is then deployed locally on the vehicle terminal for online inference to generate interface scene intents.

[0049] Through the above methods, this embodiment comprehensively analyzes the interface display instructions, driving status information, and environmental information into interface scene intents and uploads them to the cloud. The cloud then completes theme generation and initial interface information determination. Based on the interface theme information and initial interface information returned by the cloud, and the locally preset nested structure information, the first interface is collaboratively rendered and displayed. This achieves intelligent and personalized generation of the vehicle interface, avoiding the drawbacks of traditional static theme solutions that rely on pre-built resource libraries and cannot respond to multi-dimensional scene requirements in real time. It balances visual personalization and functional adaptability, improving the flexibility of vehicle interface generation and user experience.

[0050] In this embodiment, while sending the interface scene intent to the cloud, the interface display method provided in this embodiment also includes the following steps: Determine the element priority of each interface element in the first interface; Send the interface scene intent and the priority of each element to the cloud.

[0051] The initial interface information corresponding to the first interface in step S303 above includes: Based on the intent of the interface scene, determine the initial element attribute information of each interface element in the first interface.

[0052] The initial element attribute information is corrected by utilizing the priority of each element in order to obtain the initial interface information corresponding to the first interface.

[0053] Regarding the steps described above, element priority refers to the priority assigned to each interface element in the first interface by the vehicle-mounted terminal based on preset element priority rules, either simultaneously with or before sending the interface scene intent to the cloud. Element priority can be expressed as a numerical value, a level label (such as high, medium, low), or an order of arrangement. The preset element priority rules are pre-set in the vehicle-mounted terminal, independent of the cloud, ensuring normal operation even without a network connection.

[0054] Initial element attribute information refers to the set of information generated by the cloud based solely on the intent of the interface scenario, without considering differences in element priority, to define the initial display state of each interface element in the first interface. This initial element attribute information typically includes the default layout information (such as position and size) and default style information (such as font size and color) of each interface element.

[0055] Specifically, while sending the interface scene intent to the cloud, the vehicle terminal identifies all the interface elements that need to be displayed on the first interface, such as navigation elements, vehicle speed elements, and music elements; it calls the local preset element rule library to query the element priority of each interface element; and uploads the interface scene intent and the determined element priorities to the cloud.

[0056] After receiving the interface scene intent and element priorities, the cloud platform determines the initial layout and initial style information using the method described above, and uses this information as the initial element attribute information. Based on the element priorities of each interface element, the initial layout and initial style information in the initial element attribute information are modified (refer to the attribute strategy in Table 1). For example, the positions of high-priority interface elements in the grid are adjusted to areas closer to the driver's line of sight; low-priority interface elements are moved to the edge areas. After the modifications are complete, the cloud platform obtains the final initial interface information.

[0057] Through the above methods, this embodiment determines the element priority of each interface element in the first interface locally on the vehicle terminal, and adjusts the element priority according to the interface scene. Figure 1 The information is uploaded to the cloud, where it is modified based on the initial element attribute information and various priorities to obtain the initial interface information. This enables collaborative decision-making between local task perception on the vehicle and global layout optimization on the cloud, making the generated interface more in line with the safety and efficiency requirements of information transmission in the current driving scenario. This improves the intelligence level and scenario adaptability of the vehicle interface generation.

[0058] The above determination of the element priority of each interface element in the first interface specifically includes: Based on each interface element in the first interface, the initial priority of each interface element is determined from the preset element priority rules. Retrieve the historical voice commands given by the vehicle driver before the current moment; Based on the interface elements associated with the first interface included in the historical voice commands, the initial priority of each interface element is updated to determine the element priority of each interface element in the first interface.

[0059] The priority rules for pre-element elements can be found in the above description and Table 1.

[0060] The initial priority can be understood as the priority determined from the preset element priority rules, in order to provide a baseline priority configuration based on security principles.

[0061] Historical voice commands refer to voice operation commands issued by the vehicle driver to the vehicle's infotainment system within a pre-defined time period (which can be set according to actual needs) prior to the current moment. These historical voice commands may include function wake-up commands, function adjustment commands, interface switching commands, etc., to reflect the driver's actual operating intentions and function focus during recent driving, providing a personalized basis for dynamically adjusting element priorities.

[0062] Specifically, identify all interface elements currently to be displayed on the first interface (each interface element corresponds to a driving task); for each interface element, query the preset element priority rules stored locally, and use the queried priority as the initial priority of each interface element.

[0063] After obtaining the initial priority, historical voice command records within the fourth preset time period are read from the cache. Each historical voice command is traversed to identify the corresponding or implicitly associated interface element. For example, if the historical voice command is "zoom in on the navigation," the associated interface element is the navigation card; if the historical voice command is "turn off the music," the associated interface element is the music card. For interface elements with associated records in the historical voice commands, their initial priority is temporarily increased to a preset priority (this preset priority is only lower than the highest priority) to update the initial priority, thereby determining the element priority of each interface element in the first interface.

[0064] Table 1 Preset Element Priority Rules

[0065] In the above, after obtaining the priority of each element, if there are multiple elements with the same priority, the multiple elements with the same priority are processed according to the preset interface element processing order to resolve the priority conflict. Then, the initial element information is corrected based on the processed element priority to obtain the initial interface information corresponding to the first interface.

[0066] Because element priority uses a hierarchical system, after dynamic processing, two or more interface elements may be grouped into the same priority level. In this case, two interface elements at the same priority level may cause sorting conflicts. Therefore, a pre-set processing order for interface elements is established. This order is: interface elements belonging to the safety warning category, interface elements associated with historical voice commands, and the original default order in the preset rule base—that is, arranged from highest to lowest functional importance. According to this preset processing order, multiple interface elements at the same priority level are compared to determine their final order. After conflict resolution, interface elements originally at the same priority level are refined into a clear priority order, resolving the conflict. This allows the initial interface information corresponding to the first interface with the resolved priority level to be utilized.

[0067] In this embodiment, the initial priority of each interface element in the first interface is determined based on a preset element priority rule. Then, the historical voice commands of the driver before the current moment are obtained, and the initial priority is dynamically updated using the interface element information associated with the historical voice commands to obtain the final element priority. This realizes the integration of static safety rules and dynamic user intent in the determination of interface element priority. It avoids the drawback of not being able to respond to changes in the driver's temporary needs in a timely manner when relying solely on static rules. This makes the priority uploaded to the cloud for layout decision-making more accurately reflect the driver's actual focus in the current driving situation. Without sacrificing the bottom line of safety, it improves the personalized response capability and user intent adaptability of the interface generation.

[0068] refer to Figure 4 In this embodiment, step S305, based on the interface theme information, initial interface information, and preset structure information, renders and displays the first interface on the vehicle terminal, specifically including: S401: Determine the view instances corresponding to each interface element in the first interface from the preset structure information.

[0069] S402: For each interface element, apply the element attribute information corresponding to the interface element in the initial interface information to the view instance corresponding to the interface element.

[0070] S403: Based on the various view instances and interface theme information after application, the first interface is rendered and displayed on the vehicle terminal.

[0071] Regarding steps S401 to S403 above, a view instance refers to an interface element object actually created in memory by the vehicle terminal based on preset structure information. Each view instance corresponds to an element node defined in the preset structure information and is a real, operable entity on the screen.

[0072] Specifically, the system calls the preset structure information stored locally, iterates through each element in the preset structure information, and creates a corresponding view instance for each interface element in the first interface. It then parses the initial interface information sent from the cloud and extracts the element attribute information of each interface element. Based on the interface element identifier, it locates the corresponding view instance and, based on the element attribute information, calls the corresponding attribute setting interface of the view instance to assign values, thereby applying the element attributes corresponding to each interface element to the view instance corresponding to the interface element.

[0073] After applying element attributes to all view instances, the wallpaper image resource is extracted from the interface theme information and set as the image content of the main background view. Once all settings are complete, the interface is rendered, ultimately presenting the complete first interface on the vehicle's infotainment system.

[0074] Through the above methods, this embodiment creates a view instance from the local preset structure information, dynamically applies the element attribute information sent from the cloud to the created view instance, and then combines it with the interface theme information to complete the rendering display. This achieves a complete separation between the interface skeleton preset and the dynamic attribute sending, so that only a small amount of attribute change data needs to be transmitted when the interface is updated. While ensuring the stability and security of the vehicle terminal interface function, it improves the flexibility and efficiency of interface rendering.

[0075] S202: Based on the target parameter information set, determine the degree of driver distraction during vehicle operation.

[0076] In one implementation, step S202, based on the target parameter information set, determines the degree of driver distraction during vehicle operation, specifically including: Given that the target parameter information set includes eye movement information, turning angle information and vehicle speed information, the driver's first line of sight deviation duration is determined based on eye movement information, the driver's first operational chaos degree is determined based on turning angle information, and the vehicle's first speed fluctuation rate is determined based on vehicle speed information. Determine the first weights corresponding to the first line-of-sight deviation duration, the first operational chaos degree, and the first vehicle speed volatility; By using the first weights, the duration of the first line of sight deviation, the first degree of operational chaos, and the first vehicle speed fluctuation rate are weighted and calculated to determine the degree of driver distraction during the driving process.

[0077] The duration of the first line of sight deviation can be determined as follows: The deviation distances between real-time eye movement information, historical eye movement information, and preset eye movement information are determined. Based on these deviation distances, the first number indicating a deviation in the driver's gaze at the current moment and within a first preset time period is determined. The duration of the first line of sight deviation is then determined based on this first number and the first preset duration corresponding to the preset sampling point. The real-time eye movement information and historical eye movement information are all sampled at the sampling points, and the preset eye movement information is the preset direction of the driver's gaze. A deviation state is determined by a deviation distance greater than the preset deviation distance. Multiplying the first number by the first preset duration yields the duration of the first line of sight deviation.

[0078] The first operational chaos degree can be determined as follows: Real-time turning angle information and historical turning angle information are sequenced according to the sampling time order to form a turning angle information sequence. First-order differencing is performed on the turning angle information sequence to obtain a turning angle change sequence. The steering entropy of the turning angle change sequence within a second preset time period is calculated, and this steering entropy is used as the first operational chaos degree for the vehicle driver. Specifically, after obtaining the turning angle information sequence, first-order differencing is performed on it by subtracting the turning angle value of the previous sampling time from the turning angle information of the later sampling time, obtaining the turning angle change between adjacent sampling times. After performing the above operation on all adjacent sampling time pairs, a turning angle change sequence is formed. The steering entropy of the turning angle change sequence within the second preset time period is calculated, and this steering entropy is determined as the first operational chaos degree.

[0079] The first vehicle speed fluctuation rate can be determined as follows: real-time vehicle speed information and various historical vehicle speed information are arranged in the order of sampling time to determine the vehicle speed information sequence; the standard deviation and mean of the vehicle speed information sequence are calculated; the ratio of the standard deviation to the mean is determined as the first vehicle speed fluctuation rate.

[0080] Each first weight is preset and is obtained from the pre-stored first weights when calculating the degree of driver distraction. The first gaze deviation duration, first operational chaos degree, and first vehicle speed fluctuation rate obtained in the previous steps are multiplied by their respective first weights, and the sum of the three products is the degree of driver distraction.

[0081] Through the above methods, this embodiment extracts features from three dimensions—visual attention, lateral operation stability, and longitudinal control stability—when eye-tracking information, turning angle information, and vehicle speed information are available simultaneously. These features are then weighted and fused using a preset first weight, enabling a multi-dimensional quantitative assessment of the driver's distraction level. This avoids the drawbacks of single indicators being susceptible to environmental noise interference and having insufficient assessment accuracy, providing a reliable triggering basis for subsequent interface security modifications.

[0082] In another implementation, step S202 determines the degree of driver distraction during vehicle operation based on the target parameter information set, specifically including: Given that the target parameter information set includes steering angle information and vehicle speed information, the second operational chaos degree of the vehicle driver is determined based on the steering angle information, and the second vehicle speed volatility is determined based on the vehicle speed information. Determine the second weight corresponding to the second operational chaos degree and the second vehicle speed volatility; By using various second weights, the second operational chaos degree and the second vehicle speed volatility are weighted and calculated to determine the degree of driver distraction during vehicle operation.

[0083] The calculation methods for the second operational chaos degree and the second vehicle speed volatility can refer to the calculation methods for the first operational chaos degree and the first vehicle speed volatility described above, and will not be repeated here in this embodiment. Each of the second weights is preset and is obtained from the pre-stored second weights when calculating the degree of driving distraction.

[0084] The second operational chaos degree and the second vehicle speed volatility obtained from the aforementioned steps are multiplied by their respective second weights, and the two products are summed. The sum obtained is the degree of driver distraction.

[0085] Through the above methods, this embodiment extracts the second operational chaos degree and the second vehicle speed fluctuation rate as driving distraction assessment features in a downgraded scenario where only cornering information and vehicle speed information are available but eye-tracking information is unavailable. By performing weighted fusion calculations using a preset second weight, it achieves effective assessment of the degree of driving distraction even when monitoring equipment is not fully configured. This avoids the drawback of the driving distraction detection function completely failing due to the lack of eye-tracking information, and enables the driving distraction detection and interface safety correction functions to cover low-end models.

[0086] In this embodiment, the above-mentioned weighted calculation of the second operational chaos degree and the second vehicle speed volatility using various second weights to determine the degree of driver distraction during vehicle driving includes: Using each second weight, the second operational chaos degree and the second vehicle speed volatility are weighted and calculated to obtain the initial degree of distraction of the vehicle driver during driving. Determine the first degree of matching between the second operational chaos degree and the second vehicle speed volatility; Based on the first matching degree, determine the degree correction value for the initial distraction level; The initial level of distraction is corrected using a level correction value to obtain the level of driver distraction during driving.

[0087] The first matching degree refers to the degree of consistency between the changing trends of the second operational chaos degree and the second vehicle speed volatility. Under normal driving conditions, the driver's control of the steering wheel and vehicle speed usually has a certain degree of coordination. When the driver is distracted, this coordination is often broken. The role of the first matching degree is to capture the degree of disruption of this coordination and provide a basis for correcting the initial degree of distraction.

[0088] Specifically, the initial distraction level is determined by weighting the second operational chaos degree and the second vehicle speed volatility using the aforementioned second weights, and is temporarily stored as an intermediate variable. Real-time turning information and historical turning information are used to determine the turning information sequence according to the sampling time order, and real-time vehicle speed information and historical vehicle speed information are used to determine the vehicle speed information sequence according to the sampling time order. The Pearson correlation coefficient between the turning information sequence and the vehicle speed information sequence is calculated, and the calculated Pearson correlation coefficient is determined as the first matching degree. Based on the preset correspondence between the matching degree and the degree correction value, the first matching degree is used to query the above correspondence to obtain the degree correction value corresponding to the initial distraction level. The initial distraction level is added to the degree correction value to correct the initial distraction level using the degree correction value, thus obtaining the driver's distraction level during driving.

[0089] It should be noted that the degree correction value can also be determined in the following way: based on the first matching degree, determine the initial degree correction value; obtain the historical feedback information set within the preset statistical period; based on the historical feedback information set, correct the initial degree correction value to determine the degree correction value.

[0090] The preset statistical period is a duration prior to the current moment, such as half a day or a day. The historical feedback information set includes multiple historical feedback messages, each representing the degree of acceptance of the corrected interface after it has been displayed. For example, if no cancellation operation is detected for the corrected interface within a second preset duration after it has been displayed, the degree of acceptance is considered high; otherwise, it is considered low. The degree correction value corresponding to the first matching degree, determined based on the preset correspondence between matching degree and degree correction value, is recorded as the initial degree correction value. Based on the second number of all historical feedback messages in the historical feedback information set and the third number of all historical feedback messages in the historical feedback information set indicating low acceptance, a first ratio between the second and third numbers is determined. Based on the correspondence between the first ratio and the correction offset coefficient, the correction offset coefficient corresponding to the first ratio is determined. The degree correction value is equal to the initial degree correction value × (1 + correction offset coefficient). By combining the first matching degree benchmark with the historical interface correction and recognition feedback dynamic calibration degree correction value, the system adapts to the personalized driving characteristics of the vehicle driver, reduces the false trigger rate of interface correction, and improves the accuracy of driving distraction determination in two-factor scenarios without eye movement information.

[0091] In this embodiment, the initial distraction level is first calculated using the second weight in the downgraded mode. Then, the first matching degree between the second operational chaos degree and the second vehicle speed fluctuation rate is introduced as the basis for coordination evaluation. Based on the first matching degree, a degree correction value is determined to correct the initial distraction level. This achieves multi-dimensional fusion and correlation correction of driving distraction level in the absence of eye-tracking information. It avoids the drawback of insufficient evaluation accuracy caused by relying solely on independent feature weighting and ignoring the coupling relationship between features, thus improving the accuracy of driving distraction evaluation.

[0092] S203: Based on the combination type of each target parameter information in the target parameter information set, determine the target distraction threshold corresponding to the combination type.

[0093] S204: When the degree of driver distraction is greater than the target distraction threshold, identify the first type of interface elements and the second type of interface elements from the first interface.

[0094] S205: Determine the first correction information corresponding to the first type of interface element and the second correction information corresponding to the second type of interface element.

[0095] S206: The first interface is corrected using the first correction information and the second correction information to obtain the corrected first interface.

[0096] Regarding steps S203 to S206 above, the target distraction threshold refers to the critical value for determining whether interface correction needs to be triggered, based on the combination type of the target parameter information set. Different combination types correspond to different thresholds, with the target distraction threshold for the first combination type being lower than that for the second combination type. By setting a lower threshold for complete parameter combinations and a higher threshold for degraded parameter combinations, the driver distraction assessment for high-end models is made more sensitive, while the driver distraction assessment for low-end models is made more robust, balancing timely safety response with false trigger control.

[0097] The first category of interface elements consists of those related to driving safety in the first interface, typically including navigation guidance elements, vehicle speed display elements, collision warning elements, tire pressure warning elements, etc.

[0098] The second category of interface elements refers to interface elements in the first interface that are unrelated to driving safety, typically including music playback elements, entertainment recommendation elements, vehicle ambient lighting elements, etc.

[0099] The first correction information refers to the set of information used to guide interface correction for the first type of interface elements. The first correction information may include layout or style parameters such as the display area, display size, and display status of the first type of interface elements after correction, so as to define the presentation of the first type of interface elements in the corrected first interface, making them easier for vehicle drivers to perceive and obtain.

[0100] The second correction information refers to the set of information used to guide interface correction for the second type of interface elements. The second correction information may include layout or style parameters such as the display area, display size, and display status of the second type of interface elements after correction, so as to define how the second type of interface elements are presented in the corrected first interface and minimize their interference with the driver's attention.

[0101] Specifically, the system identifies the combination type of the currently available target parameter information set. Based on the preset correspondence between combination types and target distraction thresholds, it determines the target distraction threshold corresponding to the current combination type. If the driver's distraction level is less than or equal to the target distraction threshold, the driver is determined to be in a normal state of focus, and no interface correction is triggered, maintaining the original display of the first interface. If the driver's distraction level is greater than the target distraction threshold, the driver is determined to be in a state of high distraction risk. In this case, all currently displayed interface elements in the first interface are traversed. For each interface element, a preset element classification rule base is queried to obtain the first type of interface elements and the second type of interface elements. This element classification rule base stores the mapping relationship between each interface element and the relevance to driving safety.

[0102] First, determine the first correction rule corresponding to the first type of interface elements. For example, the first correction rule includes adjusting the display area of ​​the first type of interface elements to the area of ​​the screen closest to the driver's line of sight and most easily noticed, such as the left third of the screen; appropriately increasing the display size based on the original size to improve the readability and visibility of the information; and keeping the first type of display elements visible in their initial display state. For each interface element in the first type of interface elements, recalculate the layout parameters or style parameters of each interface element in the first type of interface elements according to the grid system based on the above first correction rule, thereby obtaining the first correction information.

[0103] A second correction rule is determined for the second type of interface elements. For example, the second correction rule includes adjusting the display area of ​​the second type of interface elements to the edge of the screen or an area far from the driver's line of sight, such as the lower right corner or right edge of the screen; appropriately reducing the display size to decrease its visual proportion; and setting the second display state of some second type of interface elements to hidden when the driver is highly distracted. For each interface element in the second type of interface elements, the layout parameters or style parameters of each interface element in the second type of interface elements are recalculated according to the grid system based on the above second correction rule to obtain the second correction information.

[0104] The determined first correction information is applied to the corresponding first type of interface element, and the determined second correction information is applied to the corresponding second type of interface element, thereby completing the correction of the first interface.

[0105] It should be noted that in step S204, when the driver's distraction level exceeds the target distraction level threshold, the corresponding driving operation information of the vehicle is acquired. If the driving operation information determines that the vehicle is not in a normal driving state, the first type of interface elements and the second type of interface elements are identified from the first interface. The driving operation information includes the vehicle's turn signal information, brake information, accelerator information, and gear shifting information. If any operation information changes from the previous moment, it is determined that the vehicle is in a normal driving state; otherwise, it is determined that the vehicle is not in a normal driving state. This method avoids the problems of false triggering and false intervention.

[0106] Through the above methods, this embodiment dynamically determines the corresponding target distraction threshold based on the combination type of the target parameter information set. When the driving distraction level exceeds the target distraction threshold, the interface elements are divided into a first category of interface elements related to driving safety and a second category of interface elements unrelated to driving safety, and correction information is determined for each category. This achieves adaptive matching between the driving distraction judgment standard and the vehicle hardware configuration, as well as differentiated distinction of the correction objects. It provides accurate triggering conditions and classification basis for subsequent execution of different degrees of correction for different types of interface elements, and improves the accuracy of interface safety correction triggering and the rationality of classification processing.

[0107] The determination of the first correction information corresponding to the first type of interface elements and the second correction information corresponding to the second type of interface elements in step S205 above includes: Based on the first correction rule corresponding to the first type of interface element, the first display area and the first display size of the first type of interface element are determined, and the first display area and the first display size are determined as the first correction information corresponding to the first type of interface element. Based on the second correction rule corresponding to the second type of interface element, the second display area and the second display size of the second type of interface element are determined, and the second display area and the second display size are determined as the second correction information corresponding to the second type of interface element.

[0108] The first and second correction rules can be referred to the above description, and will not be repeated here in this embodiment.

[0109] The first display area refers to the spatial range occupied by the first type of interface elements in the corrected first interface, and the second display area refers to the spatial range occupied by the second type of interface elements in the corrected first interface. The distance between the first display area and the driver's line of sight is smaller than that between the second display area and the driver's line of sight.

[0110] The first display size refers to the display area determined for the first type of interface element according to the first correction rule. It is usually manifested as an increase in the number of grid elements or an enlargement of pixel size to improve the visual prominence and readability of safety-critical information. The second display size refers to the display area determined for the second type of interface element according to the second correction rule. It is usually manifested as a decrease in the number of grid elements or a reduction in pixel size, and this size is smaller than the first display size to reduce the visual proportion of non-safety information in the interface.

[0111] Specifically, after identifying the first type of interface element, a preset first correction rule is invoked to calculate its starting coordinates and grid span in the grid system based on the first correction rule, thereby obtaining the first display area and the first display size, and determining the first display area and the first display size as the first correction information.

[0112] After identifying the second type of interface element, the preset second correction rule is invoked to calculate its starting coordinates and grid span in the grid system based on the second correction rule, thereby obtaining the second display area and the second display size. The second display area and the second display size are then determined as the second correction information.

[0113] Through the above methods, this embodiment introduces a first correction rule to guide the determination of the first correction information of the display area and display size of safety-related interface elements, and introduces a second correction rule to guide the determination of the second correction information of non-safety interface elements. It also limits the first display area to be closer to the driver's line of sight and the second display size to be smaller than the first display size. This achieves differentiated processing of safety-critical information and non-safety information in interface correction, and provides a basis for adaptive adjustment of interface safety in a distracted driving state.

[0114] S207: The corrected first interface is displayed on the vehicle's infotainment system.

[0115] In this embodiment, step S207 is the same as step S104 described above. For details, please refer to step S104 above. This embodiment will not repeat the details here.

[0116] It should be noted that after executing step S207, when it is determined that a third preset time has elapsed, a first parameter information set within the third preset time is obtained. The first parameter information set includes at least two of the following: the driver's first eye movement information, the steering wheel's first turning angle information, and the vehicle's first speed information. Based on the first eye movement information, the driver's gaze return time is determined; based on the first turning angle information, the steering wheel's steering fluctuation decrease rate is determined; and based on the second speed information, the vehicle speed fluctuation decrease rate is determined. Based on the gaze return time, steering fluctuation decrease rate, and vehicle speed fluctuation decrease rate, a convergence score is determined. Based on the convergence score, the weights corresponding to each parameter are corrected, and the corrected weights are used to return to execute step S201 as described above.

[0117] In the above, the third preset duration can be set according to actual needs, for example, 10 seconds. The first eye-tracking information includes eye-tracking information from multiple sampling times, the first turning angle information includes turning angle information from multiple sampling times, and the first vehicle speed information includes vehicle speed information from multiple sampling times. The gaze return duration can be determined by the second gaze deviation duration within the third preset duration using the above method. The gaze return duration can be obtained by using the difference between the third preset duration and the second gaze deviation duration. The steering fluctuation reduction rate can be determined as follows: the third operational chaos degree within the third preset duration is determined according to the above method. If the combination type is the first combination type, the steering fluctuation reduction rate is equal to (first operational chaos degree - third operational chaos degree) / first operational chaos degree; if the combination type is the second combination type, the steering fluctuation reduction rate is equal to (second operational chaos degree - third operational chaos degree) / first operational chaos degree. The vehicle speed fluctuation reduction rate can be determined in the following way: the third vehicle speed fluctuation rate within the first time period is determined in the above way. If the combination type is the first combination type, the vehicle speed fluctuation reduction rate is equal to (first vehicle speed fluctuation rate - third vehicle speed fluctuation rate) / first vehicle speed fluctuation rate; if the combination type is the second combination type, the vehicle speed fluctuation reduction rate is equal to (second vehicle speed fluctuation rate - third vehicle speed fluctuation rate) / second vehicle speed fluctuation rate.

[0118] After the combination type is the first combination type, the weighted calculation of gaze return time, steering fluctuation reduction rate, and vehicle speed fluctuation reduction rate yields the first convergence score. Based on the preset correspondence between the convergence score and the weight correction values ​​of each parameter (such as each first weight) (which can be set according to actual needs), the weights of each parameter are corrected, and the corrected weights are used to return to execute the above-mentioned step S201. After the combination type is the second combination type, the weighted calculation of steering fluctuation reduction rate and vehicle speed fluctuation reduction rate yields the second convergence score. Based on the preset correspondence between the convergence score and the weight correction values ​​of each parameter (such as each second weight) (which can be set according to actual needs), the weights of each parameter are corrected, and the corrected weights are used to return to execute the above-mentioned step S201. By binding the convergence effect of the vehicle driver's driving behavior after the safety correction of the vehicle interface, the multi-factor weights of the degree of driving distraction are dynamically calibrated in a closed loop. This not only improves the accuracy of judging the degree of driving distraction under different driving habits of different vehicle drivers, but also ensures the driving safety intervention effect of the dynamic adjustment of the vehicle interface.

[0119] This embodiment provides an interface display method. When the in-vehicle infotainment terminal displays a first interface, it acquires a target parameter information set including at least two of the following: driver eye movement information, steering wheel angle information, and vehicle speed information. Based on this target parameter information set, it determines the driver's level of distraction and then uses this level of distraction to dynamically correct and re-display the currently displayed first interface. This achieves a safety-adaptive adjustment of the in-vehicle infotainment terminal interface based on the driver's level of distraction during driving. It avoids the drawbacks of traditional static layout methods that maintain the original visual layout and ignore driving safety when the driver is distracted. This ensures the driver's driving safety without affecting the basic information transmission and interaction functions of the in-vehicle infotainment interface.

[0120] Figure 5 This application provides a flowchart illustrating another interface display method. The interface display method provided in this embodiment includes the following steps: S501: When the first interface is displayed on the in-vehicle terminal, obtain the target parameter information set corresponding to the vehicle.

[0121] S502: Based on the target parameter information set, determine the degree of driver distraction during vehicle operation.

[0122] Regarding steps S501 and S502, step S501 is the same as step S201, and step S502 is the same as step S202. For details, please refer to steps S201 and S202. This embodiment will not repeat them here.

[0123] S503: Send an interface correction command to the cloud based on the driver's level of distraction, so that the cloud can determine the interface correction information that needs to be corrected in the first interface based on the interface correction command, and correct the interface correction information.

[0124] S504: Receives corrected interface information sent from the cloud.

[0125] S505: Use the corrected interface correction information to correct the first interface to obtain the corrected first interface.

[0126] Regarding steps S503 to S505 above, the interface correction instruction refers to the request sent by the vehicle terminal to the cloud after determining that the driver's distraction level meets the preset trigger condition. The preset trigger condition is that the driver's distraction level is greater than the target distraction level threshold corresponding to the combination type.

[0127] The interface correction information to be corrected refers to the scope of interface elements and their related attributes that need to be corrected in the first interface after the cloud receives the interface correction instruction and analyzes the current level of driver distraction. It may include a list of interface element identifiers that need to be modified, as well as the element attribute information (such as position, size, visibility status, etc.) that needs to be adjusted for each interface element.

[0128] Specifically, when the vehicle terminal is displaying the first interface, if it determines that the driver's distraction level is greater than the target distraction level threshold corresponding to the combination type, the vehicle terminal immediately generates an interface correction instruction and sends it to the cloud.

[0129] After receiving the interface correction instruction, the cloud determines the element attribute information corresponding to the first type of interface elements and the element attribute information corresponding to the second type of interface elements from the first interface, as the interface correction information to be corrected. Based on the above step S205, the cloud determines the first correction information and the second correction information. The first correction information is used to correct the element attribute information corresponding to the first type of interface elements, and the second correction information is used to correct the element attribute information corresponding to the second type of interface elements, to obtain the corrected interface correction information.

[0130] After generating the corrected interface information in the cloud, it sends it to the vehicle terminal. The sending process uses incremental transmission, transmitting only the changed element attribute information to reduce data transmission volume and network latency.

[0131] After receiving the corrected interface correction information from the cloud, the view instances corresponding to the first type of interface elements and the second type of interface elements are determined from the preset structure information. The corrected interface correction information is then applied to the view instances corresponding to the first type of interface elements and the second type of interface elements, respectively, to obtain the corrected first interface.

[0132] In this embodiment, after detecting that the driver's distraction level is greater than the target distraction level threshold, an interface correction command is sent to the cloud. The cloud generates corrected interface correction information based on the driver's distraction level and sends it down. Upon receiving the information, it is immediately applied to the currently displayed view instance and triggers a redraw. This offloads the computationally intensive task of determining the correction strategy to the cloud, reducing the computational burden on the vehicle's system. It also facilitates the unified iteration and remote optimization of the correction strategy, improving overall computational efficiency while ensuring the real-time nature of the correction.

[0133] S506: The corrected first interface is displayed on the vehicle's infotainment system.

[0134] In this embodiment, after updating all affected view instances, the updated view instances are output to the screen buffer via the graphics processor, so that the corrected first interface is rendered and displayed on the vehicle terminal.

[0135] This embodiment provides an interface display method. When the in-vehicle infotainment terminal displays a first interface, it acquires a target parameter information set including at least two of the following: driver eye movement information, steering wheel angle information, and vehicle speed information. Based on this target parameter information set, it determines the driver's level of distraction and then uses this level of distraction to dynamically correct and re-display the currently displayed first interface. This achieves a safety-adaptive adjustment of the in-vehicle infotainment terminal interface based on the driver's level of distraction during driving. It avoids the drawbacks of traditional static layout methods that maintain the original visual layout and ignore driving safety when the driver is distracted. This ensures the driver's driving safety without affecting the basic information transmission and interaction functions of the in-vehicle infotainment interface.

[0136] The following is an example for reference. Figure 6 Here is a detailed explanation of the entire interface display process: After the vehicle terminal responds to the driver's interface display command, it obtains the vehicle's driving status and environmental information, completes the acquisition of multimodal data, and determines the priority of the currently active driving task. Multimodal data is input into the multimodal fusion model so that the multimodal fusion model outputs scene descriptors, and the scene descriptors and their priorities are uploaded to the cloud; After receiving the scene descriptor and various priorities, the cloud determines the interface theme information and the initial element attribute information of each interface element in the interface to be displayed based on the scene descriptor. The cloud uses different priorities to correct the initial element attribute information of the corresponding interface elements in order to obtain the initial interface information (including style information and layout information) corresponding to the interface to be displayed. The cloud pushes the interface theme information and initial interface information to the vehicle terminal; The vehicle terminal determines the view instance corresponding to each interface element from the preset structure information; Apply the element attribute information corresponding to each interface element in the initial interface information to their respective view instances; Based on the various view instances and interface theme information after application, the interface is rendered and displayed on the vehicle terminal. While the vehicle-mounted terminal is displaying the interface, it acquires the target parameter information set in real time. Based on the target parameter information set, determine the driver's level of distraction; When the driver's level of distraction exceeds the corresponding distraction threshold, a command to correct the interface is sent to the cloud. Based on the interface correction instructions, the cloud determines the element attribute information corresponding to the first type of interface elements and the element attribute information corresponding to the second type of interface elements from the first interface, as the interface correction information to be corrected. Determine the first correction information corresponding to the first type of interface elements and the second correction information corresponding to the second type of interface elements; The interface correction information is corrected using the first correction information and the second correction information to obtain the corrected interface correction information; The cloud will send the corrected interface information to the vehicle terminal; The vehicle terminal determines the view instances corresponding to the first type of interface elements and the second type of interface elements from the preset structure information, applies the corrected interface correction information to the view instances corresponding to the first type of interface elements and the second type of interface elements respectively to obtain the corrected interface, and renders and displays the corrected interface.

[0137] refer to Figure 7 , Figure 7 This is a schematic diagram of an interface display device provided in an embodiment of this application. The interface display device provided in this application includes: an acquisition module 10, a determination module 20, a correction module 30, and a display module 40. The acquisition module 10 is used to acquire a target parameter information set corresponding to the vehicle when a first interface is displayed on an in-vehicle infotainment terminal. The target parameter information set includes at least two of the following: eye movement information of the driver, steering wheel angle information, and vehicle speed information. The determination module 20 is used to determine the degree of driver distraction during driving based on the target parameter information set. The correction module 30 is used to correct the first interface using the degree of driver distraction to obtain a corrected first interface. The display module 40 is used to display the corrected first interface on the in-vehicle infotainment terminal.

[0138] In this embodiment, the correction module 30 is further configured to: Based on the combination type of each target parameter information in the target parameter information set, determine the target distraction threshold corresponding to the combination type; When the degree of driver distraction is greater than the target degree of distraction threshold, a first type of interface element and a second type of interface element are determined from the first interface. The first type of interface element is the interface element related to driving safety in the first interface, and the second type of interface element is the interface element unrelated to driving safety in the first interface. Determine the first correction information corresponding to the first type of interface element and the second correction information corresponding to the second type of interface element; The first interface is corrected using the first correction information and the second correction information to obtain the corrected first interface.

[0139] In this embodiment, the correction module 30 is further configured to: The step of determining the first correction information corresponding to the first type of interface element and the second correction information corresponding to the second type of interface element includes: Based on the first correction rule corresponding to the first type of interface element, the first display area and the first display size of the first type of interface element are determined, and the first display area and the first display size are determined as the first correction information corresponding to the first type of interface element. Based on the second correction rule corresponding to the second type of interface element, the second display area and the second display size of the second type of interface element are determined, and the second display area and the second display size are determined as the second correction information corresponding to the second type of interface element. The distance of the first display area from the driver's line of sight is less than the distance of the second display area from the driver's line of sight, and the second display size is less than the first display size.

[0140] In this embodiment, the determining module 20 is further configured to: When the target parameter information set includes the eye movement information, the turning angle information, and the vehicle speed information, the first visual deviation duration of the vehicle driver is determined based on the eye movement information, the first operational chaos degree of the vehicle driver is determined based on the turning angle information, and the first vehicle speed fluctuation rate of the vehicle is determined based on the vehicle speed information. Determine the first weights corresponding to the first line of sight deviation duration, the first operational chaos degree, and the first vehicle speed fluctuation rate; Using the first weights, the first gaze deviation duration, the first operational chaos degree, and the first vehicle speed fluctuation rate are weighted and calculated to determine the degree of driver distraction during the driving of the vehicle.

[0141] In this embodiment, the determining module 20 is further configured to: When the target parameter information set includes the turning angle information and the vehicle speed information, the second operational chaos degree of the vehicle driver is determined based on the turning angle information, and the second vehicle speed fluctuation rate of the vehicle is determined based on the vehicle speed information. Determine the second weights corresponding to the second operational chaos degree and the second vehicle speed volatility; Using each of the second weights, the second operational chaos degree and the second vehicle speed volatility are weighted and calculated to determine the degree of driver distraction during the driving of the vehicle.

[0142] In this embodiment, the determining module 20 is further configured to: Using each of the second weights, the second operational chaos degree and the second vehicle speed volatility are weighted and calculated to obtain the initial degree of distraction of the vehicle driver during the driving of the vehicle; Determine the first degree of matching between the second operational chaos degree and the second vehicle speed volatility; Based on the first matching degree, determine the degree correction value of the initial distraction level; The initial level of distraction is corrected using the level correction value to obtain the level of driver distraction during the driving of the vehicle.

[0143] In this embodiment, the combination type includes a first combination type and a second combination type. The target parameter information set corresponding to the first combination type includes the eye movement information, the turning angle information, and the vehicle speed information. The target parameter information set corresponding to the second combination type includes the turning angle information and the vehicle speed information. The target distraction threshold corresponding to the first combination type is less than the target distraction threshold corresponding to the second combination type.

[0144] In this embodiment, the correction module 30 is further configured to: The driver's level of distraction is used to send an interface correction command to the cloud, so that the cloud can determine the interface correction information that needs to be corrected in the first interface based on the interface correction command, and correct the interface correction information. Receive the corrected interface correction information sent from the cloud; The first interface is corrected using the corrected interface correction information to obtain the corrected first interface.

[0145] In this embodiment, the display module 40 is further configured to: In response to the interface display command corresponding to the vehicle driver, obtain the vehicle's driving status information and the environmental information of the vehicle's environment; Based on the interface display instructions, the driving status information, and the environmental information, determine the interface scene intent required by the vehicle driver. The interface scene intent is sent to the cloud so that the cloud can determine the interface theme information of the first interface and the initial interface information corresponding to the first interface based on the interface scene intent. Receive the interface theme information and initial interface information sent from the cloud; Based on the interface theme information, the initial interface information, and the preset structure information, the first interface is rendered and displayed on the vehicle terminal. The preset structure information is used to characterize the nesting structure between various interface elements in the first interface.

[0146] In this embodiment, the display module 40 is further configured to: While sending the interface scene intent to the cloud, the element priority of each interface element in the first interface is determined; The interface scene intent and the priority of each element are sent to the cloud.

[0147] In this embodiment, the cloud is used for: Based on the intent of the interface scene, the initial element attribute information of each interface element in the first interface is determined; The initial element attribute information is modified using the priority of each element to obtain the initial interface information corresponding to the first interface.

[0148] In this embodiment, the display module 40 is further configured to: Based on each of the interface elements in the first interface, the initial priority matching each of the interface elements is determined from the preset element priority rules; Retrieve the historical voice commands given by the vehicle driver up to the current moment; Based on the interface elements associated with the first interface included in the historical voice commands, the initial priority of each interface element is updated to determine the element priority of each interface element in the first interface.

[0149] In this embodiment, the display module 40 is further configured to: The view instances corresponding to each interface element in the first interface are determined from the preset structure information; For each of the interface elements, the element attribute information corresponding to the interface element in the initial interface information is applied to the view instance corresponding to the interface element; Based on the various view instances and interface theme information after application, the first interface is rendered and displayed on the vehicle terminal.

[0150] This embodiment provides an interface display device that, when a first interface is displayed on the in-vehicle infotainment terminal, acquires a target parameter information set including at least two of the following: driver eye movement information, steering wheel angle information, and vehicle speed information. Based on this target parameter information set, the driver's level of distraction is determined, and the currently displayed first interface is dynamically corrected and re-displayed using this level of distraction. This achieves adaptive adjustment of the in-vehicle infotainment terminal interface based on the driver's level of distraction during driving, avoiding the drawbacks of traditional static layout methods that maintain the original visual layout and ignore driving safety when the driver is distracted. It ensures the driver's driving safety without affecting the basic information transmission and interaction functions of the in-vehicle infotainment interface.

[0151] refer to Figure 8 As shown, Figure 8 This is a schematic diagram of a vehicle structure provided in an embodiment of this application. The vehicle 800 in this embodiment may include at least one processor 801, a memory 802, at least one network interface 804, and other user interfaces 803. The various components in the vehicle 800 are coupled together via a bus system 805. It is understood that the bus system 805 is used to implement communication between these components. In addition to a data bus, the bus system 805 also includes a power bus, a control bus, and a status signal bus. However, for clarity, all buses are referred to as bus system 805.

[0152] The user interface 803 may include a display, keyboard, or click vehicle (e.g., mouse, trackball, touchpad, or touchscreen).

[0153] It is understood that the memory 802 in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced Synchronous DRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), and Direct Rambus RAM (DRRAM). The memory 802 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0154] In some implementations, memory 802 stores elements, executable units or data structures, or subsets thereof, or extended sets thereof: operating system 8021 and application programs 8022.

[0155] The operating system 8021 includes various system programs, such as the framework layer, core library layer, and driver layer, used to implement various basic business functions and handle hardware-based tasks. The application program 8022 includes various applications, such as a media player and a browser, used to implement various application functions. The program implementing the method of this application embodiment can be included in the application program 8022.

[0156] In this embodiment of the application, the processor 801 executes the methods provided in each method embodiment by calling the program or instructions stored in the memory 802, specifically the program or instructions stored in the application program 8022.

[0157] The methods disclosed in the embodiments of this application can be applied to or implemented by processor 801. Processor 801 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the integrated logic circuit of the hardware in processor 801 or by instructions in the form of software. The processor 801 may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software units in the decoding processor. The software units may be located in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory 802. Processor 801 reads the information in memory 802 and uses its hardware to complete the above method.

[0158] It is understood that the embodiments described herein can be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit can be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing vehicles (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described herein, or combinations thereof.

[0159] For software implementation, the techniques described herein can be implemented by units that perform the functions described herein. The software code can be stored in memory and executed by a processor. The memory can be implemented in the processor or external to the processor.

[0160] This application also provides a storage medium (computer-readable storage medium). This storage medium stores one or more programs. The storage medium may include volatile memory, such as random access memory; it may also include non-volatile memory, such as read-only memory, flash memory, hard disk, or solid-state drive; and it may also include combinations of the above types of memory.

[0161] When a storage medium contains one or more programs that can be executed by one or more processors, and when the storage medium is used in a vehicle, the method described above for execution in the vehicle can be implemented. The processor executes the vehicle program stored in the memory to implement the method described above for execution in the vehicle.

[0162] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0163] It should be noted that the terms "one implementation," "embodiment," "exemplary embodiment," and "some embodiments" used in the specification indicate that the described embodiment may include a specific feature, structure, or characteristic, but not every embodiment necessarily includes that specific feature, structure, or characteristic. Furthermore, such phrases do not necessarily refer to the same embodiment. Moreover, when a specific feature, structure, or characteristic is described in connection with an embodiment, implementing such a feature, structure, or characteristic in conjunction with other embodiments, whether explicitly described or not, is within the knowledge scope of those skilled in the art.

[0164] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, or article that comprises a list of elements, or not only those elements, but also other elements not expressly listed, or elements inherent to such a process, method, article, or vehicle. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or vehicle that includes said element.

[0165] The above embodiments are merely preferred embodiments provided to fully illustrate this application, and the scope of protection of this application is not limited thereto. Equivalent substitutions or modifications made by those skilled in the art based on this application are all within the scope of protection of this application.

Claims

1. A method for displaying an interface, characterized in that, include: When the vehicle's in-vehicle terminal displays the first interface, the target parameter information set corresponding to the vehicle is obtained. The target parameter information set includes at least two of the following: the driver's eye movement information, the steering wheel angle information, and the vehicle speed information. Based on the target parameter information set, determine the degree of driver distraction during the driving of the vehicle; The first interface is corrected based on the degree of driver distraction to obtain a corrected first interface; The corrected first interface is displayed on the vehicle terminal; The step of correcting the first interface based on the degree of driver distraction to obtain a corrected first interface includes: Based on the combination type of each target parameter information in the target parameter information set, determine the target distraction threshold corresponding to the combination type; When the degree of driver distraction is greater than the target degree of distraction threshold, a first type of interface element and a second type of interface element are determined from the first interface. The first type of interface element is the interface element related to driving safety in the first interface, and the second type of interface element is the interface element unrelated to driving safety in the first interface. Determine the first correction information corresponding to the first type of interface element and the second correction information corresponding to the second type of interface element; The first interface is corrected using the first correction information and the second correction information to obtain the corrected first interface.

2. The interface display method according to claim 1, characterized in that, The step of determining the first correction information corresponding to the first type of interface element and the second correction information corresponding to the second type of interface element includes: Based on the first correction rule corresponding to the first type of interface element, the first display area and the first display size of the first type of interface element are determined, and the first display area and the first display size are determined as the first correction information corresponding to the first type of interface element. Based on the second correction rule corresponding to the second type of interface element, the second display area and the second display size of the second type of interface element are determined, and the second display area and the second display size are determined as the second correction information corresponding to the second type of interface element. The distance of the first display area from the driver's line of sight is less than the distance of the second display area from the driver's line of sight, and the second display size is less than the first display size.

3. The interface display method according to claim 1, characterized in that, Determining the degree of driver distraction during driving based on the target parameter information set includes: When the target parameter information set includes the eye movement information, the turning angle information, and the vehicle speed information, the first visual deviation duration of the vehicle driver is determined based on the eye movement information, the first operational chaos degree of the vehicle driver is determined based on the turning angle information, and the first vehicle speed fluctuation rate of the vehicle is determined based on the vehicle speed information. Determine the first weights corresponding to the first line of sight deviation duration, the first operational chaos degree, and the first vehicle speed fluctuation rate; Using the first weights, the first gaze deviation duration, the first operational chaos degree, and the first vehicle speed fluctuation rate are weighted and calculated to determine the degree of driver distraction during the driving of the vehicle.

4. The interface display method according to claim 1, characterized in that, Determining the degree of driver distraction during driving based on the target parameter information set includes: When the target parameter information set includes the turning angle information and the vehicle speed information, the second operational chaos degree of the vehicle driver is determined based on the turning angle information, and the second vehicle speed fluctuation rate of the vehicle is determined based on the vehicle speed information. Determine the second weights corresponding to the second operational chaos degree and the second vehicle speed volatility; Using each of the second weights, the second operational chaos degree and the second vehicle speed volatility are weighted and calculated to determine the degree of driver distraction during the driving of the vehicle.

5. The interface display method according to claim 4, characterized in that, The step of using each of the second weights to perform a weighted calculation of the second operational chaos degree and the second vehicle speed volatility to determine the degree of driver distraction during driving the vehicle includes: Using each of the second weights, the second operational chaos degree and the second vehicle speed volatility are weighted and calculated to obtain the initial degree of distraction of the driver of the vehicle during the driving process; Determine the first degree of matching between the second operational chaos degree and the second vehicle speed volatility; Based on the first matching degree, determine the degree correction value of the initial distraction level; The initial level of distraction is corrected using the level correction value to obtain the level of driver distraction during the driving of the vehicle.

6. The interface display method according to claim 1, characterized in that, The combination type includes a first combination type and a second combination type. The target parameter information set corresponding to the first combination type includes the eye movement information, the turning angle information, and the vehicle speed information. The target parameter information set corresponding to the second combination type includes the turning angle information and the vehicle speed information. The target distraction threshold corresponding to the first combination type is less than the target distraction threshold corresponding to the second combination type.

7. The interface display method according to claim 1, characterized in that, The step of correcting the first interface based on the degree of driver distraction to obtain a corrected first interface includes: The driver's level of distraction is used to send an interface correction command to the cloud, so that the cloud can determine the interface correction information that needs to be corrected in the first interface based on the interface correction command, and correct the interface correction information. Receive the corrected interface correction information sent from the cloud; The first interface is corrected using the corrected interface correction information to obtain the corrected first interface.

8. The interface display method according to claim 1, characterized in that, The first interface is displayed in the following manner: In response to the interface display command corresponding to the vehicle driver, obtain the vehicle's driving status information and the environmental information of the vehicle's environment; Based on the interface display instructions, the driving status information, and the environmental information, determine the interface scene intent required by the vehicle driver. The interface scene intent is sent to the cloud so that the cloud can determine the interface theme information of the first interface and the initial interface information corresponding to the first interface based on the interface scene intent. Receive the interface theme information and initial interface information sent from the cloud; Based on the interface theme information, the initial interface information, and the preset structure information, the first interface is rendered and displayed on the vehicle terminal. The preset structure information is used to characterize the nesting structure between various interface elements in the first interface.

9. The interface display method according to claim 8, characterized in that, While sending the interface scene intent to the cloud, the method also includes: Determine the element priority of each interface element in the first interface; Send the interface scene intent and the priority of each element to the cloud; The determination of the initial interface information corresponding to the first interface includes: Based on the intent of the interface scene, the initial element attribute information of each interface element in the first interface is determined; The initial element attribute information is modified using the priority of each element to obtain the initial interface information corresponding to the first interface.

10. The interface display method according to claim 9, characterized in that, Determining the element priority of each interface element in the first interface includes: Based on each of the interface elements in the first interface, the initial priority matching each of the interface elements is determined from the preset element priority rules; Retrieve the historical voice commands given by the vehicle driver up to the current moment; Based on the interface elements associated with the first interface included in the historical voice commands, the initial priority of each interface element is updated to determine the element priority of each interface element in the first interface.

11. The interface display method according to claim 8, characterized in that, The step of rendering and displaying the first interface on the vehicle terminal based on the interface theme information, the initial interface information, and the preset structure information includes: The view instances corresponding to each interface element in the first interface are determined from the preset structure information; For each of the interface elements, the element attribute information corresponding to the interface element in the initial interface information is applied to the view instance corresponding to the interface element; Based on the various view instances and interface theme information after application, the first interface is rendered and displayed on the vehicle terminal.

12. An interface display device, characterized in that, include: The acquisition module is used to acquire a target parameter information set corresponding to the vehicle when the first interface is displayed on the in-vehicle terminal. The target parameter information set includes at least two of the following: the eye movement information of the driver in the vehicle, the steering wheel angle information in the vehicle, and the vehicle speed information. The determination module is used to determine the degree of driver distraction of the vehicle driver during the driving process based on the target parameter information set; The correction module is used to correct the first interface based on the degree of driver distraction to obtain the corrected first interface. The display module is used to display the corrected first interface on the vehicle terminal. The correction module is further configured to determine the target distraction threshold corresponding to the combination type based on the combination type between the target parameter information in the target parameter information set; When the degree of driver distraction is greater than the target degree of distraction threshold, a first type of interface element and a second type of interface element are determined from the first interface. The first type of interface element is the interface element related to driving safety in the first interface, and the second type of interface element is the interface element unrelated to driving safety in the first interface. Determine the first correction information corresponding to the first type of interface element and the second correction information corresponding to the second type of interface element; The first interface is corrected using the first correction information and the second correction information to obtain the corrected first interface.

13. A vehicle, characterized in that, include: A processor and a memory, wherein the processor is configured to execute an interface display program stored in the memory to implement the interface display method of any one of claims 1 to 11.

14. A storage medium, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the interface display method of any one of claims 1 to 11.

Images