A vehicle-mounted multi-screen cooperative content interaction method and system

Abstract

The present application relates to the field of vehicle-mounted intelligent interaction technology, and discloses a vehicle-mounted multi-screen cooperative content interaction method and system, comprising: identifying current driving scene information of a vehicle; based on the current driving scene information, analyzing the current driving mode of the vehicle; when the current driving mode is a task interaction mode, identifying the information importance level of the head-up display screen corresponding to the vehicle, adjusting the information bearing target and information display priority of the head-up display screen, and obtaining a first interaction mode; when the current driving mode is an event response interaction mode, weakening the visual information of the head-up display screen, and converting the interaction content corresponding to the event response interaction mode into voice information and loading it into the center display screen to obtain a second interaction mode; based on the first interaction mode and the second interaction mode, performing multi-screen cooperative content interaction on the vehicle. The present application can optimize the vehicle-mounted screen interaction logic and improve user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to a kind of vehicle-mounted multi-screen collaborative content interaction method and system, belong to vehicle-mounted intelligent interaction technical field. BACKGROUND

[0002] With the acceleration of digital transformation of the automotive industry, vehicle information system has become an important development trend in the automotive industry, and the current vehicle screen arrangement and information display are more and more diversified. Therefore, the collaborative interaction of multi-screen information is very important.

[0003] Currently, the interaction method of vehicle multi-screen system mostly uses screen mirroring or content replication, and lacks the perception ability of driving scene and user state. Regardless of whether the vehicle is in high-speed driving, complex road section or in a relaxed driving state, the system adopts a unified display layout and interaction logic, and fails to adjust the information content and presentation method according to the current user driving state, resulting in poor user experience. SUMMARY

[0004] The present application provides a kind of vehicle-mounted multi-screen collaborative content interaction method and system, which is mainly to optimize vehicle screen interaction logic and improve user experience.

[0005] To achieve the above purpose, the present application provides a kind of vehicle-mounted multi-screen collaborative content interaction method, comprising:

[0006] identify the current driving scene information of the vehicle, the vehicle is deployed with a head-up display screen and a central control display screen, and the current driving scene information includes vehicle state, road environment and user operation intention;

[0007] based on the current driving scene information, analyze the current driving mode of the vehicle;

[0008] when the current driving mode is task interaction mode, identify the information importance level of the head-up display screen corresponding to the vehicle, based on the information importance level, adjust the information carrying target and information display priority of the head-up display screen, and obtain the first interaction mode;

[0009] when the current driving mode is event response interaction mode, the visual information of the head-up display screen is weakened, and the interaction content corresponding to the event response interaction mode is converted into voice information and loaded into the central control display screen, to obtain the second interaction mode;

[0010] based on the first interaction mode and the second interaction mode, perform multi-screen collaborative content interaction on the vehicle.

[0011] Optionally, identifying the current driving scene information of the vehicle comprises:

[0012] Obtain current driving data, map data and human-vehicle interaction data of the vehicle by using a vehicle-mounted sensor network;

[0013] Identify real-time vehicle speed, steering angle and vehicle condition parameters of the vehicle by using the driving data, and obtain vehicle state information;

[0014] Identify traffic flow, road condition type and route complexity of the current driving road of the vehicle by using the map data, and obtain road environment information;

[0015] Identify user operation intention of the operation user corresponding to the vehicle based on the human-vehicle interaction data;

[0016] Determine current driving scene information of the vehicle based on the vehicle state information, the road environment information and the user operation intention.

[0017] Optionally, extract central control screen touch data, voice instruction data and physical button data in the human-vehicle interaction data;

[0018] Construct an operation vector of the operation user corresponding to the vehicle by using the central control screen touch data, the voice instruction data and the physical button data;

[0019] Calculate intention probability of the operation user based on the operation vector;

[0020] Determine user operation intention of the operation user based on the intention probability.

[0021] Optionally, based on the first interaction mode and the second interaction mode, perform multi-screen collaborative content interaction of the vehicle, including:

[0022] Real-time monitor current driving change information of the vehicle, and identify scene information features of the current driving change information;

[0023] When the scene information features meet task interaction features, call the first interaction mode;

[0024] Based on the called first interaction mode, load a preset first multi-screen collaborative rule to perform multi-screen collaborative content interaction of the vehicle according to the first multi-screen collaborative rule, wherein the first multi-screen collaborative rule includes information distribution ratio of a head-up display screen and a central control display screen, content synchronization trigger condition and visual parameter linkage threshold;

[0025] When the scene information features meet event response features, call the second interaction mode;

[0026] Load a preset second multi-screen collaboration rule based on the second interaction mode of the call, to perform multi-screen collaboration content interaction of the vehicle according to the second multi-screen collaboration rule, wherein the second multi-screen collaboration rule comprises information visual parameter and voice loading rule.

[0027] Optionally, based on the information importance level, adjust the information bearing target and information display priority of the head-up display, to obtain a first interaction mode, comprising:

[0028] Based on the information importance level, construct a visual allocation scheme of the head-up display, wherein the visual allocation scheme comprises a high-priority information allocation scheme, a medium-priority information allocation scheme, and a low-priority information allocation scheme;

[0029] Based on the visual allocation scheme, calculate a visual load index of the head-up display;

[0030] Based on the visual load index, adjust the information display priority of the head-up display.

[0031] Optionally, the second interaction mode comprises:

[0032] Extract core interaction content corresponding to the event response interaction mode, wherein the core interaction content comprises event type, key parameter, and operation suggestion;

[0033] Perform natural language processing on the core interaction content to obtain interaction text;

[0034] Convert the interaction text into voice to obtain interaction voice;

[0035] Load the interaction voice into the center control display to obtain the second interaction mode.

[0036] Optionally, based on the current driving scene information, analyze the current driving mode of the vehicle, comprising:

[0037] Extract multi-dimensional scene features of the current driving scene information;

[0038] Use the multi-dimensional scene features to construct a judgment feature set of the corresponding driving mode of the vehicle;

[0039] Based on the judgment feature set, identify the current driving mode of the vehicle.

[0040] Optionally, identify the information importance level of the head-up display corresponding to the vehicle, comprising:

[0041] Query a set of information to be displayed of the head-up display corresponding to the vehicle;

[0042] identify a task type corresponding to the task interaction mode;

[0043] based on the task type, perform weighting processing on information in the to-be-presented information set to obtain weighted information;

[0044] calculate an importance score of the weighted information;

[0045] based on the importance score, determine an information importance level of the head-up display screen of the vehicle.

[0046] Optionally, the visual information of the head-up display screen is weakened, including:

[0047] identify all information items to be displayed by the head-up display screen and the current importance level of each information item;

[0048] According to the scene characteristics of the event response interaction mode, filter out the weakenable information items and the core information items to be retained from the information items;

[0049] After performing visual parameter adjustment on the weakenable information items and keeping the basic display parameters of the core information items unchanged, the weakening processing of the visual information of the head-up display screen is completed.

[0050] To solve the above problems, the application also provides a vehicle-mounted multi-screen cooperative content interaction system, which comprises:

[0051] a driving information analysis module for identifying current driving scene information of a vehicle, wherein the vehicle is provided with a head-up display screen and a center control display screen, and the current driving scene information includes vehicle state, road environment and user operation intention;

[0052] a driving mode analysis module for analyzing the current driving mode of the vehicle based on the current driving scene information;

[0053] a first interaction adjustment module for identifying an information importance level of the head-up display screen of the vehicle when the current driving mode is a task interaction mode, and adjusting information carrying targets and information display priorities of the head-up display screen based on the information importance level to obtain a first interaction mode;

[0054] a second interaction adjustment module for weakening the visual information of the head-up display screen when the current driving mode is an event response interaction mode, and converting interaction content corresponding to the event response interaction mode into voice information and loading the voice information into the center control display screen to obtain a second interaction mode;

[0055] The cooperative interaction module is configured to perform multi-screen cooperative content interaction of the vehicle based on the first interaction mode and the second interaction mode.

[0056] The application first determines the vehicle state, road environment and user operation intention based on the current driving scene information of the vehicle, ensures that all subsequent interaction actions are based on the real driving scene, and eliminates meaningless information interference from the source. Then, the application analyzes the current driving mode of the vehicle based on the identified current driving scene information, converts multi-dimensional driving scene information into executable driving mode judgment, avoids mismatching of the driving mode and the actual driving situation, and ensures that the subsequent multi-screen cooperation has a clear adaptation target. Next, when the current driving mode is the task interaction mode, the application adjusts the information carrying target and display priority of the head-up display screen by identifying the information importance level of the head-up display screen to build the first interaction mode, thereby dividing the information to be displayed by the head-up display screen into primary and secondary, and determining which content needs to be presented first, so that the core information can be quickly captured by the driver and visual interference is reduced. Further, when the current driving mode is the event response interaction mode, the application can maximize the reduction of driving risk in sudden scenarios by weakening the visual information of the head-up display screen and converting the interaction content into voice to load it to the center display screen to build the second interaction mode. Furthermore, the application performs multi-screen cooperative content interaction of the vehicle based on the first interaction mode and the second interaction mode, so that the two screens can dynamically cooperate according to the driving mode instead of operating independently. Therefore, the application can optimize the screen interaction logic of the vehicle and improve the user experience. BRIEF DESCRIPTION OF DRAWINGS

[0057] Figure 1 A flowchart of a vehicle multi-screen cooperative content interaction method provided by an embodiment of the application is shown.

[0058] Figure 2 A module diagram of a vehicle multi-screen cooperative content interaction method provided by an embodiment of the application is shown.

[0059] The purpose of the application, functional features and advantages will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION

[0060] It should be understood that the specific embodiments described herein are only used to explain the application and not to limit the application.

[0061] The embodiment of the present application provides a vehicle-mounted multi-screen cooperative content interaction method. The execution subject of the vehicle-mounted multi-screen cooperative content interaction method includes but is not limited to at least one of electronic devices such as a server, a terminal and the like which can be configured to execute the method provided by the embodiment of the present application. In other words, the vehicle-mounted multi-screen cooperative content interaction method can be executed by software or hardware installed in a terminal device or a server device. The server includes but is not limited to a single server, a server cluster, a cloud server or a cloud server cluster and the like.

[0062] Referring to Figure 1 Fig. 1 is a flowchart of a vehicle-mounted multi-screen cooperative content interaction method provided by an embodiment of the present application. In the embodiment, the vehicle-mounted multi-screen cooperative content interaction method includes the following steps.

[0063] S1, identifying current driving scene information of a vehicle, the vehicle being deployed with a head-up display screen and a center control display screen, the current driving scene information including vehicle state, road environment and user operation intention.

[0064] The embodiment of the present application can determine the actual situation of the current driving of the user by identifying the current driving scene information of the vehicle, so that the system has an actual scene basis, thereby enabling the content of the vehicle-mounted screen to be dynamically adjusted.

[0065] The head-up display screen refers to a vehicle-mounted display device installed near the front windshield of the vehicle and capable of projecting information into the field of view of the driver, the center control display screen refers to a touch display device located in the center console area of the vehicle, the vehicle state refers to, for example, vehicle speed, remaining power and driving mode and the like, the road environment refers to the actual situation of the external road where the vehicle is located, for example, road type, road condition and weather and the like, and the user operation intention refers to the demand transmitted by the user through the operation of the vehicle-mounted device, for example, navigation, playing music, opening the window and making or receiving a call and the like.

[0066] As an embodiment of the present application, the current driving scene information of the vehicle is identified, including:

[0067] The current driving data, map data and man-vehicle interaction data of the vehicle are obtained by using a vehicle-mounted sensor network;

[0068] The real-time vehicle speed, steering angle and vehicle condition parameters of the vehicle are identified by using the driving data, and the vehicle state information is obtained;

[0069] The traffic flow, road condition type and route complexity of the current driving road of the vehicle are identified by using the map data, and the road environment information is obtained;

[0070] The user operation intention of the user corresponding to the operation of the vehicle is identified based on the man-vehicle interaction data;

[0071] determine current driving scene information of the vehicle based on the vehicle state information, the road environment information, and the user operation intention.

[0072] The driving data refers to dynamic data reflecting the running state of the vehicle, such as real-time vehicle speed, steering angle, tire pressure, etc. The road condition type refers to the traffic state category of the current driving road, such as smooth, slow, and congested. The route complexity refers to an index reflecting the difficulty of driving operation, which is quantified based on the "operation demand of driving route" in the map data. The user operation intention refers to the specific goal that the user wants to achieve through operation, which is inferred by analyzing the human-vehicle interaction data.

[0073] In specific implementation, the current driving data, map data, and human-vehicle interaction data of the vehicle can be acquired through a sensor network composed of a vehicle-mounted CAN bus, a millimeter wave radar, a GPS module, and an interactive unit of the central control; the driving data is analyzed by using a data analysis algorithm to obtain the real-time vehicle speed, steering angle, and vehicle condition parameters of the vehicle; the map API is called by using the GPS positioning system to analyze the map data; the traffic flow can be quantified by the number of real-time vehicles in a unit road section (e.g. 50 vehicles / 1km for medium flow); the road condition type can be determined according to the average speed, ≥60km / h for smooth, 20-59km / h for slow, and <20km / h for congested; and the route complexity can be calculated according to the number of turns within 3km (≥3 times for complex route).

[0074] Preferably, the user operation intention of the operation user corresponding to the vehicle is identified based on the human-vehicle interaction data, including:

[0075] The central control screen touch data, voice instruction data, and physical button data in the human-vehicle interaction data are extracted.

[0076] The operation vector of the operation user corresponding to the vehicle is constructed by using the central control screen touch data, the voice instruction data, and the physical button data.

[0077] The intention probability of the operation user is calculated based on the operation vector.

[0078] The user operation intention of the operation user is determined based on the intention probability.

[0079] The intention probability refers to the possibility value of the operation user having a certain specific operation intention, which is obtained by quantitative calculation.

[0080] Specifically, the touch control data of the central control screen can be quantitatively processed according to operation objects, the voice instruction data can be quantitatively processed according to instruction correlation degrees, and the physical button data can be quantitatively processed according to operation conditions, and then the quantitative results of the three types of data are integrated in the fixed dimension order of "touch-voice-button", so that the operation vector of the operation user can be constructed. The intention determination threshold is set to 0.6, if the probability of a certain intention is greater than or equal to 0.6 and is the highest value, it is determined that the intention is the certain intention, if the highest probability is less than 0.6, it is determined that the intention is a "fuzzy intention" and the next round of data collection is triggered, for example, the navigation intention probability 0.65 is greater than 0.6 and is higher than the air conditioner intention (0.2) and the entertainment intention (0.15), so it is determined that the operation intention of the user is the "navigation setting intention".

[0081] Further, as another embodiment of the application, the calculation formula of the intention probability is as follows:

[0082]

[0083] wherein, represents the intention probability, represents a Softmax activation function, represents the number of operation vectors, represents a weight matrix of the i-th operation vector, represents a feature mapping function, represents the i-th operation vector.

[0084] It should be noted that the core of the intention probability calculation formula is to convert the operation vector of the user into a directly comparable intention probability through multi-layer processing. First, the feature mapping function is used to convert various operation vectors to extract key features related to the intention, then the weight matrix of the corresponding category is used to strengthen the influence of important features and weaken the interference of secondary features, and finally the Softmax activation function is used to convert the processed results into a value meeting the probability characteristics, so that the likelihood of various intentions forms a distribution with a total sum of 1, thereby quantifying the intention tendency behind different operations.

[0085] S2, based on the current driving scene information, analyzing the current driving mode of the vehicle.

[0086] The embodiment of the application can convert multi-dimensional driving scene information into executable driving mode determination based on the current driving scene information, analyze the current driving mode of the vehicle, avoid mismatching of the driving mode and the actual driving condition, and ensure that the subsequent multi-screen cooperation has a clear adaptation target.

[0087] The current driving mode includes a task interaction mode and an event response interaction mode. Further, the task interaction mode refers to a driving task initiated by a user, such as navigation setting, driving mode adjustment, or vehicle parameter adjustment, and is an interaction mode with a core of assisting the user to efficiently complete a target task. The event response interaction mode refers to a sudden driving event or vehicle abnormal state, and is an interaction mode with a core of quickly delivering warning information and avoiding distraction of driving attention.

[0088] As an embodiment of the present application, the current driving mode of the vehicle is analyzed based on the current driving scene information, including:

[0089] Multi-dimensional scene features of the current driving scene information are extracted.

[0090] The multi-dimensional scene features are used to construct a judgment feature set of the corresponding driving mode of the vehicle.

[0091] The current driving mode of the vehicle is identified based on the judgment feature set.

[0092] The multi-dimensional scene features refer to a quantifiable or classifiable key feature set extracted from three core dimensions of vehicle state, road environment, and user operation intention of the current driving scene information. The judgment feature set refers to a feature strongly related to driving mode judgment selected from the multi-dimensional scene features by a feature selection algorithm, such as a variance filtering method.

[0093] In specific implementation, key quantifiable features can be extracted from three types of information, such as vehicle state, road environment, and user operation intention. For example, real-time vehicle speed and steering angle change rate are extracted from the vehicle state, distance to the front vehicle and road congestion coefficient are extracted from the road environment, and driving operation frequency is extracted from the user operation intention to obtain the multi-dimensional scene features. Features strongly related to the driving mode are selected by the feature selection algorithm. For example, the feature set is constructed as {vehicle uniform speed driving, wide distance to the front vehicle, extremely low user driving operation, and extremely low congestion coefficient}. The actual operation scene needs to be combined for construction. In the identification of the current driving mode, the features in the judgment feature set are used for judgment. For example, the features in the current feature set are {vehicle uniform speed driving, wide distance to the front vehicle, extremely low user driving operation, extremely low congestion coefficient, and incoming call reminder}. It is determined that the event response interaction mode is selected. If the features in the current feature set are {vehicle uniform speed driving and fast speed, vehicle density, medium congestion coefficient, and incoming call reminder}, it is determined that the task interaction mode is selected.

[0094] It needs to be further explained that each feature set in the determination feature set needs to add a weight coefficient, and the specific driving mode is determined according to the finally calculated weighted score, and the threshold can be set to 0.5, greater than 0.5 is the task interaction mode, and less than 0.5 is the event response interaction mode. Among them, the features of the vehicle state, such as the speed of the vehicle, can be set to 0.2, the vehicle distance can be set to 0.25, the user operation frequency can be set to 0.25, and the congestion coefficient can be set to 0.3. The specific needs to be combined with the number of feature items in the feature set and the importance of the feature.

[0095] S3、In the current driving mode is a task interaction mode, identifying the information importance level of the head-up display screen corresponding to the vehicle, based on the information importance level, adjusting the information bearing target and information display priority of the head-up display screen, obtaining a first interaction mode.

[0096] The embodiment of the application can combine the current driving scene by identifying the information importance level of the head-up display screen corresponding to the vehicle, and divide the primary and secondary information to be displayed on the head-up display screen, and determine which content needs to be presented first, so that the core information can be quickly captured by the driver, and visual interference is reduced.

[0097] Among them, the information importance level refers to the primary and secondary levels of various information to be displayed on the head-up display screen in combination with the current driving scene information.

[0098] As an embodiment of the application, identifying the information importance level of the head-up display screen corresponding to the vehicle comprises:

[0099] Querying the to-be-displayed information set of the head-up display screen corresponding to the vehicle;

[0100] Identifying the task type corresponding to the task interaction mode;

[0101] Based on the task type, the information in the to-be-displayed information set is weighted processed to obtain weighted information;

[0102] Calculating the importance score of the weighted information;

[0103] Based on the importance score, determining the information importance level of the head-up display screen corresponding to the vehicle.

[0104] Among them, the task type refers to a specific driving related task category that can be explicitly defined target initiated by the user based on driving or riding demand, and the importance score refers to the quantitative score of each type of information in the to-be-displayed information set of the head-up display screen.

[0105] In a specific implementation, a preset head-up display standard information library can be called through a vehicle information management system to obtain all possible information items to be displayed in the current scenario, for example, the information set includes: real-time vehicle speed, navigation turning guidance, remaining power, outdoor temperature, and music playing status; based on user operation records (such as central control screen clicks, voice instructions) and system logs, the specific task type is determined by recognizing the operation intention of the user, for example, if it is recognized that the user continuously inputs a destination and confirms navigation, the task type is determined as "navigation task", and if the user frequently adjusts the air conditioning parameters, it is determined as "vehicle control task"; according to the task type, different information items are assigned weights, for example, in the "navigation task", the navigation turning guidance weight is 0.4, the real-time vehicle speed weight is 0.3, the remaining power weight is 0.15, the outdoor temperature weight is 0.1, and the music playing status weight is 0.05, then each information item is multiplied by the corresponding weight to obtain the weighted information; the weighted values of each information item are first standardized (mapped to 0-100 points), and then the importance score of each item is calculated through a weighted summation formula, for example, the original weighted value of the navigation turning guidance is 0.4, which is standardized to 80 points, and the weighted value of the real-time vehicle speed is 0.3, which corresponds to 60 points, so the specific scores of each information item are obtained; three-level thresholds can be set: scores ≥ 80 points are "high importance level", 60-79 points are "medium importance level", and < 60 points are "low importance level". For example, the navigation turning guidance is 80 points and gets the "high importance level", the real-time vehicle speed is 60 points and gets the "medium importance level", and the music playing status is 10 points and gets the "low importance level", thereby completing the level division.

[0106] Further, the embodiment of the present application adjusts the information bearing target and information display priority of the head-up display screen based on the information importance level to obtain a first interaction mode, which can clearly determine the core content borne by the head-up display screen and the priority of content display according to the information importance level of the head-up display screen, and finally form a first interaction mode adapted to the task interaction mode.

[0107] The first interaction mode refers to the content interaction method or content display method of the vehicle display screen when the current driving mode is the task interaction mode.

[0108] As an embodiment of the present application, the first interaction mode obtained by adjusting the information bearing target and information display priority of the head-up display screen based on the information importance level includes:

[0109] Based on the information importance level, a visual allocation scheme of the head-up display screen is constructed, wherein the visual allocation scheme includes a high-priority information allocation scheme, a medium-priority information allocation scheme, and a low-priority information allocation scheme.

[0110] Based on the visual allocation scheme, a visual load index of the head-up display screen is calculated.

[0111] Adjust information display priority of the head-up display based on the visual load index.

[0112] The visual load index is a numerical index reflecting the current visual load pressure of the head-up display.

[0113] In detail, display area, size proportion and visual attribute of the head-up display can be allocated to each type of information according to high, medium and low importance levels, for example, high-priority information is allocated to a central 60% area and displayed in high-contrast color, medium-priority information is allocated to a left 25% area and displayed in standard brightness white, and low-priority information is allocated to a right 15% area and displayed in low-brightness gray; a visual load quantification model can be used to convert information quantity, display area and color complexity into calculable parameters, and a load index can be calculated by weighted summation according to preset weights (area proportion weight 0.5, color complexity weight 0.3, information quantity weight 0.2); if the load index is less than or equal to a threshold value (e.g., 0.3), the original visual allocation scheme is maintained; if the load index exceeds the threshold value, the load index is reduced to within the threshold value by reducing the display intensity of low-priority information (e.g., to 50% of the original size) or temporarily hiding the low-priority information.

[0114] S4. When the current driving mode is the event response interaction mode, the visual information of the head-up display is weakened, and the interaction content corresponding to the event response interaction mode is converted into voice information and loaded into the center control display to obtain a second interaction mode.

[0115] The embodiment of the application can reduce distraction of driving attention by weakening the visual information of the head-up display, and at the same time, the warning or entertainment interaction content is converted into voice and loaded into the center control display to form a second interaction mode adapted to the sudden scene, which can avoid visual information overload interfering with driving judgment in an emergency situation, and at the same time, key information is transmitted more directly through voice to ensure driving safety.

[0116] The second interaction mode is a content interaction method or content display method of the vehicle-mounted display when the current driving mode is the event response interaction mode.

[0117] As an embodiment of the application, the weakening of the visual information of the head-up display includes:

[0118] All information items to be displayed by the head-up display and the current importance level of each information item are identified.

[0119] screening the weakenable information item and the core information item to be kept from the information item according to the scene feature of the event response interaction mode;

[0120] performing visual parameter adjustment on the weakenable information item and keeping the basic display parameter of the core information item unchanged, and completing the visual information weakening processing of the head-up display screen.

[0121] The current importance level refers to the importance level of each information item on the head-up display screen based on the task interaction mode before the event response interaction mode is triggered, the weakenable information item refers to an information item with low safety relevance to the current emergency event (such as a front collision, road construction) and with reduced visual presentation strength, and the core information item refers to an information item directly related to the current emergency event, crucial to driving safety decision-making, and needing to be kept clearly displayed.

[0122] In a specific implementation, the vehicle-mounted information interaction system can call the full-quantity information list currently loaded by the head-up screen, such as real-time vehicle speed, navigation guidance, remaining power, music playing status, and outdoor temperature, and then associate the importance score determined previously to determine the current level of each type of information, such as high, medium, and low. Based on the event type, such as front collision warning and road construction, a safety relevance threshold is set to filter out information items directly related to driving safety. For example, in the "front sudden braking warning" scenario, real-time vehicle speed and collision warning signs are core information items, and navigation guidance and music status are weakenable information items. The visual parameters of the weakenable information items are adjusted as follows: brightness is reduced to 30%-50% of the original brightness, color saturation is reduced to 20%-40%, and size is reduced to 50%-70% of the original size. The core information items keep the original brightness, saturation, and size, or the contrast is increased to 120% of the original, ensuring that the core information is clear and identifiable after weakening.

[0123] Further, the interaction content corresponding to the event response interaction mode is converted into voice information and loaded into the central control display screen to obtain a second interaction mode, which includes:

[0124] extracting core interaction content corresponding to the event response interaction mode, the core interaction content including event type, key parameters, and operation suggestions;

[0125] performing natural language processing on the core interaction content to obtain interaction text;

[0126] converting the interaction text into voice to obtain interaction voice;

[0127] loading the interaction voice into the central control display screen to obtain the second interaction mode.

[0128] In a specific implementation, event-related data can be captured in real time through vehicle-mounted sensors and system logs, such as event type: "vehicle in front sudden braking" and "abnormal tire pressure", key parameters: distance 80 meters, operation suggestion: decelerate to below 30 km / h; the extracted core content is integrated into a concise instructional text using a structured data to natural language algorithm, such as "vehicle in front 80 meters sudden braking, please decelerate immediately"; the interactive text is converted into interactive voice through a vehicle-mounted TTS module; the generated interactive voice is sent to the audio output unit of the center control display screen, and the simple text consistent with the voice content is displayed at the bottom of the center control screen to form a "voice broadcast + simple text auxiliary" cooperative output mode, that is, the second interaction mode.

[0129] S5, based on the first interaction mode and the second interaction mode, performing multi-screen cooperative content interaction of the vehicle.

[0130] The embodiment of the application can adapt the first interaction mode to the task interaction mode, and adapt the second interaction mode to the event response interaction mode, and actually land in the cooperative operation of the head-up display screen and the center control display screen, so that the two screens display information and respond to operations according to the corresponding mode rules.

[0131] As an embodiment of the application, based on the first interaction mode and the second interaction mode, performing multi-screen cooperative content interaction of the vehicle, comprising:

[0132] Real-time monitoring of current driving change information of the vehicle, and identifying scene information features of the current driving change information;

[0133] When the scene information features meet the task interaction features, the first interaction mode is called;

[0134] Based on the called first interaction mode, a preset first multi-screen cooperative rule is loaded to perform multi-screen cooperative content interaction of the vehicle according to the first multi-screen cooperative rule, wherein the first multi-screen cooperative rule includes information distribution ratio of the head-up display screen and the center control display screen, content synchronization trigger condition and visual parameter linkage threshold;

[0135] When the scene information features meet the event response features, the second interaction mode is called;

[0136] Based on the called second interaction mode, a preset second multi-screen cooperative rule is loaded to perform multi-screen cooperative content interaction of the vehicle according to the second multi-screen cooperative rule, wherein the second multi-screen cooperative rule includes information visual parameter and voice loading rule.

[0137] In a specific implementation, the driving scene state of the vehicle can be monitored in real time, including dynamic information such as vehicle speed, vehicle distance, road environment, and user operation, from which it is identified whether the current is a regular driving task scene or a sudden response scene; if it is identified as a regular driving task scene (such as user operation navigation, adjustment of in-vehicle functions), the first interaction mode is called, and the preset multi-screen cooperation rule is loaded: the heads-up display mainly displays core driving information (such as navigation guidance, vehicle speed), occupying about 60%-70% of the screen; the central control display screen auxiliary displays the operation entrance (such as navigation setting, air conditioning adjustment), occupying about 30%-40% of the screen, and the information of the two screens is synchronized in real time; if it is identified as a sudden response scene (such as a front obstacle, vehicle anomaly), the second interaction mode is switched to, and the corresponding cooperation rule is loaded: the heads-up display weakens non-key information (such as reducing the display of entertainment information), and only clearly retains core safety information such as vehicle speed; the central control display screen preferentially loads voice prompts (such as "there is an obstacle in front, please slow down"), and cooperates with simple text assistance to ensure that the two screens focus on safety response.

[0138] It should be explained that the preset first multi-screen cooperation rule refers to the multi-screen operation specification adapted to the task interaction mode, the core of which is "efficiently assisting task completion", and the division of labor between the heads-up display and the central control display screen, the information synchronization logic and the visual parameter standard are clear; the preset second multi-screen cooperation rule refers to the multi-screen operation specification adapted to the event response interaction mode, and the core is "preferentially ensuring driving safety", and the visual weakening standard of the heads-up display and the voice loading requirement of the central control display screen are clear.

[0139] As shown in Figure 2 It is a functional module diagram of a vehicle-mounted multi-screen cooperation content interaction system according to the present application.

[0140] The vehicle-mounted multi-screen cooperation content interaction system 200 according to the present application can be installed in an electronic device. According to the functions implemented, the vehicle-mounted multi-screen cooperation content interaction system can include a driving information analysis module 201, a driving mode analysis module 202, a first interaction adjustment module 203, a second interaction adjustment module 204, and a cooperative interaction module 205. The modules according to the present application can also be referred to as units, which refer to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, and are stored in the memory of the electronic device.

[0141] In the embodiments of the present application, the functions of each module / unit are as follows:

[0142] The driving information analysis module 201 is used to identify the current driving scene information of the vehicle, the vehicle is equipped with a heads-up display and a central control display screen, and the current driving scene information includes vehicle state, road environment, and user operation intention;

[0143] The driving mode analysis module 202 is configured to analyze a current driving mode of the vehicle based on the current driving scene information.

[0144] The first interaction adjustment module 203 is configured to, when the current driving mode is a task interaction mode, identify an information importance level of the vehicle corresponding to a heads-up display screen, adjust an information bearing target and an information display priority of the heads-up display screen based on the information importance level, and obtain a first interaction mode.

[0145] The second interaction adjustment module 204 is configured to, when the current driving mode is an event response interaction mode, perform weakening processing on visual information of the heads-up display screen, and convert interaction content corresponding to the event response interaction mode into voice information and load the voice information into the center control display screen, to obtain a second interaction mode.

[0146] The cooperative interaction module 205 is configured to perform multi-screen cooperative content interaction of the vehicle based on the first interaction mode and the second interaction mode.

[0147] In detail, the modules in the content interaction system 200 of the vehicle-mounted multi-screen cooperation in the embodiments of the present application use the same technical means as the content interaction method of the vehicle-mounted multi-screen cooperation in the above-mentioned Figure 1 , and can produce the same technical effects, which will not be described here.

[0148] It is obvious for those skilled in the art that the present application is not limited to the details of the above exemplary embodiments, and the present application can be implemented in other specific forms without departing from the spirit or essential characteristics of the present application.

[0149] Finally, it should be noted that in the above embodiments, each embodiment can be combined or independent, and deleting any one does not affect the technical implementation of other embodiments. The above embodiments are only used to illustrate the technical solutions of the present application and are not limited. Although the present application has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present application can be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present application.

Claims

1. A method for content interaction in a vehicle-mounted multi-screen collaboration, characterized in that, The method includes: The vehicle is equipped with a head-up display and a central control display. The current driving scenario information includes the vehicle status, road environment, and user operation intention. Based on the current driving scenario information, analyze the current driving mode of the vehicle; When the current driving mode is the task interaction mode, the importance level of the information on the vehicle's head-up display screen is identified. Based on the importance level, the information carrying target and information display priority of the head-up display screen are adjusted to obtain the first interaction mode. The adjustment of the information carrying target and information display priority of the head-up display screen includes: constructing a visual allocation scheme for the head-up display screen based on the importance level, wherein the visual allocation scheme includes a high-priority information allocation scheme, a medium-priority information allocation scheme, and a low-priority information allocation scheme; calculating the visual load index of the head-up display screen based on the visual load index; and reducing the display intensity of low-priority information on the head-up display screen based on the visual load index. When the current driving mode is the event response interaction mode, the visual information of the head-up display screen is weakened, and the interaction content corresponding to the event response interaction mode is converted into voice information and loaded into the central control display screen to obtain the second interaction mode. Based on the first interaction mode and the second interaction mode, multi-screen collaborative content interaction on the vehicle is performed, including: real-time monitoring of the vehicle's current driving change information and identifying the scene information features of the current driving change information; when the scene information features match the task interaction features, the first interaction mode is invoked; based on the invoked first interaction mode, a preset first multi-screen collaboration rule is loaded to perform multi-screen collaborative content interaction on the vehicle according to the first multi-screen collaboration rule, wherein the first multi-screen collaboration rule includes the information allocation ratio between the head-up display and the central control display, content synchronization triggering conditions, and visual parameter linkage thresholds.

2. The in-vehicle multi-screen collaborative content interaction method as described in claim 1, characterized in that, Identify the vehicle's current driving scenario information, including: By utilizing onboard sensor networks, current driving data, map data, and human-vehicle interaction data of the vehicle can be acquired; The vehicle's real-time speed, steering angle, and vehicle condition parameters are identified using the driving data to obtain vehicle status information. The map data is used to identify the traffic flow, road condition type, and route complexity of the vehicle on the current road, thereby obtaining road environment information; Based on the human-vehicle interaction data, identify the user's operation intent corresponding to the vehicle operation; Based on the vehicle status information, the road environment information, and the user's operation intention, the current driving scenario information of the vehicle is determined.

3. The in-vehicle multi-screen collaborative content interaction method as described in claim 2, characterized in that, Based on the human-vehicle interaction data, the user's operational intent corresponding to the vehicle is identified, including: Extract the central control screen touch data, voice command data, and physical button data from the human-vehicle interaction data; Using the central control screen touch data, the voice command data, and the physical button data, an operation vector corresponding to the user operating the vehicle is constructed; Based on the operation vector, calculate the probability of the user's intent. Based on the intent probability, the user's operation intent is determined.

4. The in-vehicle multi-screen collaborative content interaction method as described in claim 1, characterized in that, Based on the first interaction mode and the second interaction mode, performing multi-screen collaborative content interaction on the vehicle further includes: When the scene information features match the event response features, the second interaction mode is invoked; Based on the second interaction mode of the call, a preset second multi-screen collaboration rule is loaded to perform multi-screen collaborative content interaction on the vehicle according to the second multi-screen collaboration rule, wherein the second multi-screen collaboration rule includes information visual parameters and voice loading rules.

5. The in-vehicle multi-screen collaborative content interaction method as described in claim 1, characterized in that, The step of converting the interactive content corresponding to the event response interaction mode into voice information and loading it onto the central control display screen to obtain the second interaction mode includes: Extract the core interactive content corresponding to the event response interaction mode. The core interactive content includes event type, key parameters and operation suggestions. Natural language processing is performed on the core interactive content to obtain interactive text; The interactive text is converted into speech to obtain interactive speech; The interactive voice is loaded into the central control display screen to obtain the second interactive mode.

6. The in-vehicle multi-screen collaborative content interaction method as described in claim 1, characterized in that, Based on the current driving scenario information, the current driving mode of the vehicle is analyzed, including: Extract multi-dimensional scene features from the current driving scene information; Using the multi-dimensional scene features, a feature set for determining the driving mode of the vehicle is constructed; Based on the determination feature set, the current driving mode of the vehicle is identified.

7. The in-vehicle multi-screen collaborative content interaction method as described in claim 1, characterized in that, Identifying the importance level of the information displayed on the vehicle's head-up display includes: Query the set of information to be displayed on the head-up display screen corresponding to the vehicle; Identify the task type corresponding to the task interaction mode; Based on the task type, the information in the set of information to be displayed is weighted to obtain weighted information; Calculate the importance score of the weighted information; Based on the importance score, the importance level of the information on the vehicle's corresponding head-up display screen is determined.

8. The in-vehicle multi-screen collaborative content interaction method as described in claim 1, characterized in that, The visual information of the head-up display screen is weakened, including: Identify all information items to be displayed on the head-up display and the current importance level of each information item; Based on the scenario characteristics of the event response interaction mode, filter out information items that can be weakened and core information items that need to be retained from the information items; After adjusting the visual parameters of the weakenable information items and keeping the basic display parameters of the core information items unchanged, the visual information weakening process of the head-up display screen is completed.

9. A vehicle-mounted multi-screen collaborative content interaction system, characterized in that, The system includes: The driving information analysis module is used to identify the current driving scenario information of the vehicle. The vehicle is equipped with a head-up display and a central control display. The current driving scenario information includes the vehicle status, road environment, and user operation intention. The driving mode analysis module is used to analyze the current driving mode of the vehicle based on the current driving scenario information. The first interaction adjustment module is used to identify the information importance level of the vehicle's head-up display screen when the current driving mode is a task interaction mode, and adjust the information carrying target and information display priority of the head-up display screen based on the information importance level to obtain a first interaction mode. The adjustment of the information carrying target and information display priority of the head-up display screen includes: constructing a visual allocation scheme for the head-up display screen based on the information importance level, wherein the visual allocation scheme includes a high-priority information allocation scheme, a medium-priority information allocation scheme, and a low-priority information allocation scheme; calculating the visual load index of the head-up display screen based on the visual allocation scheme; and reducing the display intensity of low-priority information on the head-up display screen based on the visual load index. The second interaction adjustment module is used to weaken the visual information of the head-up display screen when the current driving mode is the event response interaction mode, and convert the interaction content corresponding to the event response interaction mode into voice information and load it into the central control display screen to obtain the second interaction mode. The collaborative interaction module is used to perform multi-screen collaborative content interaction on the vehicle based on the first interaction mode and the second interaction mode, including: real-time monitoring of the vehicle's current driving change information and identifying the scene information features of the current driving change information; when the scene information features meet the task interaction features, calling the first interaction mode; and loading a preset first multi-screen collaboration rule based on the called first interaction mode, so as to perform multi-screen collaborative content interaction on the vehicle according to the first multi-screen collaboration rule. The first multi-screen collaboration rule includes the information allocation ratio between the head-up display and the central control display, the content synchronization triggering condition, and the visual parameter linkage threshold.

Images