A vehicle-mounted multi-screen projection method, intelligent terminal, storage medium and program product

Abstract

A method for in-vehicle multi-screen projection, a smart terminal, a storage medium, and a program product. The method includes: the smart terminal obtains vehicle operation status data and driver attention status data in real time to dynamically assess the driver's risk level in driving the vehicle, and determines the screen display level of different in-vehicle display screens accordingly. At the same time, the smart terminal combines the attribute tags of the content to be projected with the content display permissions to achieve intelligent distribution and display control of the content to be projected. This multi-dimensional dynamic evaluation and intelligent matching mechanism can effectively prevent inappropriate projected content from distracting the driver's attention in dangerous scenarios, thereby reducing driving safety hazards. It can also flexibly adjust the display content and display mode according to the actual scenario, improving the safety and practicality of the in-vehicle multi-screen projection method.

Description

Technical Field

[0001] The present application relates to the field of in-vehicle screen projection technology, and in particular to an in-vehicle multi-screen projection method, a smart terminal, a storage medium and a program product. Background Art

[0002] With the rapid development of intelligent driving technology, in-vehicle displays have become a standard feature of modern cars. While driving, drivers usually use in-vehicle displays to display various dynamic information, such as navigation information, vehicle status information, and entertainment information.

[0003] At present, the in-vehicle screen projection system usually uses wired or wireless connection to realize the screen projection function, that is, the smart terminal establishes a connection with the in-vehicle display screen through a data cable or Bluetooth, and the driver can select the content to be projected and transmit the relevant content to the in-vehicle display screen for display.

[0004] However, due to the complexity and variability of driving environments, a simple content classification projection approach can pose safety risks. For example, when a vehicle is traveling at high speeds or the driver is distracted, the display of certain entertainment content may distract the driver and increase driving risks. Summary of the Invention

[0005] The present application provides a vehicle-mounted multi-screen projection method, a smart terminal, a storage medium and a program product for improving the safety and practicality of vehicle-mounted multi-screen projection.

[0006] In the first aspect, the present application provides a method for in-vehicle multi-screen projection, which is applied to a smart terminal, the method comprising: obtaining vehicle operation status data and driver attention status data, the vehicle operation status data including vehicle speed information, steering angle information and driving trajectory information, the driver attention status data including facial fatigue information, eye movement information, head posture information and hand control behavior information; determining a risk level based on the vehicle operation status data and the driver attention status data; determining the screen display level of each of a plurality of in-vehicle display screens based on the risk level and a preset risk level-screen display level correspondence table, the preset risk level-screen display level correspondence table including the screen display levels of different in-vehicle display screens corresponding to different risk levels, and the screen display level corresponds one-to-one with the content display permission; receiving a projection instruction from the driver, the projection instruction including the content to be projected and the attribute tag of the content to be projected; determining the content display permission of the content to be projected based on the attribute tag and the preset attribute tag-content display permission correspondence table; matching the content display permission with the screen display level to obtain a target in-vehicle display screen; establishing a projection connection with the target in-vehicle display screen, and projecting the content to be projected.

[0007] By adopting the above technical solution, the smart terminal obtains vehicle operation status data (vehicle speed information, steering angle information, and driving trajectory information) and driver attention status data (facial fatigue information, eye movement information, head posture information, and hand control behavior information) in real time to dynamically evaluate the driver's risk level of driving the vehicle, and determine the screen display level of different on-board display screens accordingly. At the same time, the smart terminal combines the attribute tags of the content to be projected with the content display permissions to achieve intelligent distribution and display control of the content to be projected. This multi-dimensional dynamic evaluation and intelligent matching mechanism can effectively prevent inappropriate projected content from distracting the driver's attention in dangerous scenarios, thereby reducing driving safety risks. It can also flexibly adjust the display content and display mode according to the actual scenario, thereby improving the safety and practicality of the in-vehicle multi-screen projection method.

[0008] In combination with some embodiments of the first aspect, in some embodiments, the risk level is determined based on the vehicle operating status data and the driver attention status data, specifically including: standardizing the vehicle operating status data to obtain a standardized vehicle speed value, a standardized steering angle value, and a standardized trajectory deviation value; obtaining a driver attention score based on the facial fatigue information, the eye movement information, the head posture information, the hand control behavior information and a preset attention assessment model; inputting the standardized vehicle speed value, the standardized steering angle value, the standardized trajectory deviation value, and the driver attention score into a pre-trained risk assessment model to obtain a risk prediction value; and determining the corresponding risk level based on the numerical range of the risk prediction value.

[0009] By employing this technical solution, the intelligent terminal standardizes vehicle operating status data and, in conjunction with an attention assessment model, quantifies and scores driver attention data. Finally, the standardized vehicle speed, steering angle, trajectory deviation, and driver attention score are input into a pre-trained risk assessment model to generate a risk prediction, enabling accurate prediction and grading of driving risks. This multi-dimensional data-based risk assessment method makes risk assessment results more comprehensive and accurate, facilitating subsequent display control decisions by the intelligent terminal and improving the reliability and practicality of in-vehicle multi-screen projection.

[0010] In combination with some embodiments of the first aspect, in some embodiments, before the step of obtaining the driver's attention score based on the facial fatigue information, the eye movement information, the head posture information, the hand control behavior information and a preset attention assessment model, the method also includes: obtaining historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information and historical driver's attention scores; using the historical facial fatigue information, the historical eye movement information, the historical head posture information and the historical hand control behavior information as input and the historical driver's attention score as output to train the preset model; when the accuracy of the preset model exceeds a preset accuracy threshold, obtaining the attention assessment model.

[0011] By adopting the above technical solution, the smart terminal collects historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information and historical driver attention scores to train the preset model. The preset model is not put into use until its accuracy reaches the preset accuracy threshold, ensuring the reliability of the driver attention score assessment and effectively avoiding the risk of misjudgment caused by the immaturity of the attention assessment model.

[0012] In combination with some embodiments of the first aspect, in some embodiments, after the step of determining the risk level based on the vehicle operating status data and the driver attention status data, the method also includes: obtaining the changing trend of the risk level within a preset time window; if the changing trend is an upward trend, pausing the display of all projected content except navigation information; if the risk level is a downward trend, adjusting the brightness of the vehicle display screen according to a preset brightness adjustment curve.

[0013] By adopting the above technical solution, the intelligent terminal monitors the changing trend of risk levels within the preset time window, realizing dynamic early warning and active intervention in driving safety. It can not only prevent potential dangers in time, but also flexibly adjust display parameters according to actual conditions, thereby improving the humanization of the in-vehicle multi-screen projection method.

[0014] In combination with some embodiments of the first aspect, in some embodiments, the content display permission is matched with the screen display level to obtain a target vehicle display screen, specifically including: determining the corresponding target screen display level according to the content display permission, the content display permission and the screen display level corresponding one-to-one; based on the target screen display level, determining the target vehicle display screen.

[0015] By adopting the above technical solution, the smart terminal establishes a one-to-one correspondence between content display permissions and screen display levels, thereby accurately allocating different types of projected content to the most appropriate in-vehicle display screen. This ensures that each in-vehicle display screen functions according to its screen display level and avoids the problem of inappropriate content being displayed in inappropriate locations. At the same time, this method also makes the smart terminal more efficient and controllable when handling in-vehicle multi-screen displays, thereby better balancing the needs of information display and driving safety requirements, and improving the practicality and safety of the entire in-vehicle multi-screen projection method.

[0016] In combination with some embodiments of the first aspect, in some embodiments, after establishing a projection connection with the target vehicle-mounted display screen and projecting the content to be projected, the method also includes: obtaining the driver's gesture instructions; retrieving the interaction instructions corresponding to the gesture instructions from an interaction instruction mapping database, the interaction instruction mapping database including different gesture instructions corresponding to different interaction instructions, and the interaction instructions are used to control the vehicle-mounted display screen; based on the interaction instructions, adjusting the vehicle-mounted display screen.

[0017] By adopting this technical solution and introducing an interactive control mechanism based on gesture recognition, the intelligent terminal establishes a database of interactive commands that map gesture commands to interactive commands, enabling contactless control of the vehicle's display. This contactless interaction method transforms complex control requirements into simple gestures, allowing the driver to easily adjust the vehicle's display without affecting driving. This not only reduces the driver's operational burden but also effectively reduces the risk of distraction from touching the vehicle's display, ensuring driving safety.

[0018] In combination with some embodiments of the first aspect, in some embodiments, after establishing a projection connection with the target vehicle-mounted display screen and projecting the content to be projected, the method also includes: detecting the driver's line of sight focus position in real time; if the line of sight focus position is located on the same vehicle-mounted display screen within a preset time period, issuing an early warning.

[0019] By employing this technical solution, the intelligent terminal detects the driver's gaze focus in real time and issues a warning if it detects the driver's gaze remains fixed on the same in-vehicle display for an extended period of time. This effectively prevents drivers from ignoring road conditions due to excessive focus on the displayed content. This proactive warning mechanism, based on gaze tracking, can promptly detect and correct improper driver attention allocation, helping drivers maintain sustained attention to the road environment and improving the safety and practicality of in-vehicle multi-screen projection.

[0020] In a second aspect, an embodiment of the present application provides a smart terminal, which includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the smart terminal to execute the method described in the first aspect and any possible implementation method of the first aspect.

[0021] In a third aspect, an embodiment of the present application provides a computer program product comprising instructions, which, when executed on a smart terminal, enables the smart terminal to execute the method described in the first aspect and any possible implementation of the first aspect.

[0022] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium comprising instructions. When the instructions are executed on a smart terminal, the smart terminal executes the method described in the first aspect and any possible implementation of the first aspect.

[0023] It is understandable that the intelligent terminal provided in the second aspect, the computer program product provided in the third aspect, and the computer storage medium provided in the fourth aspect are all used to execute the methods provided in the embodiments of the present application. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods and will not be repeated here.

[0024] One or more technical solutions provided in the embodiments of this application have at least the following technical effects or advantages:

[0025] 1. By adopting the above technical solution, the smart terminal obtains vehicle operation status data (vehicle speed information, steering angle information, and driving trajectory information) and driver attention status data (facial fatigue information, eye movement information, head posture information, and hand control behavior information) in real time to dynamically evaluate the driver's risk level of driving the vehicle and determine the screen display level of different in-vehicle display screens accordingly. At the same time, the smart terminal combines the attribute tags of the content to be projected with the content display permissions to achieve intelligent distribution and display control of the content to be projected. This multi-dimensional dynamic evaluation and intelligent matching mechanism can effectively prevent inappropriate projected content from distracting the driver's attention in dangerous scenarios, thereby reducing driving safety risks. It can also flexibly adjust the display content and display mode according to the actual scenario, thereby improving the safety and practicality of the in-vehicle multi-screen projection method.

[0026] 2. By adopting the above technical solution, the smart terminal establishes a one-to-one correspondence between content display permissions and screen display levels, thereby accurately allocating different types of projected content to the most appropriate in-vehicle display screen. This ensures that each in-vehicle display screen functions according to its screen display level and avoids the problem of inappropriate content being displayed in inappropriate locations. This approach also makes the smart terminal more efficient and controllable when handling in-vehicle multi-screen displays, thereby better balancing the needs of information display and driving safety requirements, and improving the practicality and safety of the entire in-vehicle multi-screen projection method.

[0027] 3. By employing the above technical solution, the intelligent terminal detects the driver's gaze focus in real time and issues a warning if it detects the driver's gaze remains fixed on the same in-vehicle display for an extended period of time. This effectively prevents drivers from ignoring road conditions due to excessive focus on the displayed content. This proactive warning mechanism, based on gaze tracking, can promptly detect and correct improper driver attention allocation, helping drivers maintain sustained attention to the road environment and improving the safety and practicality of in-vehicle multi-screen projection. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 This is a flowchart of the in-vehicle multi-screen projection method in an embodiment of the present application;

[0029] Figure 2 This is another flowchart of the in-vehicle multi-screen projection method according to an embodiment of the present application;

[0030] Figure 3 This is a schematic diagram of the physical device structure of the smart terminal in the embodiment of the present application. DETAILED DESCRIPTION

[0031] The terms used in the following examples of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. As used in the specification of the present application, the singular expressions "a", "an", "above", "the", and "this" are intended to include plural expressions as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used in the present application refers to any or all possible combinations of one or more of the listed items.

[0032] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0033] The following describes the execution subject of the method provided by this embodiment. The smart terminal refers to an electronic device used to control and manage the in-vehicle multi-screen projection method, which can be a mobile phone, remote control, tablet, etc., and is not limited here. The smart terminal can establish a connection with all the in-vehicle display screens in the vehicle, and the in-vehicle display screens can also establish a connection with each other to transmit data.

[0034] The following is a description of the process of the method provided by this implementation. Figure 1 , which is a flow chart of the in-vehicle multi-screen projection method in an embodiment of the present application.

[0035] S101, acquiring vehicle operation status data and driver attention status data, wherein the vehicle operation status data includes vehicle speed information, steering angle information, and driving trajectory information, and the driver attention status data includes facial fatigue information, eye movement information, head posture information, and hand control behavior information;

[0036] Among them, vehicle operation status data refers to various data information reflecting the current driving status of the vehicle, including vehicle speed information, steering angle information and driving trajectory information; vehicle speed information refers to the real-time driving speed value of the vehicle, in km / h; steering angle information refers to the deflection angle of the vehicle's steering wheel relative to the center axis of the vehicle body, in degrees; driving trajectory information is used to indicate the degree of deviation between the vehicle's driving path and the ideal path; driver attention status data refers to various data information reflecting the driver's current concentration level, including facial fatigue information, eye movement information, head posture information and hand control behavior information; facial fatigue information refers to the fatigue level value obtained through facial feature analysis; eye movement information refers to the frequency, range and other characteristics of the driver's eye movement; head posture information refers to the rotation angle and frequency of the driver's head; hand control behavior information refers to the driver's operating characteristics of control devices such as the steering wheel and gear lever.

[0037] Specifically, the smart terminal collects real-time vehicle speed through a vehicle speed sensor, steering wheel angle through a steering angle sensor, and driving trajectory data through GPS or an inertial navigation system. Furthermore, the smart terminal captures the driver's facial image through an in-car camera, analyzes facial features using computer vision algorithms to determine fatigue, obtains eye movement data through an eye tracking device, obtains head rotation data through a head posture detection device, and obtains hand control data through a steering wheel torque sensor. All of this data is continuously collected at a preset sampling frequency (e.g., 100ms) and updated in real time.

[0038] S102: Determine a risk level based on the vehicle operation status data and the driver attention status data;

[0039] Among them, the risk level refers to the assessment result of the degree of danger in the current driving scenario, which is usually divided into three levels: low risk, medium risk and high risk.

[0040] Specifically, first, the smart terminal normalizes the vehicle speed information, steering angle information, and driving trajectory information to obtain standardized values. Then, the smart terminal inputs the driver's attention status data into the pre-trained attention assessment model to obtain a driver attention score of 0-100. Next, the smart terminal inputs the standardized vehicle operation status data and the driver's attention score into the risk assessment model to obtain a risk prediction value between 0 and 1. Finally, the smart terminal divides the risk prediction value into three risk levels: low, medium, and high according to the preset risk thresholds (such as 0.3 and 0.7). The entire assessment process is completed within 100ms.

[0041] Optionally, under normal circumstances, the risk level can be determined based on the vehicle operating status data and the driver's attention status data in the following manner, which is not limited here: standardizing the vehicle operating status data to obtain a standardized vehicle speed value, a standardized steering angle value, and a standardized trajectory deviation value; obtaining a driver's attention score based on the facial fatigue information, the eye movement information, the head posture information, the hand control behavior information, and a preset attention assessment model; inputting the standardized vehicle speed value, the standardized steering angle value, the standardized trajectory deviation value, and the driver's attention score into a pre-trained risk assessment model to obtain a risk prediction value; and determining the corresponding risk level based on the numerical range of the risk prediction value.

[0042] Among them, standardization refers to the uniform conversion of data of different dimensions into the interval [0, 1]; standardized vehicle speed value refers to the vehicle speed data after standardization; standardized steering angle value refers to the steering wheel angle data after standardization; standardized trajectory deviation value refers to the distance data of the vehicle deviating from the lane centerline after standardization; attention assessment model refers to the algorithm model used to assess the driver's attention level; driver attention score refers to the attention level value calculated by the attention assessment model; risk assessment model refers to a machine learning model used to comprehensively assess driving risks; risk prediction value refers to the continuous risk indicator output by the risk assessment model; numerical interval refers to the value range of dividing the continuous risk prediction value into different risk levels.

[0043] Specifically, the smart terminal first acquires vehicle operating status data and driver attention status data. The smart terminal normalizes the vehicle operating status data, for example, mapping vehicle speeds from 0-200 km / h to a range of 0-1, steering angles from -720° to +720° to a range of 0-1, and track deviations from 0-100 cm to a range of 0-1. The smart terminal then uses a pre-set attention assessment model to calculate a driver attention score between 0 and 100 based on collected facial fatigue information (such as blink frequency and yawn frequency), eye movement information (such as gaze distribution and scan frequency), head posture information (such as head-down angle and head-turn frequency), and hand control behavior information (such as steering wheel fine-tuning frequency and operational smoothness). The smart terminal then inputs the normalized vehicle speed, steering angle, track deviation, and driver attention score into a pre-trained risk assessment model (such as a neural network model) to generate a risk prediction value between 0 and 1. Finally, the smart terminal determines the current risk level based on the preset risk level classification standards (such as 0-0.3 for low risk, 0.3-0.7 for medium risk, and 0.7-1 for high risk).

[0044] Before obtaining the driver's attention score based on the facial fatigue information, the eye movement information, the head posture information, the hand control behavior information and the preset attention assessment model, the following steps may be performed or not performed, and are not limited here: obtaining historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information and historical driver's attention scores; using the historical facial fatigue information, the historical eye movement information, the historical head posture information and the historical hand control behavior information as input and the historical driver's attention score as output to train the preset model; when the accuracy of the preset model exceeds the preset accuracy threshold, the attention assessment model is obtained.

[0045] The steps to build a deep learning-based attention estimation model are as follows:

[0046] First, the intelligent terminal obtains historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information and historical driver attention score from the storage system. The historical driver attention score can be obtained through expert evaluation, which is not limited here. The intelligent terminal stores the collected historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information and historical driver attention score in data set D in chronological order. The format of each data is (historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information, historical driver attention score). Among them, historical facial fatigue information, historical eye movement information, historical head posture information and historical hand control behavior information are input features of model training, and historical driver attention score is output feature of model training.

[0047] Secondly, the intelligent terminal performs data preprocessing on the dataset D and deletes the missing data and abnormal data in the dataset D.

[0048] The smart terminal then constructs an LSTM-based recurrent neural network, consisting of an input layer, two LSTM hidden layers, a fully connected layer, and an output layer. The input layer takes in historical information about facial fatigue, eye movements, head posture, and hand manipulation. The hidden layer has 64 nodes, the fully connected layer has 32 nodes, and the output layer outputs historical driver attention scores.

[0049] Next, the smart terminal uses the Adam optimizer with a learning rate of 0.001 and a training batch size of 32. These settings can be customized and are not set here. 80% of the historical data is divided into a training set and 20% into a validation set. Training is performed for 100 epochs, and the model with the highest validation set accuracy is retained. This can also be customized and is not set here. An epoch is the process by which a training dataset passes through the neural network once. In machine learning and deep learning, an epoch is a unit used to measure the number of times the entire training set is repeatedly learned. Specifically, an epoch is completed when the neural network completes a forward computation and backward propagation process, meaning that all data has been processed once. The smart terminal uses binary cross entropy as the loss function and employs early stopping to prevent overfitting. When the loss function value exceeds a preset threshold, model training is considered complete, resulting in an attention evaluation model. Early stopping is a technique used in deep learning and machine learning to prevent model overfitting. It monitors the model's performance on the validation set to determine when to stop training.

[0050] Finally, the smart terminal feeds the input features from the validation set into the attention evaluation model, which then generates the model's predicted output. The predicted output is then compared with the actual output features from the validation set, and the model's performance is evaluated using performance metrics such as accuracy, precision, recall, F1 score, and mean squared error (MSE). Based on the model's performance on the validation set, the model's parameters are adjusted, including the learning rate, model complexity (such as increasing or decreasing the number of neural network layers or nodes), and regularization strength. This process may require multiple iterations, with each adjustment based on the previous learning results, to optimize the attention evaluation model.

[0051] S103. Determine a screen display level for each of the plurality of vehicle-mounted display screens based on the risk level and a preset risk level-screen display level correspondence table, wherein the preset risk level-screen display level correspondence table includes screen display levels for each of the vehicle-mounted display screens corresponding to different risk levels, and the screen display levels correspond one-to-one to the content display permission;

[0052] Among them, the preset risk level-screen display level correspondence table refers to the configuration table of the screen display levels corresponding to each vehicle display screen under different risk levels; the screen display level refers to the content display permission currently allowed to be displayed on the vehicle display screen, which is usually divided into three levels: Level A, Level B, and Level C; the content display permission refers to the importance and display priority of the content to be projected, which is usually divided into three levels: Priority 1, Priority 2, and Priority 3; the vehicle display screen refers to various information display devices installed in the vehicle, including the central control screen, instrument panel, head-up display, etc.; there is a unique mapping relationship between the screen display level and the content display permission, that is, Level A corresponds to Priority 1, Level B corresponds to Priority 2, and Level C corresponds to Priority 3.

[0053] Specifically, the smart terminal reads a preset risk level-display level mapping table, which details the display levels for each vehicle display screen at different risk levels. For example, in a high risk level, the smart terminal sets the display level of the instrument cluster and center console to Level A, and the display level of the rear screens to Level B. This allows the instrument cluster and center console to display only Priority 1 critical driving information, while the rear screens can only display Priority 2 auxiliary information. In a medium risk level, the smart terminal sets the display level of the instrument cluster to Level A, the center console to Level B, and the rear screens to Level C, ensuring a more balanced distribution of displayed content. In a medium risk level, the smart terminal appropriately relaxes display restrictions, setting the display level of the instrument cluster and center console to Level B and the rear screens to Level C, allowing for the display of more non-critical information. This dynamic adjustment mechanism ensures a balanced distribution of displayed content across different risk levels, improving driving safety.

[0054] For example:

[0055] Assuming that a vehicle has three on-board display screens (instrument panel, central control screen, and rear screen), the risk levels are divided into low, medium, and high.

[0056] Preset risk level-screen display level correspondence table:

[0057] (a) Low risk level (e.g., vehicle parking):

[0058] Instrument panel display: Level B; Central control display: Level B; Rear display: Level C;

[0059] At this time, more entertainment functions are allowed to be displayed on the central control screen;

[0060] (b) Medium risk level (e.g. low speed driving):

[0061] Instrument panel display: Level A; Central control display: Level B; Rear display: Level C;

[0062] There are certain restrictions on what can be displayed at this time;

[0063] (c) High risk level (e.g. high speed driving):

[0064] Instrument panel display: Level A; Central control display: Level A; Rear display: Level B;

[0065] Strictly limit the display of non-essential information at this time

[0066] Specific application examples:

[0067] When the vehicle is parked in a parking lot (low risk level): the central control screen can display video content, the rear screens can play games, and the instrument panel can display multimedia information;

[0068] When the vehicle is driving on urban roads (medium risk): the instrument panel prioritizes displaying key information such as speed and fuel level, the central control screen can display auxiliary information such as navigation and reversing images, and the rear screen maintains entertainment functions;

[0069] When the vehicle is traveling at high speed on a highway (high risk): the instrument panel and central control screen will prioritize displaying key driving information, restricting the display of entertainment content, and the rear screens will also be partially restricted.

[0070] S104: Receive a screen projection instruction from the driver, where the screen projection instruction includes the content to be projected and an attribute tag of the content to be projected;

[0071] Among them, the screen projection command refers to the content projection request initiated by the driver, including the content to be projected and the attribute label of the content to be projected; the content to be projected refers to the specific information that needs to be displayed on the in-vehicle display screen, such as navigation, music, video, etc.; the attribute label is used to indicate the type and importance of the content to be projected, such as "Navigation Category - High Importance", "Entertainment Category - Low Importance", etc.

[0072] Specifically, the driver invokes the smart terminal's voice assistant and verbally expresses a screen projection command, such as "Hello, voice assistant, play the MV for 'I Love You.'" The smart terminal then receives the driver's screen projection command. Alternatively, the driver clicks the screen projection button on the smart terminal and confirms the content to be projected, and the smart terminal then receives the driver's screen projection command. The methods for the smart terminal to receive the driver's screen projection command are not limited and are not listed here.

[0073] Here are a few examples:

[0074] Example 1: Driving key information:

[0075] Content to be projected: Real-time vehicle speed displayed as "80km / h"; Attribute tag: Vehicle speed information;

[0076] Example 2: Driving assistance information:

[0077] Content to be projected: Navigation route from Beijing Road to Shanghai Road; Attribute tag: Navigation route;

[0078] Example 3: Entertainment information:

[0079] Content to be projected: Music currently playing; Property tag: Music playing...

[0080] S105: Determine the content display permission of the content to be projected based on the attribute tag and a preset attribute tag-content display permission correspondence table;

[0081] The preset attribute tag-content display permission correspondence table is a configuration table of different content display permissions corresponding to different attribute tags; content display permissions refer to the level requirements for the display of the content to be projected, including low, medium, and high levels; the correspondence between attribute tags and content display permissions is used to indicate the display permission levels required for content of different types and importance.

[0082] Specifically, the smart terminal first loads a preset attribute tag-display permission mapping table. This table details the display permission requirements for content of different types and importance levels, such as navigation-related content with high importance having high display permissions, and entertainment-related content with low importance having low display permissions. The smart terminal then searches the table based on the attribute tags of the content to be projected to obtain the corresponding content display permissions. If the content to be projected has multiple attribute tags, the highest-level content display permission is selected as the final permission. Finally, the smart terminal associates the determined content display permissions with the content to be projected and stores them for subsequent matching on the in-vehicle display screen.

[0083] (a) Preset attribute tag-content display permission correspondence table (navigation content)

[0084] "Navigation Route" tab → Priority 2,

[0085] "Real-time Traffic" tab → Priority 2,

[0086] Route Planning tab → Priority 2,

[0087] Matching process:

[0088] Content to be projected: Navigation route from home to work;

[0089] The attribute label is "Navigation Route";

[0090] Check the table to determine that the content display permission is Priority 2;

[0091] (b) Preset attribute tag-content display permission correspondence table (vehicle information content)

[0092] "Speed ​​Information" tab → Priority 1,

[0093] "Fuel Information" tab → Priority 1,

[0094] "Warning Information" tab → Priority 1,

[0095] Matching process:

[0096] Content to be projected: Current vehicle speed 80km / h;

[0097] The attribute label is "vehicle speed information";

[0098] Check the table to determine that the content display permission is Priority 1;

[0099] (c) Preset attribute tag-content display permission correspondence table (entertainment content)

[0100] "Video Playback" tab → Priority 3,

[0101] "Music Playback" tab → Priority 3,

[0102] "Game" tab → Priority 3,

[0103] Matching process:

[0104] Content to be projected: online video;

[0105] The attribute tag is "Video Playback";

[0106] The table check confirms that the content display permission is Priority 3...

[0107] S106: Match the content display permission with the screen display level to obtain a target vehicle display screen;

[0108] Among them, matching refers to the process of adapting the content display permission to the screen display level; the target vehicle display screen refers to the vehicle display screen that is ultimately selected to display the content to be projected.

[0109] Specifically, the smart terminal first reads the current screen display level of each in-vehicle display. Then, the smart terminal determines the corresponding screen display level based on the content display permissions of the content to be projected. Since each in-vehicle display corresponds to a screen display level, the smart terminal can then determine the target in-vehicle display.

[0110] Here is an example:

[0111] When a user wants to play a movie, the smart terminal reads the screen display levels of all current in-vehicle displays:

[0112] Instrument cluster display: Level A (the highest level, used to display key driving information),

[0113] Central control display: Level B (medium level, used to display driving assistance information),

[0114] Rear display: Level C (normal level, used to display entertainment content);

[0115] The smart terminal analyzes the content to be projected, identifying it as a movie and displaying Priority 3 (Entertainment). Based on the display permissions, the smart terminal determines that a Level C screen display is required. It then searches for a Level C in-vehicle display screen and finds that the rear-seat display screen is also Level C, identifying it as the target in-vehicle display screen. Finally, the movie is projected onto the rear-seat display screen, ensuring driver safety while still allowing rear passengers to enjoy the entertainment content.

[0116] Optionally, under normal circumstances, matching the content display permission with the screen display level to obtain the target vehicle display screen can be achieved in the following way, which is not limited here: determining the corresponding target screen display level based on the content display permission, and the content display permission corresponds to the screen display level one by one; based on the target screen display level, determining the target vehicle display screen.

[0117] Assume that a vehicle has three in-vehicle displays: instrument panel display (Level A), central control display (Level B), and rear entertainment display (Level C);

[0118] The correspondence between content display permissions and screen display levels:

[0119] Key driving information (Priority 1) → Level A (instrument panel) → vehicle speed, speed, fuel, etc.

[0120] Driving assistance information (Priority 2) → Level B (central control screen) → Navigation, reversing image, etc.

[0121] Entertainment information (Priority 3) → Level C (rear screen) → videos, games, etc.

[0122] Specific matching process:

[0123] The intelligent terminal determines that the content to be projected is the route from A to B. The attribute label of the content to be projected is the navigation route, and the corresponding content display permission is Priority 2. It is automatically matched to the screen display level of Level B, and finally determines that the content to be projected is displayed on the central control screen.

[0124] S107: Establish a projection connection with the target vehicle-mounted display screen, and project the content to be projected.

[0125] Among them, establishing a screen projection connection refers to the data transmission channel established between the smart terminal and the target vehicle-mounted display screen; projection refers to the process of transmitting the projection content to the target vehicle-mounted display screen and displaying it; the connection method for establishing a screen projection connection refers to the communication method between the smart terminal and the target vehicle-mounted display screen, including wired connection (such as HDMI, USB) and wireless connection (such as WiFi, Miracast).

[0126] Specifically, the smart terminal first attempts to establish a projection connection with the target vehicle display, prioritizing the optimal connection method currently available, such as a wired connection with greater bandwidth. Once the projection connection is established, the smart terminal performs the necessary format conversion and compression on the projected content to adapt to the display capabilities of the target vehicle display. The smart terminal then packets the processed content to be projected and transmits it to the target vehicle display. Simultaneously, the smart terminal monitors the transmission quality and automatically retransmits or switches to an alternative connection method if a transmission error occurs. Finally, the smart terminal confirms that the target vehicle display correctly displays the projected content, completing the entire projection process.

[0127] By adopting the above technical solution, the smart terminal obtains vehicle operation status data (vehicle speed information, steering angle information, and driving trajectory information) and driver attention status data (facial fatigue information, eye movement information, head posture information, and hand control behavior information) in real time to dynamically evaluate the driver's risk level of driving the vehicle, and determine the screen display level of different on-board display screens accordingly. At the same time, the smart terminal combines the attribute tags of the content to be projected with the content display permissions to achieve intelligent distribution and display control of the content to be projected. This multi-dimensional dynamic evaluation and intelligent matching mechanism can effectively prevent inappropriate projected content from distracting the driver's attention in dangerous scenarios, thereby reducing driving safety risks. It can also flexibly adjust the display content and display mode according to the actual scenario, thereby improving the safety and practicality of the in-vehicle multi-screen projection method.

[0128] The following is a more detailed description of the process of the method provided by this implementation. Figure 2 , which is another flow chart of the in-vehicle multi-screen projection method in an embodiment of the present application.

[0129] S201, acquiring vehicle operation status data and driver attention status data, wherein the vehicle operation status data includes vehicle speed information, steering angle information, and driving trajectory information, and the driver attention status data includes facial fatigue information, eye movement information, head posture information, and hand control behavior information;

[0130] For details, please refer to step S101, which will not be described again here.

[0131] S202: Determine a risk level based on the vehicle operation status data and the driver attention status data;

[0132] For details, please refer to step S102, which will not be described again here.

[0133] S203: Obtain the change trend of the risk level within a preset time window;

[0134] Among them, the preset time window refers to a pre-set period of continuous observation time, usually 3-10 seconds; the change trend refers to the direction and rate of change of the risk level within the preset time window, including an upward trend, a downward trend and a stable trend.

[0135] Specifically, first, the smart terminal reads the records of all risk levels within a preset time window length (such as 5 seconds) from the cache. Then, the smart terminal calculates the rate of change of the risk level over time through mathematical methods such as linear regression. The smart terminal compares the calculated rate of change with the preset trend determination threshold to determine whether it constitutes a valid change trend. The preset trend determination threshold is used to determine whether the rate of change of the risk level constitutes a valid change trend, and is usually set to a change rate of 0.2 levels per second. If the rate of change exceeds the positive preset trend determination threshold, it is determined to be an upward trend; if the rate of change is lower than the negative preset trend determination threshold, it is determined to be a downward trend; if the rate of change is between the two, it is determined to be a stable trend. Finally, the smart terminal stores the trend determination result for subsequent display control decisions.

[0136] S204: If the change trend is an upward trend, suspend the display of all screen projection content except navigation information;

[0137] Among them, an upward trend means that the growth rate of the risk level within the preset time window exceeds the positive preset trend judgment threshold; navigation information refers to the necessary information related to vehicle navigation, including route guidance, turn prompts, etc.; pause display refers to the temporary interruption of the display output of the projection content.

[0138] Specifically, the smart terminal first determines all currently projected content. It then sets the display status of all non-navigational projected content to pause and the display status of navigation information to maintain. The smart terminal also records the trigger time for the pause and the current risk level.

[0139] S205: If the risk level shows a downward trend, adjust the brightness of the vehicle display screen according to a preset brightness adjustment curve;

[0140] Among them, the downward trend refers to the reduction rate of the risk level within the preset time window exceeding the negative preset trend judgment threshold; the preset brightness adjustment curve refers to the brightness setting function of the vehicle display corresponding to different risk levels.

[0141] Specifically, first, the smart terminal reads the preset brightness adjustment curve, which defines the correspondence between the risk level and the brightness of the vehicle display screen. Generally, the lower the risk level, the higher the brightness of the allowed vehicle display screen. Then, the smart terminal searches for the corresponding target brightness value on the preset brightness adjustment curve according to the current risk level. To avoid sudden changes in brightness, the smart terminal calculates the difference between the current brightness value and the target brightness value, and smoothly transitions from the current brightness value to the target brightness value within a preset gradient time (such as 0.5 seconds). The preset gradient time is used to indicate the transition time required to complete the brightness adjustment of the vehicle display screen, which is used to avoid sudden changes in brightness. During the brightness adjustment process of the vehicle display screen, the smart terminal continuously monitors the risk level. If the trend of the risk level changes, the direction of brightness change is adjusted immediately.

[0142] S206. Determine a screen display level for each of the plurality of vehicle-mounted display screens based on the risk level and a preset risk level-screen display level correspondence table, wherein the preset risk level-screen display level correspondence table includes screen display levels for each of the vehicle-mounted display screens corresponding to different risk levels, and the screen display levels correspond one-to-one to the content display permission;

[0143] For details, please refer to step S103, which will not be described again here.

[0144] S207: Receive a screen projection instruction from the driver, where the screen projection instruction includes the content to be projected and an attribute tag of the content to be projected;

[0145] For details, please refer to step S104, which will not be described again here.

[0146] S208: Determine the content display permission of the content to be projected based on the attribute tag and a preset attribute tag-content display permission correspondence table;

[0147] For details, please refer to step S105, which will not be described again here.

[0148] S209: Match the content display permission with the screen display level to obtain a target vehicle display screen;

[0149] For details, please refer to step S106, which will not be described in detail here.

[0150] S210: Establishing a projection connection with the target vehicle-mounted display screen and projecting the content to be projected;

[0151] For details, please refer to step S107, which will not be described in detail here.

[0152] S211, obtaining the driver's gesture instruction;

[0153] Specifically, the smart terminal continuously monitors the driver's hand movements through the in-vehicle camera. After recognizing that the driver's hand has entered the preset gesture recognition area, the smart terminal activates the gesture recognition algorithm to analyze the characteristics of the driver's hand movements in real time. The preset gesture recognition area refers to the pre-set spatial range where gestures can be captured, usually located 20-40 cm above the steering wheel. The smart terminal matches the collected hand movements with the pre-stored gesture templates and calculates the matching degree. When the matching degree of a hand movement exceeds the preset matching degree threshold and the gesture duration exceeds the preset gesture duration threshold, the hand movement is determined to be a valid gesture instruction. The gesture duration refers to the minimum holding time required for the smart terminal to determine it as a valid gesture instruction, usually set to 0.3-0.5 seconds. The gesture instruction refers to the control intention issued by the driver through the hand movement. At the same time, the smart terminal records characteristic parameters such as gesture type, gesture direction, and gesture amplitude. If the gesture is ambiguous or multiple gestures are triggered simultaneously during the recognition process, the smart terminal will issue a prompt sound to request the driver to re-enter the gesture instruction. Gesture types include basic actions such as clicking, sliding, rotating, and pinching.

[0154] S212: Retrieve an interaction instruction corresponding to the gesture instruction from an interaction instruction mapping database, where different gesture instructions correspond to different interaction instructions, and the interaction instruction is used to control the vehicle display screen;

[0155] Among them, the interactive command mapping database refers to a data set that stores the correspondence between gesture commands and interactive commands; interactive commands refer to executable display control operations, such as brightness adjustment, content switching, etc.

[0156] Specifically, the smart terminal queries an interactive command mapping database, which details the mapping between various gesture commands and interactive commands, such as swiping upward to increase brightness or rotating to switch content. The smart terminal also determines the executable nature of gesture commands based on the current display state and risk level.

[0157] S213: Adjust the vehicle-mounted display screen based on the interactive instruction;

[0158] Specifically, the smart terminal first parses the operation type and parameter value in the interactive instruction. Then, the smart terminal selects the corresponding adjustment method based on the operation type, such as brightness adjustment, screen switching, etc. For gradual adjustments (such as brightness changes), the smart terminal will smoothly complete the adjustment within a preset gradient time (such as 0.3 seconds) to avoid sudden changes in parameters. During the adjustment process, the smart terminal will check in real time whether it exceeds the range allowed by the on-board display screen. If it exceeds the range, it will automatically limit it to the valid range. After each adjustment operation is completed, the smart terminal notifies the driver through screen prompts or sound feedback.

[0159] S214, detecting the driver's sight focus position in real time;

[0160] Among them, the focus of vision refers to the specific spatial location where the driver's eyes are looking; real-time detection refers to continuous vision tracking at a high frequency (usually 30-60Hz).

[0161] Specifically, the smart terminal continuously monitors the driver's gaze through in-car cameras and an eye-tracking system. First, the smart terminal locates the driver's eyes through real-time facial feature detection. Then, based on binocular vision principles, the smart terminal calculates the eye rotation angle and gaze direction vector. Next, the smart terminal maps the calculated gaze direction vector to the in-car spatial coordinate system to determine the intersection of the driver's gaze and the planes of each in-car display screen. Simultaneously, the smart terminal records the spatial coordinates and dwell time of each gaze point. If gaze tracking is interrupted by blinking, looking up, or other factors, the smart terminal quickly resumes tracking and compensates for the data during the interruption.

[0162] S215: If the sight focus is located on the same vehicle-mounted display screen within a preset time period, a warning is issued.

[0163] Among them, the preset duration refers to the time threshold for judging whether staring is too long, which is usually set to 2-3 seconds; the warning methods include sound prompts, vibration prompts, flashing display screens and other forms.

[0164] Specifically, first, the smart terminal calculates the cumulative duration of the focus of the gaze on each in-vehicle display screen area. When the smart terminal detects that the cumulative duration of the focus of the gaze on a certain in-vehicle display screen is close to the preset duration (e.g., 1.8 seconds), it first issues a slight warning. If the driver still does not shift his gaze, when the cumulative duration exceeds the preset duration (e.g., 2 seconds), the graded warning mechanism is immediately activated: (1) alert the driver through sound or vibration; (2) reduce the brightness of the in-vehicle display screen or temporarily freeze non-critical display content.

[0165] The following describes the intelligent terminal in the embodiment of the present invention from the perspective of hardware processing. Figure 3 , is a schematic diagram of a physical device structure of a smart terminal in an embodiment of the present application.

[0166] It should be noted that Figure 3 The structure of the smart terminal shown is only an example and should not limit the functions and scope of use of the embodiments of the present invention.

[0167] like Figure 3As shown, the intelligent terminal includes a central processing unit (CPU) 301, which can perform various appropriate actions and processes, such as the methods described in the above embodiments, based on programs stored in a read-only memory (ROM) 302 or programs loaded from a storage unit 308 into a random access memory (RAM) 303. RAM 303 also stores various programs and data required for system operation. CPU 301, ROM 302, and RAM 303 are interconnected via a bus 304. An input / output (I / O) interface 305 is also connected to bus 304.

[0168] The following components are connected to the I / O interface 305: an input section 306 including an audio input device, push button switches, and the like; an output section 307 including a liquid crystal display (LCD), an audio output device, indicator lights, and the like; a storage section 308 including a hard disk and the like; and a communication section 309 including a network interface card such as a LAN (Local Area Network) card or a modem. The communication section 309 performs communication processing via a network such as the Internet. A drive 310 is also connected to the I / O interface 305 as needed. Removable media 311, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 310 as needed, so that computer programs read from the removable media can be installed in the storage section 308 as needed.

[0169] In particular, according to embodiments of the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program including a computer program for executing the methods illustrated in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via the communication section 309 and / or installed from removable media 311. When executed by the central processing unit (CPU) 301, the computer program performs the various functions defined in the present invention.

[0170] It should be noted that specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), flash memory, optical fiber, portable compact disc read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0171] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. Each box in the flowchart or block diagram can represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings.

[0172] Specifically, the smart terminal of this embodiment includes a processor and a memory, and a computer program is stored in the memory. When the computer program is executed by the processor, the in-vehicle multi-screen projection method provided in the above embodiment is implemented.

[0173] As another aspect, the present invention further provides a computer-readable storage medium, which may be included in the smart terminal described in the above embodiments, or may exist independently and not be incorporated into the smart terminal. The storage medium carries one or more computer programs, which, when executed by a processor of the smart terminal, enable the smart terminal to implement the in-vehicle multi-screen projection method provided in the above embodiments.

[0174] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0175] As used in the above embodiments, the term “when” may be interpreted to mean “if” or “after” or “in response to determining that” or “in response to detecting that”, depending on the context. Similarly, the phrases “upon determining that” or “if (stated condition or event) is detected” may be interpreted to mean “if determining that” or “in response to determining that” or “upon detecting (stated condition or event)” or “in response to detecting (stated condition or event)”, depending on the context.

[0176] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

Claims

1. A vehicle-mounted multi-screen projection method, characterized in that: Applied to a smart terminal, the method includes: Acquiring vehicle operating status data and driver attention status data, wherein the vehicle operating status data includes vehicle speed information, steering angle information, and driving trajectory information, and the driver attention status data includes facial fatigue information, eye movement information, head posture information, and hand control behavior information; determining a risk level based on the vehicle operating status data and the driver attention status data; Determining a screen display level for each of the plurality of vehicle-mounted display screens based on the risk level and a preset risk level-screen display level correspondence table, wherein the preset risk level-screen display level correspondence table includes screen display levels for each of the vehicle-mounted display screens corresponding to different risk levels, and the screen display levels correspond one-to-one to content display permissions; Receive a screen projection instruction from a driver, wherein the screen projection instruction includes content to be projected and an attribute tag of the content to be projected; Determining the content display permission of the content to be projected based on the attribute tag and a preset attribute tag-content display permission correspondence table; Matching the content display permission with the screen display level to obtain a target vehicle display screen; Establish a projection connection with the target vehicle-mounted display screen and project the content to be projected.

2. The method according to claim 1, characterized in that The determining of the risk level according to the vehicle operation status data and the driver attention status data specifically includes: Normalizing the vehicle running state data to obtain a normalized vehicle speed value, a normalized steering angle value, and a normalized trajectory deviation value; Obtaining a driver attention score based on the facial fatigue information, the eye movement information, the head posture information, the hand manipulation behavior information, and a preset attention assessment model; Inputting the normalized vehicle speed value, the normalized steering angle value, the normalized trajectory deviation value, and the driver attention score into a pre-trained risk assessment model to obtain a risk prediction value; The corresponding risk level is determined according to the numerical range of the risk prediction value.

3. The method according to claim 2, characterized in that Before the step of obtaining the driver's attention score based on the facial fatigue information, the eye movement information, the head posture information, the hand manipulation behavior information, and a preset attention assessment model, the method further includes: Obtain historical facial fatigue information, historical eye movement information, historical head posture information, historical hand control behavior information, and historical driver attention scores; The preset model is trained using the historical facial fatigue information, the historical eye movement information, the historical head posture information, and the historical hand manipulation behavior information as input and the historical driver attention score as output; When the accuracy of the preset model exceeds a preset accuracy threshold, the attention evaluation model is obtained.

4. The method according to claim 2, characterized in that After the step of determining the risk level based on the vehicle operating status data and the driver attention status data, the method further includes: Obtaining a change trend of the risk level within a preset time window; If the change trend is an upward trend, suspend the display of all screen projection content except navigation information; If the risk level shows a downward trend, the brightness of the vehicle display screen is adjusted according to a preset brightness adjustment curve.

5. The method according to claim 1, wherein The matching of the content display permission with the screen display level to obtain a target vehicle display screen specifically includes: Determining a corresponding target screen display level according to the content display authority, wherein the content display authority corresponds to the screen display level in a one-to-one manner; The target vehicle display screen is determined based on the target screen display level.

6. The method according to claim 1, characterized in that After the steps of establishing a projection connection with the target vehicle-mounted display screen and projecting the content to be projected, the method further includes: Obtaining a gesture instruction from the driver; Retrieving an interaction instruction corresponding to the gesture instruction from an interaction instruction mapping database, wherein the interaction instruction mapping database includes different interaction instructions corresponding to different gesture instructions, and the interaction instruction is used to control the vehicle display screen; Based on the interactive instruction, the vehicle-mounted display screen is adjusted.

7. The method according to claim 1, characterized in that After the steps of establishing a projection connection with the target vehicle-mounted display screen and projecting the content to be projected, the method further includes: Real-time detection of the driver's sight focus position; If the focus of vision is located on the same vehicle display screen within a preset time period, an early warning is issued.

8. An intelligent terminal, characterized in that: The smart terminal includes: one or more processors and a memory; the memory is coupled to the one or more processors, the memory is used to store computer program code, the computer program code includes computer instructions, and the one or more processors call the computer instructions to enable the smart terminal to execute the method according to any one of claims 1 to 7.

9. A computer-readable storage medium comprising instructions, characterized in that: When the instruction is executed on a smart terminal, the smart terminal is caused to execute the method according to any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is run on an intelligent terminal, the intelligent terminal is enabled to execute the method according to any one of claims 1 to 7.

Images