Vehicle-mounted screen control method and device, vehicle and storage medium

Abstract

The invention relates to a control method and device for a vehicle-mounted screen, a vehicle and a storage medium, and the control method comprises the steps: displaying a first operation interface on a main display screen under the condition of recognizing that the vehicle has a driving risk; the first operation interface is configured to display takeover reminding information, and the takeover reminding information is used for reminding a driver to execute takeover operation on the vehicle; monitoring the takeover operation of the vehicle; displaying a second operation interface on an auxiliary display screen after the main display screen displays the first operation interface and under the condition that the takeover operation of the vehicle fails within the preset takeover time; the second operation interface is configured to receive an intelligent driving control instruction of a target passenger, the intelligent driving control instruction is used for indicating the vehicle to start an intelligent driving mode, and the target passenger is a passenger on a seat corresponding to the auxiliary display screen. According to the invention, the problem that a driver does not take over the vehicle timely when the vehicle-mounted screen is controlled to carry out safety reminding is solved.

Description

Technical Field

[0001] This application relates to the field of in-vehicle screen interaction, and particularly to a control method, device, vehicle, and storage medium for in-vehicle screens. Background Art

[0002] The human-machine mode switching of autonomous vehicles is one of the current focuses of the intelligent vehicle industry. According to the standards of the National Highway Traffic Safety Administration in the United States, Level 3 autonomous driving can achieve driverless operation in specific traffic environments, but the driver still needs to intervene in the operation loop when necessary, that is, switch back from the autonomous driving mode to the manual driving mode. The switching of the autonomous driver-machine mode includes driver reminder, current status and manual operation prompt, execution of closed-loop intervention, etc. Among them, driver reminder is an important step in the human-machine mode switching because the driver can only perform subsequent operations in the reminder state. Therefore, how to remind the driver is the key to solving the human-machine switching problem.

[0003] In the related art, generally, the driver is reminded by voice alarm or controlling the in-vehicle screen to display safety information. However, since the driver may sometimes be inattentive, it is very likely that the driver does not notice the safety reminder, thus missing the opportunity to manually take over the vehicle, resulting in traffic accidents.

[0004] Currently, there is no effective solution to the problem that the driver fails to take over in a timely manner when controlling the in-vehicle screen for safety reminder in the related art. Summary of the Invention

[0005] Embodiments of this application provide a control method, device, vehicle, and storage medium for in-vehicle screens, so as to at least solve the problem that the driver fails to take over in a timely manner when controlling the in-vehicle screen for safety reminder in the related art.

[0006] In a first aspect, embodiments of this application provide a control method for an in-vehicle screen. The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to other seats in the vehicle except the driver's seat. The method includes:

[0007] When it is recognized that the vehicle has a driving risk, display a first operation interface on the main display screen. The first operation interface is configured to display takeover reminder information, and the takeover reminder information is used to remind the driver to perform a takeover operation on the vehicle.

[0008] Monitor the takeover operation of the vehicle.

[0009] After the first operation interface is displayed on the main display screen and it is detected that the takeover operation of the vehicle fails within a preset takeover time, a second operation interface is displayed on the secondary display screen; the second operation interface is configured to receive a smart driving control instruction from a target occupant, and the smart driving control instruction is used to instruct the vehicle to start the intelligent driving mode; the target occupant is the occupant in the seat corresponding to the secondary display screen.

[0010] In some embodiments, monitoring the takeover operation of the vehicle includes:

[0011] Obtain the vehicle status safety value of the vehicle;

[0012] Based on the comparison result between the vehicle status safety value and a preset safety threshold, determine whether the takeover operation of the vehicle fails.

[0013] In some embodiments, the method further includes:

[0014] Obtain the risk discovery time when it is recognized that the vehicle has a driving risk, and calculate the predicted dangerous situation occurrence time and the predicted intelligent driving control time;

[0015] According to the risk discovery time, the predicted dangerous situation occurrence time, and the predicted intelligent driving control time, calculate the preset takeover time;

[0016] Within the preset takeover time, monitor whether the takeover operation of the vehicle fails.

[0017] In some embodiments, calculating the predicted dangerous situation occurrence time includes:

[0018] Obtain the environmental data collected by the sensing devices deployed on the vehicle, obtain the historical collision accident data of the driving section where the vehicle is located, and obtain the vehicle driving data of the driving section;

[0019] According to the environmental data, the historical collision accident data, and the vehicle driving data, calculate the predicted dangerous situation occurrence time.

[0020] In some embodiments, displaying the second operation interface on the secondary display screen includes:

[0021] Obtain the target seat among the other seats in the vehicle except the driver's seat where a corresponding secondary display screen is set, and obtain the pressure detection signal for the target seat;

[0022] Based on the pressure detection signal, determine the target occupant in the vehicle, and display the second operation interface on the secondary display screen corresponding to the seat where the target occupant is located.

[0023] In some of these embodiments, in the case where, after the first operation interface is displayed on the main display screen and a takeover operation of the vehicle fails to be monitored within a preset takeover time, a second operation interface is displayed on the secondary display screen, which includes:

[0024] Configure a secondary information overlay mode for the secondary display screen;

[0025] After the first operation interface is displayed on the main display screen and a takeover operation of the vehicle fails to be monitored within a preset takeover time, based on the secondary information overlay mode, control the secondary display screen to overlay and display the second operation interface.

[0026] In some of these embodiments, after the second operation interface is displayed on the secondary display screen, the method further includes:

[0027] Control the secondary display screen to receive the intelligent driving control instruction of the target occupant via the second operation interface;

[0028] Analyze the intelligent driving control instruction and control the vehicle to execute the corresponding intelligent driving mode; the intelligent driving mode includes an intelligent driving takeover mode, a vehicle speed limit mode, a nearest safe parking point mode, and a route switching mode.

[0029] In a second aspect, an embodiment of the present application provides a control device for an in-vehicle screen. The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to other seats in the vehicle except the driver's seat; the device includes:

[0030] A first operation reminder module, configured to display a first operation interface on the main display screen when it is recognized that the vehicle has a driving risk; the first operation interface is configured to display a takeover reminder message, and the takeover reminder message is used to remind the driver to perform a takeover operation on the vehicle;

[0031] A takeover operation monitoring module, configured to monitor the takeover operation of the vehicle;

[0032] A second operation reminder module, configured to display a second operation interface on the secondary display screen when, after the first operation interface is displayed on the main display screen and a takeover operation of the vehicle fails to be monitored within a preset takeover time; the second operation interface is configured to receive an intelligent driving control instruction of a target occupant, and the intelligent driving control instruction is used to instruct the vehicle to start an intelligent driving mode; the target occupant is the occupant on the seat corresponding to the secondary display screen.

[0033] In a third aspect, an embodiment of the present application provides a vehicle, including a controller and an in-vehicle screen;

[0034] The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to the other seats in the vehicle except the driver's seat.

[0035] The controller includes a memory and a processor. A computer program is stored in the memory, and the processor is configured to run the computer program to execute the control method of the in-vehicle screen described in the first aspect above.

[0036] In a fourth aspect, an embodiment of the present application provides a storage medium on which a computer program is stored. When the program is executed by a processor, it implements the control method of the in-vehicle screen described in the first aspect above.

[0037] Compared with the related art, for the control method, device, vehicle, and storage medium of the in-vehicle screen provided by the embodiments of the present application, the in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to the other seats in the vehicle except the driver's seat. When it is recognized that the vehicle has a driving risk, a first operation interface is displayed on the main display screen. The first operation interface is configured to display a takeover reminder message, and the takeover reminder message is used to remind the driver to perform a takeover operation on the vehicle. The takeover operation of the vehicle is monitored. When it is monitored that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen, a second operation interface is displayed on the secondary display screen. The second operation interface is configured to receive an intelligent driving control instruction from a target occupant, and the intelligent driving control instruction is used to instruct the vehicle to start the intelligent driving mode. The target occupant is the occupant on the seat corresponding to the secondary display screen.

[0038] Based on this, an open setting of the intelligent driving operation permission for the secondary display screen is realized, so that when the driver does not timely discover the reminder message, the occupants in front of other secondary display screens can timely operate to start the corresponding intelligent driving mode, solving the problem that the driver fails to take over in time when controlling the in-vehicle screen for safety reminders. At the same time, through steps such as real-time monitoring, takeover reminder, and intelligent driving control instructions, the safety of the vehicle and passengers can be ensured to the greatest extent, effectively improving the safety and reliability of vehicle driving.

[0039] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more concise and understandable. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments and descriptions thereof of the present application are used to explain the present application and do not constitute an improper limitation of the present application. In the drawings:

[0041] Figure 1It is a hardware structure block diagram of a terminal for a method of controlling an in-vehicle screen according to an embodiment of the present application;

[0042] Figure 2 It is a flowchart of a method of controlling an in-vehicle screen according to an embodiment of the present application;

[0043] Figure 3 It is a flowchart of another method of controlling an in-vehicle screen according to an embodiment of the present application;

[0044] Figure 4 It is a structure block diagram of a device for controlling an in-vehicle screen according to an embodiment of the present application. Detailed implementation manners

[0045] In order to make the objectives, technical solutions and advantages of the present application clearer and more understandable, the present application will be described and explained below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments provided in the present application without making creative efforts fall within the scope of protection of the present application. In addition, it can also be understood that although the efforts made in this development process may be complex and lengthy, for those of ordinary skill in the art related to the content disclosed in the present application, some design, manufacturing or production changes based on the technical content disclosed in the present application are only conventional technical means and should not be understood as insufficient disclosure of the content of the present application.

[0046] Referring to "embodiment" in the present application means that a specific feature, structure or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The phrase appears in various positions in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those of ordinary skill in the art explicitly and implicitly understand that the embodiments described in the present application may be combined with other embodiments without conflict.

[0047] Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the ordinary meanings understood by those with ordinary skills in the technical field to which this application belongs. The words such as "a", "an", "one kind", "the" and the like involved in this application do not indicate a limitation in quantity and may represent a singular or plural number. The terms "comprise", "include", "have" and any variations thereof involved in this application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or modules (units) is not limited to the listed steps or units, but may further include unlisted steps or units, or may further include other steps or units inherent to these processes, methods, products or devices. The words such as "connect", "be connected", "couple" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "plurality" involved in this application means greater than or equal to two. "And / or" describes the association relationship of associated objects and indicates that three relationships may exist. For example, "A and / or B" may represent: A exists alone, A and B exist simultaneously, and B exists alone. The terms "first", "second", "third" and the like involved in this application are only used to distinguish similar objects and do not represent a specific order of the objects.

[0048] The method embodiment provided in this embodiment can be executed on a terminal, a computer or a similar computing device. Taking running on a terminal as an example, Figure 1 is a hardware structure block diagram of a terminal for a vehicle-mounted screen control method according to an embodiment of this application. As Figure 1 shown, the terminal may include one or more ( Figure 1 only one is shown in the figure) processors 102 (the processor 102 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data. Optionally, the above terminal may further include a transmission device 106 for communication functions and an input / output device 108. Those of ordinary skill in the art can understand that Figure 1 the structure shown in the figure is only schematic and does not limit the structure of the above terminal. For example, the terminal may further include more or fewer components than Figure 1 shown in the figure, or have a different configuration from Figure 1 shown in the figure.

[0049] The memory 104 can be used to store computer programs, such as software programs and modules of application software, such as the computer program corresponding to the control method of the vehicle-mounted screen in the embodiments of the present application. The processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, that is, the above-mentioned method is implemented. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memories, or other non-volatile solid-state memories. In some instances, the memory 104 may further include a memory remotely disposed relative to the processor 102, and these remote memories can be connected to the terminal through a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0050] The transmission device 106 is used to receive or send data via a network. Specific examples of the above-mentioned network may include a wireless network provided by a communication provider of the terminal. In one instance, the transmission device 106 includes a network adapter (Network Interface Controller, abbreviated as NIC), which can be connected to other network devices through a base station and thus can communicate with the Internet. In one instance, the transmission device 106 can be a radio frequency (Radio Frequency, abbreviated as RF) module, which is used to communicate with the Internet wirelessly.

[0051] This embodiment provides a control method for a vehicle-mounted screen. The vehicle-mounted screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to other seats in the vehicle except the driver's seat. Specifically, the vehicle-mounted screen includes a plurality of display screens, and the plurality of display screens include a main display screen and a plurality of secondary display screens. The main display screen corresponds to the driver's seat in the vehicle, and the plurality of secondary display screens 120 respectively correspond to other seats in the vehicle. The number of secondary display screens can be determined by the number of other seats in the vehicle except the driver's seat, and the present application does not make a special limitation.

[0052] Figure 2 is a flowchart of a control method for a vehicle-mounted screen according to an embodiment of the present application, as Figure 2 shown, and the process includes the following steps:

[0053] Step S210, when it is recognized that there is a driving risk for the vehicle, display a first operation interface on the main display screen; the first operation interface is configured to display a takeover reminder message, and the takeover reminder message is used to remind the driver to perform a takeover operation on the vehicle.

[0054] Among them, the vehicle monitoring system can be used to monitor the traffic conditions, road conditions or other environmental information around the vehicle in real time to identify potential driving risks. The vehicle monitoring system includes devices such as radars, cameras, and sensors deployed inside and outside the vehicle. It can be understood that the driving risks can include any one or a combination of multiple ones such as a vehicle approaching, malicious lane changing, sudden braking ahead, road narrowing, the light ahead dimming, insufficient light and the vehicle not turning on the lights, etc.

[0055] Once a driving risk is identified, the controller will control the main display screen to immediately display the first operation interface. This interface contains a takeover reminder message, which is used to clearly inform the driver that there is a current driving risk and remind him to immediately take over the vehicle control right. For example, the takeover reminder message can be... It should be understood that while the main display screen jumps to the first operation interface to display the takeover reminder message, it is also possible to control the vehicle's built-in speaker, warning lights and other sound and light devices to also give a takeover operation reminder to the driver.

[0056] It should be added that in the prior art, when there is a driving risk, intelligent driving is mostly triggered by intervening at the first time. However, there are also cases where intelligent driving cannot determine whether it should intervene, which results in the loss of the best intervention time. To improve the above problems, in this step, when a driving risk is identified, the takeover reminder message is displayed on the first operation interface of the main display screen. Therefore, the human judgment ability can be used as a supplementary ability to enter the judgment time standard of intelligent driving.

[0057] Step S220, monitor the takeover operation of the vehicle.

[0058] In this step, it will continuously monitor whether the driver takes over the operation of the vehicle. This monitoring method can be achieved by using various sensors built into the vehicle to detect whether the driver holds the steering wheel, steps on the brake, etc. Or, it is also possible to collect the vehicle and its surrounding road condition environment information, calculate the safety value of the current vehicle driving in combination with the collected information, and thereby determine whether the vehicle driving condition has reached the preset safety value, and further determine whether the takeover operation of the vehicle has been successfully executed.

[0059] If it is monitored that the driver quickly and correctly takes over the vehicle after identifying the risk, then the entire process will end here.

[0060] Step S230, when it is monitored that the takeover operation of the vehicle fails within the preset takeover time after the first operation interface is displayed on the main display screen, display the second operation interface on the secondary display screen; the second operation interface is configured to receive the intelligent driving control instruction of the target occupant, and the intelligent driving control instruction is used to instruct the vehicle to start the intelligent driving mode; the target occupant is the occupant in the seat corresponding to the secondary display screen.

[0061] The above preset takeover time can be preset and stored in combination with the actual situation. Specifically, the expected takeover time can be the time when it is expected that the driver or other authorized occupants in the vehicle can perform takeover operations on the vehicle (such as manually controlling the vehicle, pressing the confirmation button, etc.); for this expected takeover time, timing can start from when the first operation interface is displayed on the main display screen. Or, the expected takeover time can be the human intervention response time provided when a driving risk is identified; for this expected takeover time, timing can start from the moment when the vehicle driving risk is identified through the above steps.

[0062] If no takeover operation on the vehicle by the driver is monitored within the preset takeover time (for example, 5 seconds or 10 seconds), or the takeover operation fails (for example, although the driver holds the steering wheel but the vehicle is still in danger), then the controller executes the next step to ensure that when the vehicle intelligent driving system needs to intervene in the subsequent steps, the intervention time will not exceed the latest braking point or the latest steering wheel avoidance point.

[0063] At this time, a second operation interface is displayed on the secondary display screen of the vehicle (usually located at other positions in the vehicle, such as the rear seat entertainment system or the screen in front of the co-pilot); this second operation interface is specifically designed to receive intelligent driving control instructions from the target occupant (i.e., the occupant in the seat corresponding to the secondary display screen). The triggering method of this intelligent driving control instruction can be: after the target occupant receives the takeover operation reminder information displayed on the secondary display screen through the second operation interface, and / or the reminder information output by sound and light devices such as speakers, the target occupant inputs the intelligent driving control instruction to the second operation interface by means of touching the screen or voice commands, etc.; this instruction is usually used to instruct the vehicle to start the corresponding intelligent driving mode, such as the automatic driving mode or the emergency obstacle avoidance mode, etc., thus realizing the function of opening the intelligent driving operation permission to the secondary display screen in such emergency situations where the driver's human intervention is not timely. After the controller receives the intelligent driving control instruction, it will immediately execute the corresponding operation to try to avoid or mitigate the driving risk. For example, if the instruction is to start the automatic driving mode, then the vehicle will try to automatically adjust parameters such as the driving method, speed and distance, etc. to maintain safe driving.

[0064] It should be noted that in this embodiment, the vehicle intelligent driving system has added a preset function; different from the original function that is triggered when encountering problems, this configuration function indicates that the vehicle intelligent driving system is in a pre-execution mode and waits for the intelligent driving reception instruction. Then, when receiving the intelligent driving control instruction, the vehicle intelligent driving system will enter the corresponding intelligent driving mode from the pre-execution mode. Additionally, if the vehicle intelligent driving system automatically recognizes the need to intervene in intelligent driving control after detecting that the driver has not taken risk avoidance operations in a timely manner and before receiving the intelligent driving control instruction, it can automatically start the intelligent driving mode first; in other words, after the driver has not taken risk avoidance operations, the vehicle intelligent driving system intervenes in risk avoidance, and the intervention time is determined based on the earliest time among the automatic discovery time and the target occupant reminder time.

[0065] In practical applications, the above processes also need to consider local laws, regulations, and traffic rules. For example, in some areas, autonomous vehicles may need to drive on specific roads or during specific time periods and need to comply with specific traffic signs and signals.

[0066] In the above control method of the in-vehicle screen, when a takeover operation of the vehicle fails to be monitored within a preset takeover time after the first operation interface is displayed on the main display screen, a second operation interface for receiving the intelligent driving control instruction of the target occupant is displayed on the secondary display screen, thereby realizing the open setting of the intelligent driving operation permission of the secondary display screen, enabling other occupants in front of the secondary display screen to operate and start the corresponding intelligent driving mode in a timely manner when the driver does not discover the reminder information in time, solving the problem that the driver fails to take over in a timely manner when controlling the in-vehicle screen for safety reminders. At the same time, through steps such as real-time monitoring, takeover reminder, and intelligent driving control instruction, the safety of the vehicle and passengers can be ensured to the greatest extent, effectively improving the safety and reliability of vehicle driving.

[0067] In some of these embodiments, monitoring the takeover operation of the vehicle may further include the following steps:

[0068] Obtain the vehicle state safety value of the vehicle; based on the comparison result between the vehicle state safety value and a preset safety threshold, determine whether the takeover operation of the vehicle fails.

[0069] Specifically, simultaneously with or after the first operation interface is displayed on the main display screen of the vehicle, the controller will obtain various state parameters of the vehicle through various sensors deployed on the vehicle, such as vehicle speed, acceleration, steering angle, braking state, and surrounding environment perception data. These state parameters will be comprehensively processed into one or more vehicle state safety values; the vehicle state safety value is used to reflect the current safety condition or risk level of the vehicle.

[0070] After that, the vehicle state safety value is compared with a preset safety threshold to determine whether the driver's takeover operation of the vehicle fails. The safety threshold is preset according to factors such as the vehicle's design, road regulations, and safety standards, and is used to determine whether the vehicle state is within the safe range. If the vehicle state safety value is lower than the safety threshold, it indicates that the vehicle is in an unsafe state, and no effective takeover operation is detected in this state to restore the vehicle's driving state to a safe state, then it can be determined that the takeover operation fails.

[0071] Through the above embodiments, based on the comparison result between the calculated vehicle state safety value and the safety threshold, it is possible to more accurately determine whether the takeover operation fails, and provide a backup plan when necessary to ensure the safety and controllability of the vehicle in different situations.

[0072] In some of the embodiments, the above method for controlling the in-vehicle screen further includes the following steps:

[0073] Obtain the risk discovery time when it is recognized that the vehicle has a driving risk, and calculate the predicted dangerous situation occurrence time and the predicted intelligent driving control time; according to the risk discovery time, the predicted dangerous situation occurrence time, and the predicted intelligent driving control time, calculate the preset takeover time; within the preset takeover time, monitor whether the takeover operation of the vehicle fails.

[0074] The above predicted dangerous situation occurrence time refers to the predicted time data of the actual occurrence of the dangerous situation; the predicted dangerous situation occurrence time usually needs to be comprehensively evaluated according to factors such as the risk discovery time and the vehicle's current state and driving environment. The predicted intelligent driving control time refers to the time required for the vehicle's intelligent driving system to take control measures (such as braking, steering, etc.) from receiving the intelligent driving control instruction. This time depends on the response speed of the intelligent driving system, the efficiency of the control algorithm, and the performance of the vehicle hardware. By calculating the time difference between the risk occurrence time and the predicted dangerous situation occurrence time, and calculating the time difference between this time difference and the predicted intelligent driving control time, a predicted takeover time can be calculated.

[0075] Within the preset takeover time, the system needs to continuously monitor whether the driver has successfully taken over the vehicle and taken corresponding measures to avoid the occurrence of the dangerous situation. If the driver fails to successfully take over the vehicle or fails to take effective measures to avoid the occurrence of the dangerous situation within the preset takeover time, it can be determined that the takeover operation fails. At this time, further measures can be taken to ensure the safety of the vehicle.

[0076] More specifically, the above takeover process should satisfy the following relational expression: reminder time + manual operation time + time from when intelligent driving intervenes after manual operation fails to the safety value < predicted dangerous situation occurrence time - risk discovery time.

[0077] For example, during vehicle driving, when it is recognized that another vehicle is approaching and the distance between the vehicles exceeds a set threshold (such as 10 cm), the time of risk discovery T0 is recorded at this time. Through algorithm model prediction, a dangerous situation such as a collision will occur to the vehicle within the next T1 time. According to factors such as the driver's reaction time and the braking performance of the vehicle, the preset takeover time is set to T2 (T2 should be less than T1 to ensure that the driver has enough time to take over the vehicle and / or the intelligent driving has enough time to intervene). Within the T2 time, continuously monitor the driver's takeover operation. If the driver fails to successfully take over the vehicle or fails to take effective measures to avoid the dangerous situation, the system can determine that the takeover operation fails and take corresponding safety measures.

[0078] Through the above embodiments, the predicted takeover time is calculated based on the calculated predicted dangerous situation occurrence time, and the takeover operation of the vehicle is monitored within the preset takeover time, so that a certain time can be reserved for the vehicle intelligent driving system to intervene in control, which is beneficial to improving the safety of vehicle driving control.

[0079] In some of these embodiments, calculating the predicted dangerous situation occurrence time may further include the following steps:

[0080] Obtain the environmental data collected by the sensing devices deployed on the vehicle, obtain the historical collision accident data of the driving section where the vehicle is located, and obtain the vehicle driving data of the driving section; calculate the predicted dangerous situation occurrence time according to the environmental data, historical collision accident data, and vehicle driving data.

[0081] The above environmental data includes but is not limited to information about obstacles around the vehicle (such as other vehicles, pedestrians, road obstacles, etc.), road conditions (such as slippery road surface, potholes, etc.), weather conditions (such as rain, snow, fog, etc.), and traffic signs and signals, etc. These data are usually collected in real time by sensing devices such as on-vehicle radars, cameras, lidars, and global positioning systems. The historical collision accident data includes the records of collision accidents that occurred on the driving section where the vehicle is located in the past period of time, which can be obtained from channels such as traffic management departments, insurance companies, and scientific research institutions. The vehicle driving data of the driving section includes information such as the driving speed, driving direction, and acceleration of other vehicles on this section during the current time period; these data can be obtained through channels such as vehicle networking technology and traffic monitoring systems.

[0082] By performing preprocessing such as data cleaning on the above various types of data, and using the trained algorithm model to make predictions for the preprocessed comprehensive data, the time of predicted dangerous situation occurrence can be obtained. In summary, by comprehensively considering the environmental data collected by the sensing devices, historical collision accident data, and vehicle driving data, the predicted dangerous situation occurrence time can be calculated more accurately, providing strong support for the decision-making and control of the intelligent driving system.

[0083] In some of these embodiments, the above-mentioned display of the second operation interface on the secondary display screen may further include the following steps:

[0084] Obtain a target seat in other seats in the vehicle except the driver's seat, where a corresponding secondary display screen is provided, and obtain a pressure detection signal for the target seat; based on the pressure detection signal, determine the target occupant in the vehicle, and display the second operation interface on the secondary display screen corresponding to the seat where the target occupant is located.

[0085] Install pressure sensors on each seat in the vehicle, and these sensors can sense and measure the pressure change on the seat. The pressure sensor can be a resistive, capacitive, piezoelectric or other type of sensor. According to the collected pressure detection signal, analyze the pressure distribution on each seat, and then judge which seats have occupants. Finally, according to the vehicle interior layout and the occupant distribution, determine which secondary display screen corresponding to the seat should display the second operation interface, thus realizing the display control of the second operation interface on the secondary display screen corresponding to the seat where the target occupant is seated.

[0086] More specifically, in this embodiment, for each seat in the vehicle, which can be each other seat except the driver's seat, at least one corresponding secondary display screen can be allocated respectively; or a corresponding secondary display screen can be allocated for some seats. Based on this, when detecting the target occupant, the detection can be combined with the vehicle interior seats and the allocation of the secondary display screens. For example, assume that there are the following seats in the vehicle: the driver's seat has a main and secondary display screen, the co-driver's seat has a secondary display screen, the left rear seat has no secondary display screen, and the right rear seat has a secondary display screen. Then when detecting the target occupant, only obtain the pressure detection signals of the two target seats, namely the co-driver's seat and the right rear seat, to determine whether there are target occupants sitting on these two seats, and display the second operation interface on the secondary display screen corresponding to the seat where the target occupant is located.

[0087] In addition, in an optional embodiment, if it is detected that there is no occupant sitting on the target seat, the pressure detection signals of the remaining seats in the vehicle except the driver's seat and the target seat can be obtained, and when it is detected that there are other occupants sitting on the remaining seats, according to the vehicle interior layout and the occupant distribution, determine the seat in the target seats that is closest to the seat where the detected other occupant is located, and then display the second operation interface on the secondary display screen corresponding to the determined seat.

[0088] In some of these embodiments, the above-mentioned display of the second operation interface on the secondary display screen when a takeover operation of the vehicle fails is monitored within a preset takeover time after the first operation interface is displayed on the main display screen, includes:

[0089] Configure a secondary information overlay mode for the secondary display screen; when a takeover operation of the vehicle is detected to fail within a preset takeover time after the first operation interface is displayed on the main display screen, based on the secondary information overlay mode, control the secondary display screen to overlay and display the second operation interface.

[0090] In this embodiment, a secondary information processing and display method is adopted, that is, the above-mentioned secondary information overlay mode. Specifically, the secondary information overlay mode refers to: the primary mode, where each operation interface and information display interface (such as movie navigation music settings, etc.) takes user operations as the first priority, and for secondary information processing, the second operation interface is used to overlay any selections made in the first-level information operations.

[0091] In the above manner, when there are congestion and accident risks ahead, the danger warning information is placed on the outermost surface of the screen, and the screen at the position where the user is sitting remains the same, in case the driver does not see it and is reminded by other-position users, so as to effectively ensure that the target occupant in the seat corresponding to the secondary display screen can timely discover the reminder information, which is beneficial to improving the safety of vehicle driving.

[0092] In some of these embodiments, after the second operation interface is displayed on the secondary display screen, the method further includes:

[0093] Control the secondary display screen to receive the intelligent driving control instruction of the target occupant via the second operation interface; analyze the intelligent driving control instruction, and control the vehicle to execute the corresponding intelligent driving mode; the intelligent driving mode includes an intelligent driving takeover mode, a vehicle speed limit mode, a nearest safe parking point mode, and a route switching mode.

[0094] Among them, on the second operation interface of the secondary display screen, a clear and intuitive user interface is designed, including options or buttons for intelligent driving control instructions. The options or buttons should clearly label their functions, such as "Intelligent Driving Takeover", "Vehicle Speed Limit", "Nearest Safe Parking Point", and "Route Switching", etc.

[0095] When the target occupant selects or clicks on a certain intelligent driving control instruction on the secondary display screen through touch screen technology, gesture recognition, or voice control, etc., the received intelligent driving control instruction is analyzed to determine the specific operation that the occupant hopes the vehicle to execute, and the vehicle is controlled to execute the corresponding intelligent driving mode, thereby improving the safety of vehicle driving.

[0096] The following describes the present application with specific embodiments. Please refer to Figure 3 , and the control method of the in-vehicle screen further includes the following steps:

[0097] Step S301, turn on the control function. The controller defaults that the functions described in the above method are in the on state. The user can also manually turn off this function after the vehicle owner's identity is recognized and in the state of no accident in the past year.

[0098] Step S302, collect vehicle driving information through the original vehicle monitoring system composed of sensing devices such as external vehicle radars, lidars, and cameras.

[0099] Step S303, the vehicle body processor receives the collected vehicle driving information from the above step, and comprehensively processes and judges whether there are situations such as a vehicle approaching, malicious lane changing, sudden braking ahead, road narrowing, the light ahead becoming darker, insufficient light and the vehicle not turning on the lights, etc., to identify whether there is a driving risk for the vehicle.

[0100] Step S304, the vehicle intelligent driving system is in the pre-execution mode, waiting for instructions.

[0101] Step S305, the audio screen processor enters the audio and video pre-reminder stage according to the output signal of the vehicle monitoring system.

[0102] Step S306, identify who is sitting on other seats except the driver's seat through the seat pressure sensor to determine the target passenger.

[0103] Step S307, control the main display screen to display a takeover reminder message on the first operation interface; among them, enter the synchronous reminder of text, video and audio to prevent the driver from not receiving the message.

[0104] Step S308, monitor whether the driver has successfully taken over the vehicle through operation monitoring information such as the reverse angle of the steering wheel (i.e., turning the steering wheel away from the dangerous direction), whether to brake in time, and whether to accelerate and avoid.

[0105] Step S309, if the judgment result of the above step S308 is yes, it is determined that the driver has controlled the vehicle to avoid risks; at the same time, the vehicle intelligent driving system is added to play an auxiliary role to make up for the driver's operation loss as much as possible.

[0106] Step S310, if the judgment result of the above step S308 is no, it means that the driver did not see and perform risk avoidance operations in time. Then, based on the target passenger identified in step S306, display the second operation interface on the secondary display screen corresponding to the seat where the target passenger is located, and receive the intelligent driving control instruction indicating that the vehicle intelligent driving system enters the intelligent driving mode from the pre-execution mode through the second operation interface.

[0107] It should be noted that the steps shown in the above process or the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. And although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in a different order than here.

[0108] This embodiment also provides a control device for a vehicle-mounted screen. The vehicle-mounted screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to other seats in the vehicle except the driver's seat. This device is used to implement the above-mentioned embodiments and preferred implementation manners, and those that have been described will not be repeated. As used hereinafter, terms such as "module", "unit", "sub-unit", etc. can be a combination of software and / or hardware that can achieve a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, implementation in hardware, or a combination of software and hardware is also possible and contemplated.

[0109] Figure 4 is a structural block diagram of a control device for a vehicle-mounted screen according to an embodiment of the present application. As Figure 4 shown, the device includes: a first operation reminder module 41, a takeover operation monitoring module 42, and a second operation reminder module 43; where:

[0110] The first operation reminder module 41 is used to display a first operation interface on the main display screen when it is recognized that there is a driving risk for the vehicle; the first operation interface 41 is configured to display takeover reminder information, and the takeover reminder information is used to remind the driver to perform a takeover operation on the vehicle.

[0111] The takeover operation monitoring module 42 is used to monitor the takeover operation of the vehicle.

[0112] The second operation reminder module 42 is used to display a second operation interface on the secondary display screen when it is detected that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen; the second operation interface is configured to receive an intelligent driving control instruction from a target occupant, and the intelligent driving control instruction is used to instruct the vehicle to start the intelligent driving mode; the target occupant is the occupant on the seat corresponding to the secondary display screen.

[0113] In some of these embodiments, the above-mentioned takeover operation monitoring module 42 is further used to obtain the vehicle state safety value of the vehicle; the takeover operation monitoring module 42 is further used to determine whether the takeover operation of the vehicle fails based on the comparison result between the vehicle state safety value and a preset safety threshold.

[0114] In some of these embodiments, the takeover operation monitoring module 42 is further configured to obtain the risk discovery time when a driving risk of the vehicle is recognized, and calculate the predicted danger occurrence time and the predicted intelligent driving control time; the takeover operation monitoring module 42 is further configured to calculate a preset takeover time according to the risk discovery time, the predicted danger occurrence time, and the predicted intelligent driving control time; the takeover operation monitoring module is further configured to monitor whether the takeover operation of the vehicle fails within the preset takeover time.

[0115] In some of these embodiments, the takeover operation monitoring module 42 is further configured to obtain the environmental data collected by the sensing devices deployed on the vehicle, obtain the historical collision accident data of the driving section where the vehicle is located, and obtain the vehicle driving data of the driving section; the takeover operation monitoring module 42 is further configured to calculate the predicted danger occurrence time according to the environmental data, the historical collision accident data, and the vehicle driving data.

[0116] In some of these embodiments, the second operation reminder module 43 is further configured to obtain a target seat in other seats in the vehicle except the driver's seat, where a corresponding secondary display screen is provided, and obtain a pressure detection signal for the target seat; the second operation reminder module 43 is further configured to determine a target occupant in the vehicle based on the pressure detection signal, and display a second operation interface on the secondary display screen corresponding to the seat where the target occupant is located.

[0117] In some of these embodiments, the second operation reminder module 43 is further configured to configure a secondary information overlay mode for the secondary display screen; the second operation reminder module is further configured to, when the takeover operation of the vehicle fails is monitored within the preset takeover time after the first operation interface is displayed on the main display screen, control the secondary display screen to overlay and display the second operation interface based on the secondary information overlay mode.

[0118] In some of these embodiments, the second operation reminder module 43 is further configured to control the secondary display screen to receive the intelligent driving control instruction of the target occupant via the second operation interface; the second operation reminder module 43 is further configured to parse the intelligent driving control instruction and control the vehicle to execute the corresponding intelligent driving mode; the intelligent driving mode includes an intelligent driving takeover mode, a vehicle speed limit mode, a nearest safe parking point mode, and a route switching mode.

[0119] It should be noted that the above-mentioned various modules can be functional modules or program modules, and can be implemented either by software or by hardware. For the modules implemented by hardware, the above-mentioned various modules can be located in the same processor; or the above-mentioned various modules can also be located in different processors in any combined form.

[0120] This embodiment also provides a vehicle, including a controller and an in-vehicle screen;

[0121] The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat in the vehicle, and the secondary display screen corresponds to the other seats in the vehicle except the driver's seat.

[0122] The controller includes a memory and a processor. A computer program is stored in the memory. The processor is configured to run the computer program to execute the steps in any of the above method embodiments.

[0123] Optionally, the above controller may further include a transmission device and an input / output device. Among them, the transmission device is connected to the above processor, and the input / output device is connected to the above processor.

[0124] Optionally, in this embodiment, the above processor may be configured to execute the following steps through a computer program:

[0125] S1, when it is recognized that the vehicle has a driving risk, display a first operation interface on the main display screen; the first operation interface is configured to display a takeover reminder message, and the takeover reminder message is used to remind the driver to perform a takeover operation on the vehicle.

[0126] S2, monitor the takeover operation of the vehicle.

[0127] S3, when it is monitored that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen, display a second operation interface on the secondary display screen; the second operation interface is configured to receive a smart driving control instruction from a target occupant, and the smart driving control instruction is used to instruct the vehicle to start the intelligent driving mode; the target occupant is the occupant on the seat corresponding to the secondary display screen.

[0128] It should be noted that the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and will not be elaborated here.

[0129] In addition, in combination with the above-mentioned control method of the in-vehicle screen in the embodiment, the embodiment of the present application can be implemented by providing a storage medium. A computer program is stored on the storage medium; when the computer program is executed by a processor, it implements any one of the above-mentioned control methods of the in-vehicle screen.

[0130] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data that have been authorized by the user or fully authorized by all parties.

[0131] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memories can include read-only memory (ROM), magnetic tapes, floppy disks, flash memories, optical memories, high-density embedded non-volatile memories, resistive random access memories (ReRAM), magnetoresistive random access memories (MRAM), ferroelectric random access memories (FRAM), phase change memories (PCM), graphene memories, etc. Volatile memories can include random access memory (RAM) or external cache memories, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logics, data processing logics based on quantum computing, etc., without limitation.

[0132] Those skilled in the art should understand that the technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0133] The above embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the scope of the invention patent. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A control method for an in-vehicle screen, characterized in that The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat inside the vehicle, and the secondary display screen corresponds to other seats inside the vehicle except the driver's seat; the method includes: When it is recognized that the vehicle has a driving risk, display a first operation interface on the main display screen; the first operation interface is configured to display a takeover reminder message, and the takeover reminder message is used to remind the driver to perform a takeover operation on the vehicle; Monitor the takeover operation of the vehicle; When it is monitored that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen, display a second operation interface on the secondary display screen; the second operation interface is configured to receive an intelligent driving control instruction from a target occupant, and the intelligent driving control instruction is used to instruct the vehicle to start an intelligent driving mode; the target occupant is the occupant on the seat corresponding to the secondary display screen.

2. The control method according to claim 1, wherein The monitoring of the takeover operation of the vehicle includes: Obtain the vehicle state safety value of the vehicle; Based on the comparison result between the vehicle state safety value and a preset safety threshold, determine whether the takeover operation of the vehicle fails.

3. The control method according to claim 1, wherein The method further includes: Obtain the risk discovery time when it is recognized that the vehicle has a driving risk, and calculate the predicted dangerous situation occurrence time and the predicted intelligent driving control time; Calculate the preset takeover time according to the risk discovery time, the predicted dangerous situation occurrence time, and the predicted intelligent driving control time; Within the preset takeover time, monitor whether the takeover operation of the vehicle fails.

4. The control method according to claim 3, wherein The calculation of the predicted dangerous situation occurrence time includes: Obtain the environmental data collected by the sensing devices deployed on the vehicle, obtain the historical collision accident data of the driving section where the vehicle is located, and obtain the vehicle driving data of the driving section; Calculate the predicted dangerous situation occurrence time according to the environmental data, the historical collision accident data, and the vehicle driving data.

5. The control method according to claim 1, wherein The displaying of the second operation interface on the secondary display screen includes: Obtain the target seat among the other seats inside the vehicle except the driver's seat where a corresponding secondary display screen is set, and obtain the pressure detection signal for the target seat; Based on the pressure detection signal, determine the target occupant inside the vehicle, and display the second operation interface on the secondary display screen corresponding to the seat where the target occupant is located.

6. The control method according to claim 1, characterized in that, When it is monitored that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen, the displaying of the second operation interface on the secondary display screen includes: Configure a secondary information overlay mode for the secondary display screen; When it is monitored that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen, based on the secondary information overlay mode, control the secondary display screen to overlay and display the second operation interface.

7. The control method according to any one of claims 1 to 6, characterized in that, After the second operation interface is displayed on the secondary display screen, the method further includes: Control the secondary display screen to receive the intelligent driving control instruction from the target occupant via the second operation interface; Parse the intelligent driving control instruction and control the vehicle to execute the corresponding intelligent driving mode; the intelligent driving mode includes an intelligent driving takeover mode, a vehicle speed limit mode, a nearest safe parking point mode, and a route switching mode.

8. A control device for an in-vehicle screen, characterized in that, The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat inside the vehicle, and the secondary display screen corresponds to the other seats inside the vehicle except the driver's seat. The device includes: A first operation reminder module, configured to display a first operation interface on the main display screen when it is recognized that there is a driving risk for the vehicle; the first operation interface is configured to display a takeover reminder message, and the takeover reminder message is used to remind the driver to perform a takeover operation on the vehicle. A takeover operation monitoring module, configured to monitor the takeover operation of the vehicle. A second operation reminder module, configured to display a second operation interface on the secondary display screen when it is monitored that the takeover operation of the vehicle fails within a preset takeover time after the first operation interface is displayed on the main display screen; the second operation interface is configured to receive an intelligent driving control instruction from a target occupant, and the intelligent driving control instruction is used to instruct the vehicle to start the intelligent driving mode; the target occupant is the occupant on the seat corresponding to the secondary display screen.

9. A vehicle, characterized in that, It includes a controller and an in-vehicle screen; The in-vehicle screen includes a main display screen and a secondary display screen. The main display screen corresponds to the driver's seat inside the vehicle, and the secondary display screen corresponds to the other seats inside the vehicle except the driver's seat. The controller includes a memory and a processor. The memory stores a computer program, and the processor is configured to run the computer program to execute the control method of the in-vehicle screen according to any one of claims 1 to 7.

10. A storage medium, characterized in that, A computer program is stored in the storage medium, wherein the computer program is configured to execute the control method of the in-vehicle screen according to any one of claims 1 to 7 when running.

Images