Human-computer interaction design method of intelligent cockpit system, electronic device and medium

Abstract

The application discloses a man-machine interaction design method of an intelligent cockpit system, an electronic device and a medium. The man-machine interaction design method of the intelligent cockpit system comprises the following steps: fatigue detection is performed on a driver by using a vehicle-mounted camera in the intelligent cockpit, and it is judged whether the driver has a fatigue state; if it is detected that the driver has a fatigue state, an auxiliary driving mode is started; a navigation route to a parking point closest to the intelligent cockpit is inquired, and prompt information is pushed to the driver; and if response information of the driver is not received after a first preset time threshold, an automatic driving mode is started to control a vehicle corresponding to the intelligent cockpit to go to the parking point. The application solves the technical problem of low safety in a fatigue driving state.

Description

Technical Field

[0001] This application relates to the field of intelligent cockpits, and more particularly to a human-computer interaction design method, electronic device and storage medium for an intelligent cockpit system. Background Technology

[0002] With the development of automotive intelligence, modern cars can now provide users with interactive functions such as music playback, lighting control, and receiving vehicle status information through in-cabin devices. The fragmented layout and information overload of traditional car cabins have created obstacles to human-vehicle interaction, leading to an underestimation of the car's value as an interaction point. Currently, people are increasingly concerned about driving safety, and accidents caused by prolonged fatigue driving are numerous. Therefore, corresponding detection methods for driver status have been developed. However, current solutions for driver fatigue mainly involve various methods to refresh the driver, failing to address the root cause of driver fatigue and resulting in excessively low safety standards for fatigued driving. Summary of the Invention

[0003] The main purpose of this application is to provide a human-computer interaction design method, electronic device and medium for an intelligent cockpit system, which aims to solve the technical problem of low safety under fatigue driving conditions.

[0004] To achieve the above objectives, this application provides a human-computer interaction design method for an intelligent cockpit system, the method comprising:

[0005] The driver fatigue is detected by the in-vehicle camera in the smart cockpit to determine whether the driver is fatigued.

[0006] If driver fatigue is detected, the assisted driving mode is activated.

[0007] The system queries the navigation route to the nearest parking spot to the smart cockpit and sends a notification to the driver.

[0008] If no response is received from the driver after a first preset time threshold, the autonomous driving mode is activated to control the vehicle corresponding to the smart cockpit to proceed to the parking spot.

[0009] Optionally, the step of detecting driver fatigue using an in-vehicle camera within the smart cockpit to determine whether the driver is fatigued includes:

[0010] The driver's facial image information is collected by the vehicle-mounted camera in the smart cockpit, and the recognition points are extracted from the facial image information.

[0011] The driver's head posture is determined based on a preset head model and recognition points in the facial image information;

[0012] Based on the head posture and the recognition points, it is determined whether the driver is currently fatigued.

[0013] When the duration of the driver's current fatigue state exceeds a second preset time threshold, it is determined that the driver is fatigued.

[0014] Optionally, the step of determining the driver's head posture based on a preset head model and recognition points in the facial image information includes:

[0015] Based on each preset recognition point in the recognition points, establish a mapping matrix between the facial image information and the preset head model;

[0016] The current 3D head model is obtained by adjusting the preset head model according to the mapping matrix.

[0017] The driver's head posture is determined based on the preset head model and the current three-dimensional head model.

[0018] Optionally, the step of determining whether the driver is currently fatigued based on the head posture and the recognition point includes:

[0019] The lateral and longitudinal change amplitudes are determined based on the movement of each identification point.

[0020] Determine whether the amplitude of the horizontal change and the amplitude of the vertical change exceed a preset change threshold;

[0021] If the lateral change amplitude or the longitudinal change amplitude exceeds the preset change threshold, the driver is determined to be fatigued.

[0022] Optionally, the step of querying navigation routes to the nearest parking spot to the smart cockpit and pushing notification information to the driver includes:

[0023] Use in-vehicle navigation software to query the location information of parking spots within a preset distance around the intelligent cockpit;

[0024] The navigation routes from the current location to each of the aforementioned parking spots are compared to determine the parking spot with the shortest estimated driving time.

[0025] The navigation route from the current location to the parking spot will be pushed to the driver, and a voice prompt will be issued.

[0026] Optionally, before the step of detecting driver fatigue using an in-vehicle camera within the smart cockpit to determine whether the driver is fatigued, the method further includes:

[0027] The user inputs preset initial commands through a visual input interface. The preset initial commands include various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command.

[0028] When the driver is detected to have entered the smart cockpit, the system controls the smart cockpit to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

[0029] Optionally, the step of controlling the smart cockpit to perform corresponding initial operations based on current time information, current vehicle status information, and preset initial instructions when a user is detected entering the smart cockpit includes:

[0030] Pressure detection is performed on the seats in the smart cockpit;

[0031] When the pressure value on the seat exceeds a first preset pressure threshold, it is determined that the driver has entered the smart cockpit;

[0032] Based on the current time information and the current vehicle status information, the corresponding smart cockpit control command is retrieved from the preset initial command. The current vehicle status information includes at least one of temperature information, vehicle operation information, and vehicle body sensor information.

[0033] According to the intelligent cockpit control command, control the intelligent cockpit to perform the initial operation corresponding to the intelligent cockpit control command.

[0034] Optionally, after the step of determining that the driver has entered the smart cockpit when the pressure value detected on the seat exceeds a first preset pressure threshold, the method further includes:

[0035] Determine whether the pressure value applied to the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value applied to the seat when a preset user sits down;

[0036] If so, then the driver is determined to be the preset user;

[0037] If not, the driver is determined not to be the preset user, and a notification message is pushed to the preset user.

[0038] This application also provides a human-computer interaction design device for an intelligent cockpit system, which is applied to a human-computer interaction design equipment for an intelligent cockpit system. The human-computer interaction design device for the intelligent cockpit system includes:

[0039] The fatigue detection module is used to detect driver fatigue through an in-vehicle camera in the smart cockpit and determine whether the driver is fatigued.

[0040] The driver assistance module is used to activate the driver assistance mode if driver fatigue is detected.

[0041] The navigation module is used to query the navigation route to the nearest parking spot to the smart cockpit and push prompt information to the driver;

[0042] The autonomous driving module is used to activate the autonomous driving mode and control the vehicle corresponding to the smart cockpit to proceed to the parking spot if no response information is received from the driver after a first preset time threshold.

[0043] Optionally, the fatigue detection module is further used for:

[0044] The driver's facial image information is collected by the vehicle-mounted camera in the smart cockpit, and the recognition points are extracted from the facial image information.

[0045] The driver's head posture is determined based on a preset head model and recognition points in the facial image information;

[0046] Based on the head posture and the recognition points, it is determined whether the driver is currently fatigued.

[0047] When the duration of the driver's current fatigue state exceeds a second preset time threshold, it is determined that the driver is fatigued.

[0048] Optionally, the fatigue detection module is further used for:

[0049] Based on each preset recognition point in the recognition points, establish a mapping matrix between the facial image information and the preset head model;

[0050] The current 3D head model is obtained by adjusting the preset head model according to the mapping matrix.

[0051] The driver's head posture is determined based on the preset head model and the current three-dimensional head model.

[0052] Optionally, the fatigue detection module is further used for:

[0053] The lateral and longitudinal change amplitudes are determined based on the movement of each identification point.

[0054] Determine whether the amplitude of the horizontal change and the amplitude of the vertical change exceed a preset change threshold;

[0055] If the lateral change amplitude or the longitudinal change amplitude exceeds the preset change threshold, the driver is determined to be fatigued.

[0056] Optionally, the navigation module is further configured to:

[0057] Use in-vehicle navigation software to query the location information of parking spots within a preset distance around the intelligent cockpit;

[0058] The navigation routes from the current location to each of the aforementioned parking spots are compared to determine the parking spot with the shortest estimated driving time.

[0059] The navigation route from the current location to the parking spot will be pushed to the driver, and a voice prompt will be issued.

[0060] Optionally, the initial module is further configured to:

[0061] Pressure detection is performed on the seats in the smart cockpit;

[0062] When the pressure value on the seat exceeds a first preset pressure threshold, it is determined that the driver has entered the smart cockpit;

[0063] Based on the current time information and the current vehicle status information, the corresponding smart cockpit control command is retrieved from the preset initial command. The current vehicle status information includes at least one of temperature information, vehicle operation information, and vehicle body sensor information.

[0064] According to the intelligent cockpit control command, control the intelligent cockpit to perform the initial operation corresponding to the intelligent cockpit control command.

[0065] Optionally, the initial module is further configured to:

[0066] Determine whether the pressure value applied to the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value applied to the seat when a preset user sits down;

[0067] If so, then the driver is determined to be the preset user;

[0068] If not, the driver is determined not to be the preset user, and a notification message is pushed to the preset user.

[0069] Optionally, the initial module is further configured to:

[0070] Collect the driver's facial image information, and determine whether the driver is a preset user based on the facial image information;

[0071] If not, a notification message will be pushed to the preset user.

[0072] Optionally, the authentication module is further configured to:

[0073] When the driver's interactive command voice is detected, the interactive command voice is identified through the voiceprint authentication model to determine whether the interactive command voice matches the preset voiceprint.

[0074] If the interactive command voice matches the preset voiceprint, then the voiceprint authentication status of the interactive command voice is set to voiceprint authentication passed.

[0075] If the interactive command voice does not match the preset voiceprint, the voiceprint authentication status of the interactive command voice is set to voiceprint authentication failure, and a notification message is pushed to the preset user.

[0076] Optionally, the execution module is further configured to:

[0077] Extract the interactive commands from the voice commands, and query the corresponding cockpit devices based on the interactive commands;

[0078] The cockpit equipment is controlled to perform the interactive operation corresponding to the interactive command according to the interactive command.

[0079] Optionally, the execution module is further configured to:

[0080] When the decrease in pressure on the seat of the smart cockpit exceeds a second preset pressure threshold, a voice prompt is sent to the driver, wherein the voice prompt is used to ask the driver whether he / she needs to turn off the various cockpit devices in the smart cockpit.

[0081] When a device shutdown command is received from the driver, the various cockpit devices in the smart cockpit are initialized.

[0082] Optionally, the human-machine interaction design device of the intelligent cockpit system also includes an initialization module:

[0083] Optionally, the initialization module is further configured to:

[0084] The user inputs preset initial commands through a visual input interface. The preset initial commands include various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command.

[0085] When the driver is detected to have entered the smart cockpit, the system controls the smart cockpit to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

[0086] Optionally, the initialization module is further configured to:

[0087] The user inputs preset initial commands through a visual input interface. The preset initial commands include various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command.

[0088] When the driver is detected to have entered the smart cockpit, the system controls the smart cockpit to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

[0089] Optionally, the initialization module is further configured to:

[0090] Determine whether the pressure value applied to the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value applied to the seat when a preset user sits down;

[0091] If so, then the driver is determined to be the preset user;

[0092] If not, the driver is determined not to be the preset user, and a notification message is pushed to the preset user.

[0093] This application also provides an electronic device, which is a physical device, comprising: a memory, a processor, and a program for the human-computer interaction design method of the intelligent cockpit system stored in the memory and executable on the processor. When the program for the human-computer interaction design method of the intelligent cockpit system is executed by the processor, it can implement the steps of the human-computer interaction design method of the intelligent cockpit system as described above.

[0094] This application also provides a computer-readable storage medium storing a program for implementing a human-computer interaction design method for an intelligent cockpit system. When the program for the human-computer interaction design method for the intelligent cockpit system is executed by a processor, it implements the steps of the human-computer interaction design method for the intelligent cockpit system as described above.

[0095] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the human-computer interaction design method for the intelligent cockpit system described above.

[0096] This application provides a human-computer interaction design method, electronic device, and medium for an intelligent cockpit system. First, an in-vehicle camera within the intelligent cockpit detects driver fatigue to determine if the driver is fatigued. If fatigue is detected, an assisted driving mode is activated. Navigation routes to the nearest parking spot are then retrieved, and a notification is sent to the driver. If no response is received from the driver after a first preset time threshold, an autonomous driving mode is activated, controlling the vehicle corresponding to the intelligent cockpit to proceed to the parking spot. By detecting driver fatigue, automatically switching driving modes, and retrieving the nearest parking spot, this application fundamentally overcomes driver fatigue, effectively preventing traffic accidents caused by fatigued driving and improving safety during fatigued driving. Attached Figure Description

[0097] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0098] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0099] Figure 1 This is a flowchart illustrating the first embodiment of the human-computer interaction design method for the intelligent cockpit system of this application;

[0100] Figure 2 This is a flowchart illustrating the second embodiment of the human-computer interaction design method for the intelligent cockpit system of this application;

[0101] Figure 3 This is a table showing the correspondence between time information and vehicle status information for intelligent cockpit control commands in the first embodiment of the human-computer interaction design method for the intelligent cockpit system of this application.

[0102] Figure 4 This is a schematic diagram of the human-computer interaction design device for the intelligent cockpit system of this application;

[0103] Figure 5 This is a schematic diagram of the equipment structure of the hardware operating environment involved in the human-computer interaction design method of the intelligent cockpit system in this application embodiment.

[0104] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0105] To make the above-mentioned objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0106] Example 1

[0107] As people pay more and more attention to driving safety, there are countless traffic accidents caused by prolonged fatigue driving. Therefore, corresponding detection methods have been developed for drivers' driving status. However, the current way to deal with drivers in a fatigued state is mainly to use various methods to refresh the driver and make them regain their alertness. This cannot fundamentally solve the problem of driving fatigue, resulting in low safety of fatigue driving.

[0108] This application provides a human-computer interaction design method for an intelligent cockpit system. In the first embodiment of the human-computer interaction design method for the intelligent cockpit system of this application, refer to... Figure 1 The human-computer interaction design method of the intelligent cockpit system includes:

[0109] Step S10: The driver is fatigued by using the in-vehicle camera in the smart cockpit to determine whether the driver is fatigued.

[0110] Step S20: If the driver is detected to be fatigued, then the assisted driving mode is activated;

[0111] Step S30: Query the navigation route to the nearest parking spot to the smart cockpit and push a prompt message to the driver;

[0112] Step S40: If no response from the driver is received after the first preset time threshold, then activate the autonomous driving mode to control the vehicle corresponding to the smart cockpit to proceed to the parking spot.

[0113] In this embodiment, it should be noted that the assisted driving mode is used to deal with sudden situations in the driving state, such as emergency braking when encountering an obstacle ahead, an upcoming vehicle ahead, or other dangerous situations. It also includes auxiliary operations such as controlling vehicle speed, turning on lights, and automatically activating turn signals when turning or overtaking, to prevent the driver from neglecting detailed operations due to fatigue. The automatic driving mode is used to control the vehicle when the driver cannot respond to prompts, i.e., has entered a sleep state, to safely bring the driver to the parking spot.

[0114] As an example, steps S10 to S40 include: acquiring the driver's facial image information through the in-vehicle camera in the smart cockpit; determining whether the driver is fatigued based on the driver's facial image information; if the driver is detected to be fatigued, activating the assisted driving mode to ensure driving safety; querying the navigation route to the nearest parking spot to the smart cockpit and pushing a prompt to the driver to indicate whether the driver needs to go to the nearest parking spot; when the driver's instruction to go to the parking spot is received, pushing the navigation route to the driver in a visual manner; if no response is received from the driver after a first preset time threshold, activating the autonomous driving mode and controlling the vehicle corresponding to the smart cockpit to go to the nearest parking spot.

[0115] The step of detecting driver fatigue and determining whether the driver is fatigued via an in-vehicle camera in the smart cockpit includes:

[0116] Step S11: Collect facial image information of the driver through the vehicle-mounted camera in the smart cockpit, and extract the recognition points from the facial image information;

[0117] Step S12: Determine the driver's head posture based on the preset head model and the recognition points in the facial image information;

[0118] Step S13: Determine whether the driver is currently fatigued based on the head posture and the recognition point;

[0119] Step S14: When the duration of the driver's current fatigue state exceeds the second preset time threshold, it is determined that the driver is in a fatigue state.

[0120] In this embodiment, it should be noted that the recognition point is used to characterize the position information of each facial organ in the facial image information, such as the eyes and mouth, and the head posture includes looking down, looking up, and looking straight ahead; the second preset time threshold is used to accurately detect the driver's fatigue state and to eliminate misjudgments caused by the driver's brief head-down or other interfering actions.

[0121] As an example, steps S11 to S14 include: acquiring facial image information of the driver through the vehicle-mounted camera in the smart cockpit, and extracting recognition points corresponding to the driver's facial organs from the facial image information, each recognition point being used to identify the position information of each face; determining the driver's head posture based on the position information of each recognition point and a preset head model, wherein the preset head model includes the position information of the recognition points under various head postures; determining whether the driver's head is in a head-down state based on the head posture and the recognition points; if the driver's head is in a head-down state, determining that the driver is currently in a fatigue state; recording the duration of the driver's fatigue state, and determining that the driver is fatigued when the duration exceeds a second preset time threshold.

[0122] The step of determining the driver's head posture based on a preset head model and recognition points in the facial image information includes:

[0123] Step S121: Based on each preset recognition point in the recognition points, establish a mapping matrix between the facial image information and the preset head model;

[0124] Step S122: Adjust the preset head model according to the mapping matrix to obtain the current three-dimensional head model;

[0125] Step S123: Determine the driver's head posture based on the preset head model and the current three-dimensional head model.

[0126] In this embodiment, it should be noted that the mapping matrix is ​​used to characterize the mapping relationship between each preset recognition point in the facial image information and each recognition point in the preset head model, and is used to generate the current synchronous three-dimensional model.

[0127] As an example, steps S121 to S123 include: extracting each preset recognition point from the recognition points, wherein each preset recognition point is used to characterize the position of key facial organs in the facial image information; establishing a mapping matrix between the facial image information and the preset head model through each preset recognition point and the preset head model; mapping each preset recognition point to the preset head model according to the mapping matrix to generate a current three-dimensional head model characterizing the facial image information; detecting the motion of the current three-dimensional head model in real time, comparing the current three-dimensional head model with the preset head model, and obtaining the head posture of the current three-dimensional head model.

[0128] The step of determining whether the driver is currently fatigued based on the head posture and the recognition point includes:

[0129] Step S131: Determine the lateral change amplitude and the longitudinal change amplitude based on the movement of each identification point;

[0130] Step S132: Determine whether the horizontal change amplitude and the vertical change amplitude exceed a preset change threshold;

[0131] Step S133: If the lateral change amplitude or the longitudinal change amplitude exceeds the preset change threshold, it is determined that the driver is fatigued.

[0132] As an example, steps S131 to S133 include: real-time monitoring of each identification point to obtain the motion trajectory of each identification point; extracting the maximum lateral change amplitude and the maximum longitudinal change amplitude from each motion trajectory, and comparing the maximum lateral change amplitude and the maximum longitudinal change amplitude with preset change thresholds respectively; if the lateral change amplitude or the longitudinal change amplitude both exceed the preset change thresholds, then it is determined that the driver is fatigued; if the lateral change amplitude exceeds the preset change thresholds and the longitudinal change amplitude does not exceed the preset change thresholds, then it is determined that the driver is fatigued; if the lateral change amplitude does not exceed the preset change thresholds and the longitudinal change amplitude exceeds the preset change thresholds, then it is determined that the driver is fatigued; if the lateral change amplitude does not exceed the preset change thresholds and the longitudinal change amplitude does not exceed the preset change thresholds, then it is determined that the driver is not fatigued.

[0133] The step of querying navigation routes to the nearest parking spot to the smart cockpit and sending a notification to the driver includes:

[0134] Step S31: Use the in-vehicle navigation software to query the location information of parking spots within a preset distance around the smart cockpit;

[0135] Step S32: Compare the navigation routes from the current location to each of the parking spots to obtain the parking spot with the shortest estimated driving time;

[0136] Step S33: The navigation route from the current location to the parking spot is pushed to the driver, and a voice prompt is issued.

[0137] In this embodiment, it should be noted that the voice prompt includes whether you need to rest at the nearest parking spot; the preset distance can be 10 kilometers to avoid finding parking spots that are too far away, which would cause the search time to be too long.

[0138] As an example, steps S31 to S33 include: querying the location information of nearby parking spots within the preset distance based on the in-vehicle navigation software; querying the route information from the current location to each parking spot based on the location information; calculating the driving time required for each route information, selecting the navigation route with the shortest driving time and pushing it to the driver in a visual manner, and prompting the driver via voice whether he needs to stop at the nearest parking spot to rest.

[0139] This application provides a human-computer interaction design method for an intelligent cockpit system. First, an in-vehicle camera within the intelligent cockpit detects driver fatigue to determine if the driver is fatigued. If fatigue is detected, an assisted driving mode is activated. Navigation routes to the nearest parking spot are then queried, and a notification is sent to the driver. If no response is received from the driver after a first preset time threshold, an autonomous driving mode is activated, controlling the vehicle corresponding to the intelligent cockpit to proceed to the parking spot. This application, by detecting driver fatigue, automatically switching driving modes, and querying the nearest parking spot to allow the driver to rest and adjust, fundamentally overcomes driver fatigue, effectively preventing traffic accidents caused by fatigued driving and improving safety during fatigued driving.

[0140] Example 2

[0141] Furthermore, based on the first embodiment of this application, in another embodiment of this application, the same or similar content as in Embodiment 1 can be referred to the above description, and will not be repeated hereafter. Based on this, refer to... Figure 2 Before the step of detecting driver fatigue using an in-vehicle camera within the smart cockpit to determine whether the driver is fatigued, the method further includes:

[0142] Step A10: Obtain the preset initial command input by the user through the visual input interface. The preset initial command includes various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command.

[0143] Step A20: When the driver is detected to have entered the smart cockpit, the smart cockpit is controlled to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

[0144] In this embodiment, it should be noted that the visual input interface can be on the display screen of the smart cockpit or on a mobile device connected to the smart cockpit. It allows users to customize settings as needed, automatically controlling various user requirements and achieving operation without manual intervention. The smart cockpit is an automotive smart cockpit. The time information includes the current date and current time. The current date is used to determine the current season and estimate the temperature. The current date and current time are used together to determine the current lighting conditions to guide lighting control. The preset initial command includes initial commands corresponding to each time information and each vehicle status information. For example, refer to the example. Figure 3 The time information is 17:00 on December 1st. The vehicle status information includes an interior temperature of 32℃, the vehicle is running, and the vehicle is in the rain with no sunlight. The corresponding initial commands are to turn on the air conditioner and set the temperature to 26℃, turn on the headlights, turn on the windshield wipers, turn on the music, and turn on Bluetooth. The preset initial commands can be set by the user according to their personal needs.

[0145] As an example, steps A10 to A20 include: pushing a visual input interface to the preset user by connecting the smart cockpit and the preset user's mobile device, wherein the preset user is the vehicle owner or another user set by the vehicle owner; receiving a preset initial command input by the preset user through the visual input interface, wherein the preset initial command includes at least a set of time information, vehicle status information, and corresponding smart cockpit control commands, used to query the corresponding smart cockpit control commands given the existing current time information and current vehicle status information, wherein the smart cockpit control commands include at least one of the following: light control commands, music control commands, air conditioning control commands, window control commands, windshield wiper control commands, and Bluetooth control commands; determining whether a driver has entered the smart cockpit by performing pressure detection on the seats in the smart cockpit; determining that a driver has entered the smart cockpit when the pressure value received by the seat exceeds a first preset threshold; querying the corresponding initial command in the preset initial commands based on the current time information and current vehicle status information; and controlling each cockpit device in the smart cockpit to perform the interactive operation corresponding to the initial command based on the initial command.

[0146] The step of controlling the smart cockpit to perform corresponding initial operations based on current time information, current vehicle status information, and preset initial commands when a user is detected entering the smart cockpit includes:

[0147] Step A21: Perform pressure detection on the seats in the smart cockpit;

[0148] Step A22: When the pressure value on the seat exceeds the first preset pressure threshold, it is determined that the driver has entered the smart cockpit;

[0149] Step A23: Based on the current time information and the current vehicle status information, query the corresponding smart cockpit control command in the preset initial command, wherein the current vehicle status information includes at least one of temperature information, vehicle operation information and vehicle body sensing information;

[0150] Step A24: According to the intelligent cockpit control command, control the intelligent cockpit to perform the initial operation corresponding to the intelligent cockpit control command.

[0151] In this embodiment, it should be noted that the first preset pressure threshold is used to determine whether a driver is sitting in the seat, in order to avoid interference from other actions such as pressing the seat with hands; the tool used to detect the pressure of the seat is a pressure sensor, which is used to accurately measure the pressure exerted on the seat when the driver sits on it.

[0152] As an example, steps A21 to A24 include: detecting the pressure of the seat in the smart cockpit using a pressure sensor to obtain a seat pressure value; continuing to continuously detect the seat when the seat pressure value does not exceed a first preset pressure threshold; determining that the driver has entered the smart cockpit when the detected pressure value of the seat exceeds the first preset pressure threshold; retrieving the smart cockpit control command corresponding to the current time information and the current vehicle status information from the preset initial command, wherein the current vehicle status information includes temperature information, vehicle operation information, and vehicle body sensor information; and controlling each cockpit device in the smart cockpit to perform the interactive operation corresponding to the smart cockpit control command according to the smart cockpit control command.

[0153] After the step of determining that the driver has entered the smart cockpit when the pressure value detected on the seat exceeds a first preset pressure threshold, the method further includes:

[0154] Step B10: Determine whether the pressure value of the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value of the seat when a preset user sits down;

[0155] Step B20: If yes, then determine that the driver is the preset user;

[0156] Step B30: If not, determine that the driver is not the preset user and push a notification message to the preset user.

[0157] In this embodiment, it should be noted that the preset pressure range is used to determine whether the driver is the preset user based on the pressure value received by the seat when the preset user sits down, so as to prevent other people from entering the smart cockpit and improve the safety of the smart cockpit; the push notification message method can send push notifications to the preset user's mobile device through the connection between the smart cockpit and the preset user's mobile device.

[0158] As an example, steps B10 to B30 include: determining whether the seat pressure value is within a preset pressure range by detecting the seat pressure value, wherein the preset pressure range is the range of pressure value variation of the seat when the preset user sits down; if the seat pressure value is within the preset pressure range, then the driver is determined to be the preset user; if the seat pressure value is not within the preset pressure range, then the driver is determined not to be the preset user, and a notification message is pushed to the preset user through the connection channel between the smart cockpit and the preset user's mobile device.

[0159] After the step of determining that the driver has entered the smart cockpit when the pressure value detected on the seat exceeds a first preset pressure threshold, the method further includes:

[0160] Step C10: Collect the driver's facial image information and determine whether the driver is a preset user based on the facial image information;

[0161] Step C20: If not, push a notification message to the preset user.

[0162] In this embodiment, it should be noted that the facial image information can be collected by a camera inside the smart cockpit. By collecting the driver's facial image information, feature information can be extracted from the facial image information to determine the driver's identity and improve the security of the smart cockpit.

[0163] As an example, steps C10 to C20 include: acquiring facial image information of the driver through a camera inside the cockpit; extracting facial feature information from the facial image information; comparing the facial feature information of the facial image information with the facial feature information corresponding to the preset user; if they do not match, determining that the driver is not the preset user, and notifying the driver by pushing a message to the mobile device corresponding to the preset user; if they match, determining that the driver is the preset user.

[0164] The step of controlling the smart cockpit to perform corresponding initial operations based on current time information, current vehicle status information, and preset initial instructions when the driver is detected entering the smart cockpit includes:

[0165] Step D10: When the interactive command voice issued by the driver is detected, the interactive command voice is identified by the voiceprint authentication model to determine whether the interactive command voice matches the preset voiceprint.

[0166] Step D20: If the interactive command voice matches the preset voiceprint, then set the voiceprint authentication status of the interactive command voice to voiceprint authentication passed.

[0167] Step D30: If the interactive command voice does not match the preset voiceprint, then the voiceprint authentication status of the interactive command voice is set to voiceprint authentication failure, and a notification message is pushed to the preset user.

[0168] In this embodiment, it should be noted that the voiceprint authentication model is trained in advance using a voice training set and a voice test set. It is used to identify voiceprint features in voice information and then compare them with the voiceprint features of the preset user's voice information recorded in advance to determine the identity of the driver.

[0169] As an example, steps D10 to D30 include: collecting sound information from the smart cockpit; identifying the sound information to determine whether it is an interactive command voice issued by the driver; if the sound information is an interactive command voice issued by the driver, extracting voiceprint features from the interactive command voice through a voiceprint authentication model; matching the voiceprint features with voiceprint features corresponding to a preset voiceprint; if the voiceprint features match successfully with the voiceprint features corresponding to the preset voiceprint, determining that the interactive command voice conforms to the preset voiceprint, and setting the voiceprint authentication status of the interactive command voice to voiceprint authentication passed; if the voiceprint features fail to match with the voiceprint features corresponding to the preset voiceprint, determining that the interactive command voice does not conform to the preset voiceprint, setting the voiceprint authentication status of the interactive command voice to voiceprint authentication failed, and pushing a notification message to the mobile device corresponding to the preset user.

[0170] The step after setting the voiceprint authentication status of the interactive command voice to "voiceprint authentication passed" further includes:

[0171] Step D21: Extract the interactive commands from the interactive command voice, and query the corresponding cockpit equipment according to the interactive commands;

[0172] Step D22: Control the cockpit equipment to perform the interactive operation corresponding to the interactive command according to the interactive command.

[0173] As an example, steps D21 to D22 include: extracting the interaction command from the interaction command voice according to the preset interaction command; querying the corresponding cockpit devices according to the interaction command, wherein the cockpit devices include at least one of the following: lights, music player, air conditioner, windows, Bluetooth system, and windshield wipers; and controlling each of the cockpit devices to perform the interaction operation corresponding to the interaction command according to the interaction command to complete the human-computer interaction.

[0174] After the step of controlling the smart cockpit to perform corresponding interactive operations according to the interactive command voice, the method further includes:

[0175] Step D23: When the pressure value of the seat in the smart cockpit decreases by more than the second preset pressure threshold, a voice prompt message is sent to the driver. The voice prompt message is used to ask the driver whether he or she needs to turn off the various cockpit devices in the smart cockpit.

[0176] Step D24: When the device shutdown command issued by the driver is received, initialize each cockpit device in the smart cockpit.

[0177] In this embodiment, it should be noted that the second preset pressure threshold is used to determine whether the driver has left the seat, so as to avoid misjudgment caused by changes in seat pressure value due to the driver adjusting his posture or other actions; the purpose of pushing voice prompt information to the driver is to confirm that the driver has finished riding, rather than temporarily leaving the smart cockpit for other reasons.

[0178] As an example, steps D23 to D24 include: continuously detecting pressure changes in the seats in the smart cockpit; when the pressure drop detected on the seats exceeds the second preset pressure threshold, issuing a voice prompt to the driver through the internal speakers in the smart cockpit, wherein the voice prompt is used to ask the driver whether they need to turn off the various cockpit devices in the smart cockpit; continuously receiving ambient sound information through the microphone in the smart cockpit; when a device shutdown command is identified from the ambient sound information, initializing the various cockpit devices in the smart cockpit to restore the smart cockpit to the state before the driver entered.

[0179] This application provides a human-computer interaction design method for an intelligent cockpit system. First, a preset initial command input by the user is obtained through a visual input interface. This preset initial command includes various intelligent cockpit control commands corresponding to different time and vehicle status information. These intelligent cockpit control commands include at least one of the following: lighting control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command. When the driver enters the intelligent cockpit, the system controls the intelligent cockpit to perform the corresponding initial operation based on the current time, current vehicle status information, and the preset initial command. This application, through the preset initial command, automatically performs initial operations based on the current time and current vehicle status, adjusting the state of the intelligent cockpit to a mode suitable for the current situation. This eliminates the need for manual operation by the user, improving the safety of the intelligent cockpit. In summary, the solution used in this application effectively overcomes the technical defects of existing technologies that require manual parameter adjustment, improving the automation level of the intelligent cockpit.

[0180] Example 3

[0181] This application also provides a human-computer interaction design device for an intelligent cockpit system. This device is applied to a human-computer interaction design equipment for an intelligent cockpit system. (Refer to...) Figure 4 The human-computer interaction design device of the intelligent cockpit system includes:

[0182] The fatigue detection module is used to detect driver fatigue through an in-vehicle camera in the smart cockpit and determine whether the driver is fatigued.

[0183] The driver assistance module is used to activate the driver assistance mode if driver fatigue is detected.

[0184] The navigation module is used to query the navigation route to the nearest parking spot to the smart cockpit and push prompt information to the driver;

[0185] The autonomous driving module is used to activate the autonomous driving mode and control the vehicle corresponding to the smart cockpit to proceed to the parking spot if no response information is received from the driver after a first preset time threshold.

[0186] Optionally, the fatigue detection module is further used for:

[0187] The driver's facial image information is collected by the vehicle-mounted camera in the smart cockpit, and the recognition points are extracted from the facial image information.

[0188] The driver's head posture is determined based on a preset head model and recognition points in the facial image information;

[0189] Based on the head posture and the recognition points, it is determined whether the driver is currently fatigued.

[0190] When the duration of the driver's current fatigue state exceeds a second preset time threshold, it is determined that the driver is fatigued.

[0191] Optionally, the fatigue detection module is further used for:

[0192] Based on each preset recognition point in the recognition points, establish a mapping matrix between the facial image information and the preset head model;

[0193] The current 3D head model is obtained by adjusting the preset head model according to the mapping matrix.

[0194] The driver's head posture is determined based on the preset head model and the current three-dimensional head model.

[0195] Optionally, the fatigue detection module is further used for:

[0196] The lateral and longitudinal change amplitudes are determined based on the movement of each identification point.

[0197] Determine whether the amplitude of the horizontal change and the amplitude of the vertical change exceed a preset change threshold;

[0198] If the lateral change amplitude or the longitudinal change amplitude exceeds the preset change threshold, the driver is determined to be fatigued.

[0199] Optionally, the navigation module is further configured to:

[0200] Use in-vehicle navigation software to query the location information of parking spots within a preset distance around the intelligent cockpit;

[0201] The navigation routes from the current location to each of the aforementioned parking spots are compared to determine the parking spot with the shortest estimated driving time.

[0202] The navigation route from the current location to the parking spot will be pushed to the driver, and a voice prompt will be issued.

[0203] Optionally, the initial module is further configured to:

[0204] Pressure detection is performed on the seats in the smart cockpit;

[0205] When the pressure value on the seat exceeds a first preset pressure threshold, it is determined that the driver has entered the smart cockpit;

[0206] Based on the current time information and the current vehicle status information, the corresponding smart cockpit control command is retrieved from the preset initial command. The current vehicle status information includes at least one of temperature information, vehicle operation information, and vehicle body sensor information.

[0207] According to the intelligent cockpit control command, control the intelligent cockpit to perform the initial operation corresponding to the intelligent cockpit control command.

[0208] Optionally, the initial module is further configured to:

[0209] Determine whether the pressure value applied to the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value applied to the seat when a preset user sits down;

[0210] If so, then the driver is determined to be the preset user;

[0211] If not, the driver is determined not to be the preset user, and a notification message is pushed to the preset user.

[0212] Optionally, the initial module is further configured to:

[0213] Collect the driver's facial image information, and determine whether the driver is a preset user based on the facial image information;

[0214] If not, a notification message will be pushed to the preset user.

[0215] Optionally, the authentication module is further configured to:

[0216] When the driver's interactive command voice is detected, the interactive command voice is identified through the voiceprint authentication model to determine whether the interactive command voice matches the preset voiceprint.

[0217] If the interactive command voice matches the preset voiceprint, then the voiceprint authentication status of the interactive command voice is set to voiceprint authentication passed.

[0218] If the interactive command voice does not match the preset voiceprint, the voiceprint authentication status of the interactive command voice is set to voiceprint authentication failure, and a notification message is pushed to the preset user.

[0219] Optionally, the execution module is further configured to:

[0220] Extract the interactive commands from the voice commands, and query the corresponding cockpit devices based on the interactive commands;

[0221] The cockpit equipment is controlled to perform the interactive operation corresponding to the interactive command according to the interactive command.

[0222] Optionally, the execution module is further configured to:

[0223] When the decrease in pressure on the seat of the smart cockpit exceeds a second preset pressure threshold, a voice prompt is sent to the driver, wherein the voice prompt is used to ask the driver whether he / she needs to turn off the various cockpit devices in the smart cockpit.

[0224] When a device shutdown command is received from the driver, the various cockpit devices in the smart cockpit are initialized.

[0225] Optionally, the human-machine interaction design device of the intelligent cockpit system also includes an initialization module:

[0226] Optionally, the initialization module is further configured to:

[0227] The user inputs preset initial commands through a visual input interface. The preset initial commands include various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command.

[0228] When the driver is detected to have entered the smart cockpit, the system controls the smart cockpit to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

[0229] Optionally, the initialization module is further configured to:

[0230] The user inputs preset initial commands through a visual input interface. The preset initial commands include various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command.

[0231] When the driver is detected to have entered the smart cockpit, the system controls the smart cockpit to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

[0232] Optionally, the initialization module is further configured to:

[0233] Determine whether the pressure value applied to the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value applied to the seat when a preset user sits down;

[0234] If so, then the driver is determined to be the preset user;

[0235] If not, the driver is determined not to be the preset user, and a notification message is pushed to the preset user.

[0236] Example 4

[0237] This application provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to execute the human-computer interaction design method of the intelligent cockpit system in the first embodiment described above.

[0238] The following is for reference. Figure 5 The diagram illustrates a structural schematic of an electronic device suitable for implementing embodiments of the present disclosure. The electronic devices in the embodiments of the present disclosure may include, but are not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 5 The electronic device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments disclosed herein.

[0239] like Figure 5As shown, an electronic device may include a processing unit (such as a central processing unit, graphics processing unit, etc.) that can perform various appropriate actions and processes based on a program stored in read-only memory (ROM) or a program loaded from a storage device into random access memory (RAM). The RAM also stores various programs and data required for the operation of the electronic device. The processing unit, ROM, and RAM are interconnected via a bus. Input / output (I / O) interfaces are also connected to the bus.

[0240] Typically, the following systems can be connected to the I / O interface: input devices including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices including, for example, magnetic tapes, hard disks, etc.; and communication devices. Communication devices allow electronic devices to communicate wirelessly or wiredly with other devices to exchange data. Although electronic devices with various systems are shown in the figures, it should be understood that it is not required to implement or possess all the systems shown. More or fewer systems may be implemented alternatively.

[0241] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by a processing device, it performs the functions defined above in the methods of embodiments of this disclosure.

[0242] The electronic device provided in this application adopts the human-computer interaction design method of the intelligent cockpit system in the above embodiments, which solves the technical problem of low safety under fatigue driving conditions. Compared with the prior art, the beneficial effects of the electronic device provided in this application are the same as those of the human-computer interaction design method of the intelligent cockpit system provided in the first embodiment above, and other technical features of the electronic device are the same as those disclosed in the method of the previous embodiment, and will not be repeated here.

[0243] It should be understood that various parts of this disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the description of the above embodiments, specific features, structures, materials, or characteristics may be combined in any suitable manner in one or more embodiments or examples.

[0244] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

[0245] Example 5

[0246] This embodiment provides a computer-readable storage medium having computer-readable program instructions stored thereon, which are used to execute the human-computer interaction design method of the intelligent cockpit system in the first embodiment described above.

[0247] The computer-readable storage medium provided in this application embodiment may be, for example, a USB flash drive, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to: electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this embodiment, the computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, system, or device. The program code contained on the computer-readable storage medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0248] The aforementioned computer-readable storage medium may be included in an electronic device or may exist independently without being assembled into an electronic device.

[0249] The aforementioned computer-readable storage medium carries one or more programs that, when executed by an electronic device, cause the electronic device to: perform fatigue detection on the driver using an in-vehicle camera within the smart cockpit to determine if the driver is fatigued; if fatigue is detected, activate the assisted driving mode; query the navigation route to the nearest parking spot to the smart cockpit and push a prompt message to the driver; if no response is received from the driver after a first preset time threshold, activate the automatic driving mode to control the vehicle corresponding to the smart cockpit to proceed to the parking spot. Computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computer, partially on a user's computer, as a standalone software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0250] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0251] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The names of the modules do not necessarily limit the functionality of the unit itself.

[0252] The computer-readable storage medium provided in this application stores computer-readable program instructions for executing the human-computer interaction design method of the above-described intelligent cockpit system, thus solving the technical problem of low safety under fatigue driving conditions. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in this application are the same as the beneficial effects of the human-computer interaction design method of the intelligent cockpit system provided in the above-described embodiments, and will not be repeated here.

[0253] Example 6

[0254] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the human-computer interaction design method for the intelligent cockpit system described above.

[0255] The computer program product provided in this application solves the technical problem of low safety under fatigue driving conditions. Compared with the prior art, the beneficial effects of the computer program product provided in this application are the same as the beneficial effects of the human-computer interaction design method of the intelligent cockpit system provided in the above embodiments, and will not be repeated here.

[0256] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.

Claims

1. A human-computer interaction design method for an intelligent cockpit system, characterized in that, The human-computer interaction design method of the intelligent cockpit system includes: The driver fatigue is detected by the in-vehicle camera in the smart cockpit to determine whether the driver is fatigued. If driver fatigue is detected, the driver assistance mode is activated. The driver assistance mode is used to deal with emergencies while driving. The assistance operations in the driver assistance mode include at least emergency braking, controlling vehicle speed, turning on lights, steering, and automatically turning on turn signals when overtaking. The system queries the navigation route to the nearest parking spot to the smart cockpit and sends a notification to the driver. When the driver's instruction to proceed to the parking spot is received, the navigation route is pushed to the driver in a visual manner; If no response is received from the driver after a first preset time threshold, the autonomous driving mode is activated to control the vehicle corresponding to the smart cockpit to proceed to the parking spot. The autonomous driving mode is used for vehicle control when the driver is unable to respond to the prompts. The step of detecting driver fatigue and determining whether the driver is fatigued via an in-vehicle camera in the smart cockpit includes: The driver's facial image information is collected by the vehicle-mounted camera in the smart cockpit, and the recognition points are extracted from the facial image information. The driver's head posture is determined based on a preset head model and recognition points in the facial image information; Based on the head posture and the recognition points, it is determined whether the driver is currently fatigued. When the duration of the driver's current fatigue state exceeds a second preset time threshold, it is determined that the driver is fatigued. The step of determining whether the driver is currently fatigued based on the head posture and the recognition point includes: The lateral and longitudinal change amplitudes are determined based on the movement of each identification point. Determine whether the amplitude of the horizontal change and the amplitude of the vertical change exceed a preset change threshold; If the lateral change amplitude or the longitudinal change amplitude exceeds the preset change threshold, it is determined that the driver is fatigued. The step of querying navigation routes to the nearest parking spot to the smart cockpit and sending a notification to the driver includes: Use in-vehicle navigation software to query the location information of parking spots within a preset distance around the intelligent cockpit; The navigation routes from the current location to each of the aforementioned parking spots are compared to determine the parking spot with the shortest estimated driving time. The navigation route from the current location to the parking spot will be pushed to the driver, and a voice prompt will be issued.

2. The human-computer interaction design method for the intelligent cockpit system as described in claim 1, characterized in that, The step of determining the driver's head posture based on the preset head model and the recognition points in the facial image information includes: establishing a mapping matrix between the facial image information and the preset head model based on each preset recognition point in the recognition points; The current 3D head model is obtained by adjusting the preset head model according to the mapping matrix. The driver's head posture is determined based on the preset head model and the current three-dimensional head model.

3. The human-computer interaction design method for the intelligent cockpit system as described in claim 1, characterized in that, Before the step of detecting driver fatigue using an in-vehicle camera within the smart cockpit to determine whether the driver is fatigued, the method further includes: The user inputs preset initial commands through a visual input interface. The preset initial commands include various smart cockpit control commands corresponding to various time information and various vehicle status information. The smart cockpit control commands include at least one of the following: light control command, music control command, air conditioning control command, window control command, windshield wiper control command, and Bluetooth control command. When the driver is detected to have entered the smart cockpit, the system controls the smart cockpit to perform the corresponding initial operation based on the current time information, the current vehicle status information, and the preset initial command.

4. The human-computer interaction design method for the intelligent cockpit system as described in claim 3, characterized in that, The step of controlling the smart cockpit to perform corresponding initial operations based on current time information, current vehicle status information, and preset initial commands when the driver is detected to have entered the smart cockpit includes: Pressure detection is performed on the seats in the smart cockpit; When the pressure value on the seat exceeds a first preset pressure threshold, it is determined that the driver has entered the smart cockpit; Based on the current time information and the current vehicle status information, the corresponding smart cockpit control command is retrieved from the preset initial command. The current vehicle status information includes at least one of temperature information, vehicle operation information, and vehicle body sensor information. According to the intelligent cockpit control command, control the intelligent cockpit to perform the initial operation corresponding to the intelligent cockpit control command.

5. The human-computer interaction design method for the intelligent cockpit system as described in claim 4, characterized in that, After the step of determining that the driver has entered the smart cockpit when the pressure value detected on the seat exceeds a first preset pressure threshold, the method further includes: Determine whether the pressure value applied to the seat is within a preset pressure range, wherein the preset pressure range is determined based on the pressure value applied to the seat when a preset user sits down; If so, then the driver is determined to be the preset user; If not, the driver is determined not to be the preset user, and a notification message is pushed to the preset user.

6. An electronic device, characterized in that, The electronic device includes: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the steps of the human-computer interaction design method for the intelligent cockpit system according to any one of claims 1 to 5.

7. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a program for implementing a human-computer interaction design method for an intelligent cockpit system, the program for implementing the human-computer interaction design method for an intelligent cockpit system being executed by a processor to implement the steps of the human-computer interaction design method for an intelligent cockpit system as described in any one of claims 1 to 5.

Images