Intelligent cabin system based on artificial intelligence technology

Abstract

The invention relates to the technical field of automobiles, in particular to an intelligent cabin system based on an artificial intelligence technology, which comprises a control terminal, an environment sensing module, a man-machine interaction module, an identity authentication module, an intelligent adjusting module and a safe driving module, and is characterized in that the environment sensing module is used for monitoring the internal environment of an automobile in real time and providing data support for the control terminal; a passenger can interact with the control terminal through the man-machine interaction module, convenient operation experience is provided, identity information of the current passenger is recognized through the identity authentication module, and the intelligent adjusting module can automatically complete control over the cabin based on the identity information of the current passenger. If the current passenger takes the vehicle for the first time, the cabin is controlled by implementing operation, meanwhile, the safety condition around the vehicle is monitored in real time through the safety driving module, safety prompt and early warning are provided for a driver, and by means of the system, the intelligent degree of the cabin is higher, and the diversified requirements of users can be met.

Description

Technical Field

[0001] The present invention relates to the field of automobile technology, and in particular to an intelligent cockpit system based on artificial intelligence technology. Background Art

[0002] With the continuous advancement of science and technology, people's demand for cars has changed from a simple means of transportation to the pursuit of a more intelligent, comfortable and safe mobile space. As an important part of the car, the smart cockpit system is of great significance to improving the driving and riding experience.

[0003] However, existing smart cockpit systems often have problems such as single function, inconvenient interaction, and insufficient intelligence, making it difficult to meet the diverse needs of users. Summary of the invention

[0004] The purpose of the present invention is to provide an intelligent cockpit system based on artificial intelligence technology to solve the problems that the intelligent cockpit systems in the prior art often have single functions, inconvenient interactions, insufficient intelligence, and are difficult to meet the diverse needs of users.

[0005] To achieve the above object, the present invention provides an intelligent cockpit system based on artificial intelligence technology, the intelligent cockpit system based on artificial intelligence technology includes a control terminal, an environment perception module, a human-computer interaction module, an identity authentication module, an intelligent adjustment module and a safe driving module, the environment perception module, the human-computer interaction module, the identity authentication module, the intelligent adjustment module and the safe driving module are all connected to the control terminal in communication;

[0006] The environment perception module is used to monitor the internal environment of the car in real time and provide data support for the control terminal;

[0007] The human-computer interaction module is used for passengers to interact with the control terminal to provide a convenient operating experience;

[0008] The identity authentication module is used to identify the identity information of the current passenger;

[0009] The intelligent adjustment module controls the cabin based on the identified identity information of the passenger and the passenger's real-time operation;

[0010] The safe driving module is used to monitor the safety conditions around the vehicle in real time and provide safety tips and warnings to the driver.

[0011] Among them, the environmental perception module includes a temperature sensor, a humidity sensor, a light sensor and an air quality sensor, and the temperature sensor, the humidity sensor, the light sensor and the air quality sensor are all communicatively connected to the control terminal.

[0012] Wherein, the human-computer interaction module includes a voice interaction device, a touch screen and a gesture recognition device, and the voice interaction device, the touch screen and the gesture recognition device are all communicatively connected with the control terminal.

[0013] Wherein, the identity authentication module includes a weight sensor and an identity recognition camera group, the weight sensor is installed on a seat in the cockpit, and the weight sensor and the identity recognition camera group are both communicatively connected to the control terminal.

[0014] Wherein, the control terminal is provided with a usage habit model generation module, and the usage habit model generation module generates a usage habit model of the current passenger based on the passenger's historical usage data.

[0015] Among them, the usage habit model generation module includes a data collection unit, a data preprocessing unit, a feature extraction unit, a feature selection unit, a model training unit, a model verification unit and a model deployment unit. The data collection unit is used to collect the user's historical usage data; the data preprocessing unit is used to standardize the collected data and remove noise and invalid data; the feature extraction unit is used to extract features related to the passenger's usage habits from the preprocessed data; the feature selection unit is used to select the most representative features for model training based on the importance and relevance of the features; the model training unit trains the original decision tree model through the extracted feature data and the corresponding passenger's habit labels to obtain the passenger's usage habit model; the model verification unit uses an independent test data set to verify the trained usage habit model; and the model deployment unit is used to deploy the trained model to the control terminal.

[0016] The decision tree model used by the model training unit generates a tree structure capable of predicting the target variable by recursively segmenting the data set;

[0017] When the decision tree selects the split attribute, it uses information gain as a metric. The calculation formula of information gain is:

[0018] IG(D,A)=H(D)-H(D|A)

[0019] Among them, H(D) is the entropy of data set D, and H(D|A) is the conditional entropy of data set D under the condition of given attribute A;

[0020] Among them, entropy is an indicator to measure the purity of the data set, and its calculation formula is:

[0021] H(D)=-Σp_i*log_2(p_i)

[0022] Among them, p_i is the proportion of samples of the i-th category in the dataset D.

[0023] The intelligent adjustment module includes an automatic adjustment unit and a manual adjustment unit. The automatic adjustment unit controls the cockpit based on the passenger's usage habit model and the current interior environment of the car, and the manual adjustment unit is used for the passenger to manually control the cockpit.

[0024] Among them, the identity recognition camera group includes a support, an adjustment component, a mounting seat and an identity recognition camera. The support is installed inside the car, the mounting seat is installed on the end of the support through a rotating shaft, the identity recognition camera is arranged on the mounting seat, and the adjustment component is also arranged on the support. The output end of the adjustment component is mechanically transmitted with the rotating shaft.

[0025] Wherein, the adjustment component includes a driving motor, a gear reduction box and a coupling. The driving motor is installed on the support. The output end of the driving motor is provided with the gear reduction box. The output end of the gear reduction box is provided with the coupling. The coupling is mechanically transmitted with the rotating shaft.

[0026] The present invention discloses an intelligent cockpit system based on artificial intelligence technology, comprising a control terminal, an environment perception module, a human-computer interaction module, an identity authentication module, an intelligent adjustment module and a safe driving module. The environment perception module is used to monitor the internal environment of the car in real time to provide data support for the control terminal. The passenger can interact with the control terminal through the human-computer interaction module to provide a convenient operation experience. At the same time, the identity authentication module is used to identify the identity information of the current passenger, and the usage habits of the current passenger in the current in-car environment are uploaded to the control terminal. The control terminal generates a usage habit model of the current passenger based on the data of historical usage habits. The intelligent adjustment module can automatically control the cockpit based on the identity information of the current passenger. If the current passenger is riding for the first time, the cockpit can also be controlled by implementing operations. At the same time, the safe driving module is used to monitor the safety status around the vehicle in real time to provide safety prompts and warnings for the driver. With the above system, the cockpit has a higher degree of intelligence and can meet the diverse needs of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0028] Figure 1It is a principle block diagram of the intelligent cockpit system based on artificial intelligence technology provided by the present invention.

[0029] Figure 2 It is a principle block diagram of the control terminal provided by the present invention.

[0030] Figure 3 It is a structural schematic diagram of the identity recognition camera group provided by the present invention.

[0031] 101-control terminal, 102-environmental perception module, 103-human-computer interaction module, 104-identity authentication module, 105-intelligent adjustment module, 106-safe driving module, 107-temperature sensor, 108-humidity sensor, 109-light sensor, 110-air quality sensor, 111-voice interaction device, 112-touch screen, 113-gesture recognition device, 114-weight sensor, 115-identity recognition camera group, 116-usage habit module Model generation module, 117-data collection unit, 118-data preprocessing unit, 119-feature extraction unit, 120-feature selection unit, 121-model training unit, 122-model verification unit, 123-model deployment unit, 124-automatic adjustment unit, 125-manual adjustment unit, 126-support, 127-mounting seat, 128-identification camera, 129-rotating shaft, 130-drive motor, 131-gear reduction box, 132-coupling. DETAILED DESCRIPTION

[0032] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0033] See also Figures 1 to 3 The present invention provides an intelligent cockpit system based on artificial intelligence technology, which includes a control terminal 101, an environment perception module 102, a human-computer interaction module 103, an identity authentication module 104, an intelligent adjustment module 105 and a safe driving module 106. The environment perception module 102, the human-computer interaction module 103, the identity authentication module 104, the intelligent adjustment module 105 and the safe driving module 106 are all connected to the control terminal 101 for communication;

[0034] The environment sensing module 102 is used to monitor the internal environment of the car in real time and provide data support for the control terminal 101;

[0035] The human-computer interaction module 103 is used for passengers to interact with the control terminal 101, providing a convenient operation experience;

[0036] The identity authentication module 104 is used to identify the identity information of the current passenger;

[0037] The intelligent adjustment module 105 controls the cabin based on the identified identity information of the passenger and the passenger's real-time operation;

[0038] The safe driving module 106 is used to monitor the safety conditions around the vehicle in real time and provide safety tips and warnings to the driver.

[0039] In this embodiment, the environmental perception module 102 is used to monitor the internal environment of the car in real time to provide data support for the control terminal 101. The passenger can interact with the control terminal 101 through the human-computer interaction module 103 to provide a convenient operation experience. At the same time, the identity authentication module 104 is used to identify the identity information of the current passenger, and the usage habits of the current passenger in the current in-car environment are uploaded to the control terminal 101. The control terminal 101 generates a usage habit model of the current passenger based on the data of historical usage habits. The intelligent adjustment module 105 can automatically control the cockpit based on the identity information of the current passenger. If the current passenger is riding for the first time, the cockpit can also be controlled by implementing operations. At the same time, the safe driving module 106 is used to monitor the safety status around the vehicle in real time to provide safety tips and warnings to the driver. With the above system, the cockpit is more intelligent and can meet the diverse needs of users.

[0040] Furthermore, the environmental perception module 102 includes a temperature sensor 107 , a humidity sensor 108 , a light sensor 109 and an air quality sensor 110 , and the temperature sensor 107 , the humidity sensor 108 , the light sensor 109 and the air quality sensor 110 are all communicatively connected to the control terminal 101 .

[0041] In this embodiment, various sensors, such as temperature, humidity, light, air quality and the like, are installed to monitor the internal environment of the automobile in real time and provide data support for the control terminal 101 .

[0042] Furthermore, the human-computer interaction module 103 includes a voice interaction device 111 , a touch screen 112 , and a gesture recognition device 113 . The voice interaction device 111 , the touch screen 112 , and the gesture recognition device 113 are all communicatively connected to the control terminal 101 .

[0043] In this embodiment, the user can interact with the control terminal 101 through the voice interaction device 111, the touch screen 112 and the gesture recognition device 113 to achieve a more convenient operation experience.

[0044] Furthermore, the identity authentication module 104 includes a weight sensor 114 and an identity recognition camera group 115 . The weight sensor 114 is installed on a seat in the cockpit. Both the weight sensor 114 and the identity recognition camera group 115 are in communication connection with the control terminal 101 .

[0045] In this embodiment, when a passenger sits on a seat in the cabin, the weight sensor 114 is subjected to force, that is, the identity recognition camera group 115 is started through the control terminal 101, and the identity recognition camera group 115 is used to capture image information of the current passenger to complete the identity recognition of the current passenger.

[0046] Furthermore, the safe driving module 106 monitors the safety conditions around the vehicle in real time by integrating various safety monitoring devices, such as cameras, radars, etc., and provides safety tips and warnings to the driver.

[0047] Furthermore, the control terminal 101 is provided with a usage habit model generation module 116, and the usage habit model generation module 116 generates a usage habit model of the current passenger based on the historical usage data of the passenger.

[0048] Among them, the usage habit model generation module 116 includes a data collection unit 117, a data preprocessing unit 118, a feature extraction unit 119, a feature selection unit 120, a model training unit 121, a model verification unit 122 and a model deployment unit 123, wherein the data collection unit 117 is used to collect the user's historical usage data; the data preprocessing unit 118 is used to standardize the collected data to remove noise and invalid data; the feature extraction unit 119 is used to extract features related to the passenger's usage habits from the preprocessed data; the feature selection unit 120 is used to select the most representative features for model training based on the importance and relevance of the features; the model training unit 121 trains the original decision tree model through the extracted feature data and the corresponding passenger's habit labels to obtain the passenger's usage habit model; the model verification unit 122 uses an independent test data set to verify the trained usage habit model; and the model deployment unit 123 is used to deploy the trained model to the control terminal 101.

[0049] The decision tree model used by the model training unit 121 generates a tree structure capable of predicting the target variable by recursively segmenting the data set;

[0050] When the decision tree selects the split attribute, it uses information gain as a metric. The calculation formula of information gain is:

[0051] IG(D,A)=H(D)-H(D|A)

[0052] Among them, H(D) is the entropy of data set D, and H(D|A) is the conditional entropy of data set D under the condition of given attribute A;

[0053] Among them, entropy is an indicator to measure the purity of the data set, and its calculation formula is:

[0054] H(D)=-Σp_i*log_2(p_i)

[0055] Among them, p_i is the proportion of samples of the i-th category in the dataset D.

[0056] Furthermore, the original training model in the model training unit 121 may adopt a neural network model and a support vector machine model in addition to the decision tree model.

[0057] Furthermore, the intelligent adjustment module 105 includes an automatic adjustment unit 124 and a manual adjustment unit 125. The automatic adjustment unit 124 controls the cockpit based on the passenger's usage habit model and the current interior environment of the car, and the manual adjustment unit 125 is used for the passenger to manually control the cockpit.

[0058] In this embodiment, if the current passenger is a passenger with an established usage habit model, the cockpit is controlled by the automatic adjustment unit 124 based on the passenger's usage habit model and the current interior environment of the car. If the current passenger is a first-time passenger or the current passenger has his own needs, the cockpit is manually controlled by the manual adjustment unit 125.

[0059] Furthermore, the identity recognition camera group 115 includes a support 126, an adjustment component, a mounting seat 127 and an identity recognition camera 128. The support 126 is installed inside the car, and the mounting seat 127 is installed on the end of the support 126 through a rotating shaft 129. The identity recognition camera 128 is arranged on the mounting seat 127. The adjustment component is also arranged on the support 126, and the output end of the adjustment component is mechanically transmitted to the rotating shaft 129.

[0060] In this embodiment, the adjustment component is started to drive the mounting seat 127 to rotate on the support 126 via the rotating shaft 129 to adjust the shooting angle of the identity recognition camera 128, thereby expanding the shooting range of the identity recognition camera 128.

[0061] Furthermore, the adjustment component includes a drive motor 130, a gear reduction box 131 and a coupling 132. The drive motor 130 is installed on the support 126. The output end of the drive motor 130 is provided with the gear reduction box 131. The output end of the gear reduction box 131 is provided with the coupling 132. The coupling 132 is mechanically transmitted with the rotating shaft 129.

[0062] In this embodiment, the drive motor 130 is started, and after the output speed is slowed down by the gear reducer 131, the rotating shaft 129 is driven to rotate through the coupling 132, and then the mounting base 127 is driven to rotate on the support 126 through the rotating shaft 129 to complete the adjustment of the shooting angle of the identity recognition camera 128.

[0063] What is disclosed above is only a preferred embodiment of the present invention, and it certainly cannot be used to limit the scope of rights of the present invention. Ordinary technicians in this field can understand that all or part of the processes of the above embodiment and equivalent changes made according to the claims of the present invention still fall within the scope of the invention.

Claims

1. An intelligent cockpit system based on artificial intelligence technology, characterized in that: It includes a control terminal, an environment perception module, a human-computer interaction module, an identity authentication module, an intelligent adjustment module and a safe driving module, wherein the environment perception module, the human-computer interaction module, the identity authentication module, the intelligent adjustment module and the safe driving module are all connected to the control terminal in communication; The environment perception module is used to monitor the internal environment of the car in real time and provide data support for the control terminal; The human-computer interaction module is used for passengers to interact with the control terminal to provide a convenient operating experience; The identity authentication module is used to identify the identity information of the current passenger; The intelligent adjustment module controls the cabin based on the identified identity information of the passenger and the passenger's real-time operation; The safe driving module is used to monitor the safety conditions around the vehicle in real time and provide safety tips and warnings to the driver.

2. The intelligent cockpit system based on artificial intelligence technology according to claim 1, characterized in that: The environment sensing module includes a temperature sensor, a humidity sensor, a light sensor and an air quality sensor, and the temperature sensor, the humidity sensor, the light sensor and the air quality sensor are all communicatively connected with the control terminal.

3. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 2, characterized in that: The human-computer interaction module includes a voice interaction device, a touch screen and a gesture recognition device, and the voice interaction device, the touch screen and the gesture recognition device are all communicatively connected with the control terminal.

4. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 3, characterized in that: The identity authentication module includes a weight sensor and an identity recognition camera group. The weight sensor is installed on a seat in the cockpit. Both the weight sensor and the identity recognition camera group are communicatively connected to the control terminal.

5. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 4, characterized in that: The control terminal is provided with a usage habit model generation module, and the usage habit model generation module generates a usage habit model of the current passenger based on the historical usage data of the passenger.

6. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 5, characterized in that: The usage habit model generation module includes a data collection unit, a data preprocessing unit, a feature extraction unit, a feature selection unit, a model training unit, a model verification unit and a model deployment unit. The data collection unit is used to collect the user's historical usage data; the data preprocessing unit is used to standardize the collected data and remove noise and invalid data; the feature extraction unit is used to extract features related to the passenger's usage habits from the preprocessed data; the feature selection unit is used to select the most representative features for model training based on the importance and relevance of the features; the model training unit trains the original decision tree model through the extracted feature data and the corresponding passenger's habit labels to obtain the passenger's usage habit model; the model verification unit uses an independent test data set to verify the trained usage habit model; and the model deployment unit is used to deploy the trained model to the control terminal.

7. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 6, characterized in that: The decision tree model adopted by the model training unit generates a tree structure capable of predicting the target variable by recursively segmenting the data set; When the decision tree selects the split attribute, it uses information gain as a metric. The calculation formula of information gain is: IG(D,A)=H(D)-H(D|A) Among them, H(D) is the entropy of data set D, and H(D|A) is the conditional entropy of data set D under the condition of given attribute A; Among them, entropy is an indicator to measure the purity of the data set, and its calculation formula is: H(D)=-Σp_i*log_2(p_i) Among them, p_i is the proportion of samples of the i-th category in the dataset D.

8. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 7, characterized in that: The intelligent adjustment module includes an automatic adjustment unit and a manual adjustment unit. The automatic adjustment unit controls the cockpit based on the passenger's usage habit model and the current interior environment of the car, and the manual adjustment unit is used for the passenger to manually control the cockpit.

9. The intelligent cockpit system based on artificial intelligence technology as claimed in claim 4, characterized in that: The identity recognition camera group includes a support, an adjustment component, a mounting seat and an identity recognition camera. The support is installed inside the car, the mounting seat is installed on the end of the support through a rotating shaft, the identity recognition camera is arranged on the mounting seat, and the adjustment component is also arranged on the support. The output end of the adjustment component is mechanically transmitted with the rotating shaft.

10. The intelligent cockpit system based on artificial intelligence technology according to claim 9, characterized in that: The adjustment component includes a drive motor, a gear reduction box and a coupling. The drive motor is installed on the support. The output end of the drive motor is provided with the gear reduction box. The output end of the gear reduction box is provided with the coupling. The coupling is mechanically transmitted with the rotating shaft.

Images