Vehicle control method and vehicle control system

Abstract

The invention relates to a vehicle control method and a vehicle control system. The method comprises the following steps: establishing interconnection with a vehicle terminal; the desktop application is sent to the vehicle terminal, the vehicle terminal displays the desktop application on a display screen, and when a touch instruction for the display screen is detected, the touch instruction is sent to the mobile terminal; receiving the touch instruction and the intelligent cabin data sent by the vehicle terminal; and the intelligent cabin data is analyzed, a control instruction corresponding to the touch instruction is obtained, and the control instruction is sent to the vehicle end execution equipment so as to control the vehicle end execution equipment to respond to the control instruction. According to the invention, the intelligent cabin function of the vehicle is set in the mobile terminal, and the intelligent cabin function is operated by using the resource of the mobile terminal home terminal, so that the deployment of the intelligent cabin function at the vehicle terminal can be omitted, the experience of touch control of the vehicle terminal can be provided for a user, and the interconnection application of the mobile terminal and the vehicle terminal can be expanded.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle control, and in particular to a vehicle control method and a vehicle control system. Background Art

[0002] With the popularization of intelligent modern cars, more and more cars are equipped with intelligent interconnection systems to achieve interconnection between car computers and mobile terminals such as mobile phones.

[0003] Due to the barriers between mobile terminal manufacturers and automobile manufacturers, the current interconnection between the car terminal and the mobile terminal is simply to share the display screen of the car terminal with the mobile terminal, and operate the car terminal through the mobile terminal to achieve remote control of the car terminal; or the navigation interface, video playback interface, etc. of the mobile terminal can be projected onto the display screen of the car terminal, and the navigation interface of the mobile terminal can be displayed on the display screen to facilitate the driver to view and operate, or the video playback interface of the mobile terminal can be displayed on the display screen to facilitate the back seat or front passenger passengers to watch the video.

[0004] However, the application of interconnection between vehicle terminals and mobile terminals still has limitations. Summary of the invention

[0005] One of the purposes of the present invention is to provide a vehicle control method to solve the problem that the interconnection application between the vehicle terminal and the mobile terminal in the prior art is single and has limitations; the second purpose is to provide a vehicle control system.

[0006] In order to achieve the above object, the technical solution adopted by the present invention is as follows:

[0007] Establish interconnection with the vehicle terminal;

[0008] Sending the desktop application to the vehicle terminal, wherein the vehicle terminal displays the desktop application on a display screen, and upon detecting a touch command to the display screen, sends the touch command to the mobile terminal;

[0009] Receiving the touch control command and smart cockpit data sent by the vehicle terminal;

[0010] The smart cockpit data is analyzed to obtain a control instruction corresponding to the touch instruction, and the vehicle-side execution device is controlled to respond to the control instruction.

[0011] According to the above technical means, due to the interconnection between the vehicle terminal and the mobile terminal, data transmission is realized, for example, the desktop application of the mobile terminal is projected to the vehicle terminal, and the desktop application of the mobile terminal is displayed and touched based on the display screen of the vehicle terminal; in this embodiment, the intelligent cockpit function of the vehicle is set on the mobile terminal, and the vehicle terminal triggers the control, and the intelligent cockpit data is sent to the mobile terminal through the vehicle terminal. The mobile terminal uses the resources of the local terminal to run the intelligent cockpit function, analyzes and processes the intelligent cockpit data, and analyzes the control instructions corresponding to the touch instructions. Then the mobile terminal controls the vehicle-side execution device based on the control instructions, so that the touch operation can be realized on the display screen of the vehicle terminal, and the intelligent cockpit data is analyzed and processed on the mobile terminal, and the corresponding control instructions are generated, and then the vehicle-side execution device is controlled to respond. It can not only save the deployment of the intelligent cockpit function on the vehicle terminal, but also provide users with the experience of vehicle-side touch control. The intelligent cockpit function is developed on the mobile terminal, which does not affect the load of the vehicle terminal, can avoid the influence of the function and performance of the vehicle terminal, and the function development is not restricted. This embodiment expands the interconnection application between the mobile terminal and the vehicle terminal. In addition, by utilizing the hardware resources of mobile terminals, the deployment costs of hardware and software on the vehicle side can be saved or low-cost hardware can be deployed on the vehicle side, which can also achieve high-end intelligent control and reduce vehicle costs.

[0012] Further, the mobile terminal is provided with a smart cockpit application, and the smart cockpit data is analyzed based on the smart cockpit application;

[0013] According to the above technical means, the smart cockpit application is deployed on the mobile terminal. In the interconnected mode, the resources of the mobile terminal can be used to solve the problems of the smart cockpit function.

[0014] Furthermore, the smart cockpit data includes one or more of voice information collected by a microphone, perception information of a vehicle perception system, environmental information in the cockpit, and setting information.

[0015] According to the above-mentioned technical means, the vehicle's smart cockpit functions include but are not limited to voice interaction, automatic driving, 3D car models, vehicle air conditioning control, window control, etc. Different functions are triggered and the response data is different. When a function is triggered, the corresponding smart cockpit data is sent to the mobile terminal. The mobile terminal can analyze the touch command based on the touch command and the corresponding smart cockpit data, and then respond to the corresponding control.

[0016] Further, analyzing the smart cockpit data, obtaining a control instruction corresponding to the touch instruction, and controlling the vehicle-side execution device to respond to the control instruction includes:

[0017] Determining a touched target application according to the touch instruction;

[0018] Determining a target function indicated by the touch instruction according to the touch instruction and the functions configured in the target application;

[0019] Determining a target control instruction based on the target function and the smart cockpit data;

[0020] The target control instruction is sent to a target vehicle-side execution device that executes the target function.

[0021] According to the above-mentioned technical means, in the interconnected mode, the control is triggered through the display screen on the vehicle side, and the triggered control is analyzed and identified through the mobile terminal, and the target control instructions obtained based on the identification are sent to the target vehicle side execution device to control the target vehicle side execution device to perform the corresponding operation.

[0022] Further, the target application is a vehicle control application, the smart cockpit data includes environmental information in the cockpit and a set temperature of an air conditioner, and the target control instruction is determined based on the target function and the smart cockpit data, including:

[0023] Determining operating parameters of the air conditioner according to the set temperature of the air conditioner and the environmental information;

[0024] A target control instruction is generated based on the operating parameters.

[0025] According to the above technical means, the air conditioner is controlled through the mobile terminal.

[0026] Further, the target function is playing an atmosphere light, the smart cockpit data includes music playing information, and the target control instruction is determined based on the target function and the smart cockpit data, including:

[0027] Acquiring music playing information of the cockpit, and determining working parameters of the ambient light according to the music playing information;

[0028] A target control instruction is generated based on the ambient light operating parameters.

[0029] According to the above technical means, the ambient light on the vehicle side is controlled through the mobile terminal.

[0030] Further, the target application is a 3D car model application, the target function is to open a car door, and the step of determining the target function indicated by the touch command according to the touch command and the function configured in the target application includes:

[0031] Determining a target function indicated by the touch instruction according to the touch instruction and the functions configured in the target application;

[0032] Determine the trigger position of the touch command on the 3D vehicle model, and determine the target function indicated by the touch command according to the trigger position, wherein the target function includes rotating the 3D vehicle model, opening / closing the door, opening / closing the trunk, rendering the 3D vehicle model, or one or more of the trigger position mapping of the 3D vehicle model.

[0033] According to the above technical means, the touch commands of the 3D car model application are identified through the mobile terminal, and the 3D car model data is processed according to the touch commands, and then the processed 3D car model data is sent to the car computer end. There is no need to process the 3D car model data on the car computer end. In this way, the low-configuration hardware device on the car computer end (which can only display the picture of the vehicle) can also display the 3D car model on the display screen, and control the vehicle based on the 3D car model, or adjust the display of the 3D car model (such as rendering, mapping, rotation, etc.), so that low-cost vehicles can also experience advanced functions.

[0034] Further, the smart cockpit data includes voice information collected by the microphone of the vehicle side, and the analyzing the smart cockpit data, obtaining the control instruction corresponding to the touch instruction, and controlling the vehicle side execution device to respond to the control instruction includes:

[0035] Recognize the voice information based on the local voice assistant recognition model to obtain a recognition result, or send the voice information to the cloud, recognize the voice information through the voice recognition model of the cloud, and obtain a recognition result;

[0036] When the recognition result is a voice control instruction of the target vehicle-side execution device, determining a target control instruction according to the voice control instruction, and sending the target control instruction to the target vehicle-side execution device;

[0037] When the recognition result is speech-to-text, the recognized target text is sent to the vehicle terminal, and the display screen of the vehicle terminal displays it;

[0038] Among them, the trigger instruction includes a voice assistant wake-up instruction.

[0039] According to the above technical means, the voice assistant recognition model of the mobile terminal is used to identify the voice information collected by the vehicle terminal, so as to realize resource reuse. There is no need to deploy the voice assistant recognition model on the vehicle terminal, thereby reducing the resources occupied by the vehicle terminal.

[0040] Further, the smart cockpit data includes perception information of a vehicle perception system, and the step of analyzing the smart cockpit data, obtaining a control instruction corresponding to the touch control instruction, and controlling the vehicle-side execution device to respond to the control instruction includes:

[0041] Processing the perception information based on a preset autonomous driving model, or sending the perception information to the cloud, where the perception information is processed by the autonomous driving model in the cloud to obtain a driving control instruction;

[0042] Sending the driving control instruction to a corresponding target vehicle-side execution device, wherein the target vehicle-side execution device includes one or more of a brake controller, a direction controller and an acceleration controller;

[0043] Among them, the touch command includes an automatic driving start command.

[0044] According to the above technical means, the perception information is analyzed and processed by the mobile terminal, and then the driving control instructions are generated, and the driving control instructions are sent to the vehicle-side execution device to realize automatic driving or assisted driving. Based on the high hardware configuration requirements of the automatic driving or assisted driving system, the software performance requirements and space requirements are large, and the automatic driving or assisted driving system is deployed on the mobile terminal. On the one hand, the resources of the mobile terminal are utilized to save the hardware configuration of the vehicle side. On the other hand, the mobile terminal can call cloud resources to realize fast and stable processing of perception information and ensure the safety of automatic driving or assisted driving.

[0045] Furthermore, after sending the desktop application to the vehicle terminal, the method further includes:

[0046] Receive an application selection instruction for the desktop application based on the display screen sent by the vehicle terminal, determine the target application according to the application selection instruction, and send the control interface data of the target application to the vehicle terminal, wherein the vehicle terminal displays the control interface of the target application on the display screen according to the control interface data.

[0047] According to the above technical means, the mobile terminal sends the control interface data to the vehicle terminal, and the vehicle terminal generates a display screen based on the control interface data. Compared with the screen projection technology in the related technology, this embodiment can avoid the display screen dominating the screen.

[0048] Furthermore, when the target application is a 3D car model application, sending the control interface data of the target application to the vehicle machine end includes:

[0049] Generate a 3D vehicle model based on vehicle information and a preset 3D model;

[0050] The control interface data of the 3D vehicle model is sent to the vehicle computer end, and the control interface data includes the 3D vehicle model data and the touch function data of the 3D vehicle model.

[0051] According to the above technical means, 3D vehicle model data is generated by a mobile terminal, and the vehicle computer only needs to display the 3D vehicle based on the 3D vehicle model data. The requirements for the hardware and software of the vehicle computer are low, and the 3D vehicle model can be displayed on a low-configuration vehicle computer.

[0052] Further, the sending of the control interface data of the target application to the vehicle terminal includes:

[0053] Obtaining the size of a window to be displayed on the display screen of the vehicle terminal, where the window to be displayed is used to display a control interface of a target application;

[0054] Adapting the control interface data of the target application according to the size of the window to be displayed;

[0055] The control interface data is sent to the vehicle computer end.

[0056] According to the above technical means, the control interface data is adapted according to the display window size of the display screen of the vehicle terminal, so as to facilitate the display of the vehicle terminal and make the information display of the control interface complete.

[0057] Furthermore, the method further comprises:

[0058] It also establishes a communication connection with the vehicle-side execution device;

[0059] The control instruction is sent to the vehicle-side execution device through the communication connection.

[0060] According to the above technical means, the mobile terminal can communicate with the vehicle-side execution device, and transmit the control instructions through the communication, and transmit the control instructions directly to the vehicle-side execution device, without going through the cloud or the vehicle-side, and there are two communication channels with the vehicle-side, which do not affect each other, realizing the mobile terminal control vehicle function, and there is no need to go through multi-level transmission, ensuring the timeliness of transmission, and the vehicle-side execution device responds in time. And based on the deployment of the vehicle's smart cockpit function on the mobile terminal, the mobile terminal analyzes and processes the touch instructions and the smart cockpit data corresponding to the touch instructions, and after obtaining the control instructions, it is directly sent to the vehicle-side execution device, shortening the data transmission time, and highlighting the control effect corresponding to the application scenario of the smart cockpit function deployed on the mobile terminal, which is better than deploying the smart cockpit function on the vehicle-side.

[0061] Furthermore, establishing interconnection with the vehicle terminal includes:

[0062] Listening to the interconnection request of the vehicle terminal, obtaining verification information for interconnection with the vehicle terminal, wherein the verification information includes one or more of a pairing code input based on the output verification input window, identity authentication information of the mobile terminal, and configuration information of the mobile terminal;

[0063] The verification information is sent to the vehicle terminal, wherein after the verification by the vehicle terminal is completed, the mobile terminal and the vehicle terminal establish an interconnection channel.

[0064] According to the above technical means, when the mobile terminal and the vehicle terminal are interconnected, the security of the interconnection is guaranteed, thereby improving the safety of vehicle control.

[0065] A vehicle control method is applied to a vehicle terminal, wherein the vehicle terminal includes a display screen, and the method includes:

[0066] After establishing interconnection with the mobile terminal, receiving a desktop application sent by the mobile terminal, and displaying the desktop application on the display screen;

[0067] When the touch control command and the smart cockpit data are acquired, the touch control command and the smart cockpit data are sent to the mobile terminal.

[0068] According to the above-mentioned technical means, the vehicle-side does not need to deploy smart cockpit function applications, but after interconnecting with the mobile terminal, the desktop application of the mobile terminal can be displayed. When the user triggers a command in the control interface of the application, the vehicle-side sends the trigger command and the smart cockpit data required to execute the trigger command to the mobile terminal. The mobile terminal analyzes the smart cockpit data and controls the vehicle-side execution device to respond to the control command. When there is no application deployment on the vehicle-side, the vehicle-side can also trigger commands to control the vehicle.

[0069] Furthermore, the method further comprises:

[0070] detecting an application selection instruction for the desktop application based on the display screen, and sending the application selection instruction to the mobile terminal;

[0071] The control interface data of the target application sent by the mobile terminal is received, and the control interface of the target application is displayed on the display screen according to the control interface data.

[0072] According to the above technical means, in the interconnected mode, the vehicle control can be achieved by utilizing the resources of the mobile terminal, which can reduce the cost of the vehicle side, and low-configuration vehicles can also achieve rich functional control based on the resources of the mobile terminal, providing a high-configuration service experience.

[0073] Furthermore, before establishing interconnection with the mobile terminal, the method further includes:

[0074] Broadcasting an interconnection request and outputting pairing information, wherein when the mobile terminal monitors the interconnection request, it feeds back verification information to the vehicle terminal;

[0075] When the verification information is received, the mobile terminal is verified based on the verification information, and interconnection is established with the mobile terminal according to the verification result, wherein the verification information includes one or more of a pairing code input based on the output verification input window, identity authentication information of the mobile terminal, and configuration information of the mobile terminal.

[0076] According to the above technical means, when the mobile terminal and the vehicle terminal are interconnected, the security of the interconnection is guaranteed, thereby improving the safety of vehicle control.

[0077] Further, establishing interconnection with the mobile terminal according to the verification result includes:

[0078] When the verification result is that the pairing code and / or the identity authentication information match, determining the interconnection protocol according to the configuration information of the mobile terminal, the configuration information reflecting the system of the mobile terminal;

[0079] An interconnection channel is established based on the interconnection protocol to interconnect with the mobile terminal.

[0080] According to the above technical means, the vehicle terminal can be interconnected with mobile terminals of different configurations (brands), adapt to the control of mobile terminals of different configurations, and increase the adaptability of the vehicle terminal.

[0081] A vehicle control system, comprising: a mobile terminal, a vehicle terminal and a vehicle terminal execution device; the vehicle terminal comprises a display screen, the mobile terminal can be interconnected with the vehicle terminal, and the mobile terminal can also be connected to the vehicle terminal execution device in a communication manner; wherein:

[0082] The mobile terminal is used to send the desktop application to the vehicle terminal;

[0083] The vehicle terminal is used to receive the desktop application sent by the mobile terminal and display the desktop application on the display screen; the vehicle terminal is also used to send the touch command to the mobile terminal when detecting a touch command to the display screen;

[0084] The mobile terminal is also used to receive the touch control command and smart cockpit data sent by the vehicle terminal; and analyze the smart cockpit data to obtain the control command corresponding to the touch control command, and control the vehicle terminal execution device to respond to the control command.

[0085] According to the above technical means, due to the interconnection between the vehicle terminal and the mobile terminal, data transmission is realized, for example, the desktop application of the mobile terminal is projected to the vehicle terminal, and the desktop application of the mobile terminal is displayed and touched based on the display screen of the vehicle terminal; in this embodiment, the intelligent cockpit function of the vehicle is set on the mobile terminal, and the vehicle terminal triggers the control, and the intelligent cockpit data is sent to the mobile terminal through the vehicle terminal. The mobile terminal uses the resources of the local terminal to run the intelligent cockpit function, analyzes and processes the intelligent cockpit data, and analyzes the control instructions corresponding to the touch instructions. Then the mobile terminal controls the vehicle-side execution device based on the control instructions, so that the touch operation can be realized on the display screen of the vehicle terminal, and the intelligent cockpit data is analyzed and processed on the mobile terminal, and the corresponding control instructions are generated, and then the vehicle-side execution device is controlled to respond. It can not only save the deployment of the intelligent cockpit function on the vehicle terminal, but also provide users with the experience of vehicle-side touch control. The intelligent cockpit function is developed on the mobile terminal, which does not affect the load of the vehicle terminal, can avoid the influence of the function and performance of the vehicle terminal, and the function development is not restricted. This embodiment expands the interconnection application between the mobile terminal and the vehicle terminal. In addition, by utilizing the hardware resources of mobile terminals, the deployment costs of hardware and software on the vehicle side can be saved or low-cost hardware can be deployed on the vehicle side, which can also achieve high-end intelligent control and reduce vehicle costs.

[0086] Further, the mobile terminal is provided with a smart cockpit application, and the smart cockpit data is analyzed based on the smart cockpit application;

[0087] The target vehicle-side execution device is used to receive the target control instruction and respond to the target control instruction.

[0088] According to the above technical means, in the interconnected mode, the vehicle control can be achieved by utilizing the resources of the mobile terminal, which can reduce the cost of the vehicle side, and low-configuration vehicles can also achieve rich functional control based on the resources of the mobile terminal, providing a high-configuration service experience.

[0089] Furthermore, the smart cockpit data includes one or more of voice information collected by a microphone, perception information of a vehicle perception system, environmental information in the cockpit, and setting information.

[0090] According to the above-mentioned technical means, the vehicle's smart cockpit functions include but are not limited to voice interaction, automatic driving, 3D car models, vehicle air conditioning control, window control, etc. Different functions are triggered and the response data is different. When a function is triggered, the corresponding smart cockpit data is sent to the mobile terminal. The mobile terminal can analyze the touch command based on the touch command and the corresponding smart cockpit data, and then respond to the corresponding control.

[0091] Furthermore, it also includes a cloud, and the mobile terminal communicates with the cloud. The mobile terminal is also used to analyze the smart cockpit data in the smart cockpit application, call the local model to analyze the smart cockpit data, or send the smart cockpit data to the cloud, and analyze the smart cockpit data through the model on the cloud. After the mobile terminal obtains the analysis result, it obtains the control instruction based on the analysis result, and controls the target vehicle-side execution device based on the control instruction. The model includes one or more of a speech recognition model, an automatic driving model, and a 3D vehicle model control model.

[0092] According to the above technical means, using the cloud to analyze the smart cockpit data can save the computing power of the mobile terminal and avoid affecting the performance of the mobile terminal. In addition, the cloud can run more complex and more powerful models and analyze more complex vehicle data.

[0093] Furthermore, the system also includes: a first communication module and a second communication module, the mobile terminal and the vehicle-side are interconnected through the first communication module, and the mobile terminal and the vehicle-side execution device are connected through the second communication module.

[0094] Furthermore, the vehicle terminal is configured with interconnection protocols corresponding to multiple systems, and the vehicle terminal is also used to select an interconnection protocol compatible with the system of the mobile terminal according to the configuration information of the mobile terminal.

[0095] According to the above technical means, the vehicle terminal can be interconnected with mobile terminals of different configurations (brands), adapt to the control of mobile terminals of different configurations, and increase the adaptability of the vehicle terminal.

[0096] A computer-readable storage medium stores a computer program / instruction, wherein the computer program / instruction is used to implement the above method when executed by a processor.

[0097] A computer program product, comprising a computer program / instruction, wherein the computer program / instruction implements the above method when executed by a processor.

[0098] Beneficial effects of the present invention:

[0099] (1) The present invention deploys the core computing power of the vehicle's intelligent cockpit function to the mobile terminal, which can not only save the deployment of the intelligent cockpit function on the vehicle side, but also provide users with a touch experience on the vehicle side. The development of the intelligent cockpit function does not affect the load on the vehicle side, and can avoid the impact on the function and performance of the vehicle side. Function development is also not restricted, and the optimization and supplement of the vehicle side function can be achieved. This embodiment expands the interconnection application between the mobile terminal and the vehicle side.

[0100] (2) The present invention sets the intelligent cockpit function of the vehicle-side on the mobile terminal, and utilizes the hardware resources of the mobile terminal, which can save the deployment cost of the hardware resources of the vehicle-side or deploy low-cost hardware on the vehicle-side, and can also realize intelligent control and reduce vehicle costs; at the same time, for low-configuration vehicle-side, intelligent control of the vehicle can also be achieved through the mobile terminal, providing a high-configuration service experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0101] Figure 1 A schematic diagram of the structure of a vehicle control system provided in one embodiment of the present application;

[0102] Figure 2 A schematic diagram of an interface for opening a mobile terminal desktop application from a vehicle terminal in a vehicle control system provided in an embodiment of the present application;

[0103] Figure 3 A schematic diagram of a flow chart of a vehicle control method provided in one embodiment of the present application;

[0104] Figure 4 A schematic flow chart of a vehicle control method provided by another embodiment of the present application;

[0105] Figure 5 A schematic diagram of the working process of a vehicle control method provided in one embodiment of the present application;

[0106] Figure 6 A schematic diagram of the structure of a vehicle control system provided in another embodiment of the present application.

[0107] Among them, 10, mobile terminal; 20, vehicle terminal; 30, vehicle terminal execution device; 31, vehicle terminal controller; 32, actuator; 40, cloud. DETAILED DESCRIPTION

[0108] The following will describe the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention, not for limiting the scope of protection of the present invention.

[0109] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0110] With the popularization of intelligent modern cars, more and more cars are equipped with intelligent interconnection systems to achieve interconnection between car computers and mobile terminals such as mobile phones.

[0111] Due to the barriers between mobile terminal manufacturers and automobile manufacturers, the current interconnection between the car terminal and the mobile terminal is simply to share the car terminal's display screen with the mobile terminal, and to operate the controls displayed on the car terminal's display screen through the mobile terminal to achieve remote control of the car terminal; or the mobile terminal's navigation interface, video playback interface, etc. can be projected onto the car terminal's display screen, and the mobile terminal's navigation interface can be displayed on the display screen to facilitate the driver's viewing and operation, or the mobile terminal's video playback interface can be displayed on the display screen to facilitate back seat or front passenger passengers to watch videos.

[0112] The application of interconnection between the vehicle terminal and the mobile terminal still has limitations. For example, the advantages of mobile terminals have not been fully utilized to replace the intelligent control functions of the vehicle terminal. The intelligent control functions of the vehicle terminal can only be developed through the vehicle terminal, but as the number of functions increases, the load of the vehicle terminal gradually reaches its limit, resulting in the impact on the functions and performance of the vehicle terminal, and the development of the vehicle terminal is also restricted.

[0113] Based on this, an embodiment of the present application proposes a vehicle control system, which realizes the transfer of the intelligent control function of the vehicle-side to the mobile terminal. Based on the control of the vehicle-side, the mobile terminal processes the operation and controls the vehicle-side execution device. In this way, the functional layout of the vehicle-side can be omitted, the load on the vehicle-side can be avoided, and the function and performance of the vehicle-side can be maintained.

[0114] Figure 1 A schematic diagram of the structure of a vehicle control system provided in an embodiment of the present application, such as Figure 1 As shown, the vehicle control system includes a mobile terminal 10, a vehicle terminal 20 and a vehicle terminal execution device 30.

[0115] The mobile terminal 10 refers to a device that can support applications, including but not limited to mobile phones, tablets, computers, etc. The vehicle terminal 20 refers to an in-vehicle infotainment system installed inside a car, which can realize information communication between people and cars, and between cars and the outside world. The vehicle terminal 20 includes a display screen and a display device that supports screen projection input. The vehicle-side execution device 30 includes but is not limited to in-vehicle air conditioning, ambient lights, windows, etc.

[0116] Among them, the mobile terminal 10 can be interconnected with the vehicle-side 20, and the mobile terminal 10 can be communicatively connected with the vehicle-side execution device 30.

[0117] Optionally, the mobile terminal 10 and the vehicle-side 20 are connected through a first communication module, and the mobile terminal 10 and the vehicle-side execution device 30 can communicate through the vehicle-side 20, or through a cloud connection, or in a preferred embodiment, the mobile terminal 10 and the vehicle-side execution device are connected through a second communication module, and the mobile terminal and the vehicle-side execution device communicate directly without passing through the cloud or the vehicle-side. The first communication module and the second communication module are two communication channels that do not affect each other, thereby realizing the mobile terminal's vehicle control function, and there is no need for multi-level transmission, thereby ensuring the timeliness of transmission and the timely response of the vehicle-side execution device.

[0118] Among them, the first communication module includes but is not limited to WiFi / USB, and the second communication module includes but is not limited to Bluetooth module, 4G / 5G module, WiFi module, NFC module, etc.

[0119] The mobile terminal 10 and the vehicle terminal 20 are connected based on the first communication module, and then interconnected based on an interconnection technology. Optionally, the interconnection technology used includes but is not limited to HiCar, CarLife, etc.

[0120] In this embodiment, after the mobile terminal 10 is interconnected with the vehicle terminal 20, data can be transmitted with the vehicle terminal 20. The mobile terminal 10 sends the desktop application to the vehicle terminal 20. The vehicle terminal 20 is used to receive the desktop application sent by the mobile terminal 10 and display the desktop application on a display screen.

[0121] Based on the desktop applications on the display screen, the user can operate the desktop applications of the mobile terminal 10. For example, the user can select to open any application in the desktop applications, or perform a touch operation on the control interface in any application.

[0122] As an example, the vehicle-side execution device 30 includes a vehicle-side controller 31, an actuator 32, and a second communication module. The mobile terminal 10 is connected to the vehicle-side execution device 30 via the second communication module. The second communication module is used to transmit the control instruction of the mobile terminal 10 to the vehicle-side controller 31. The vehicle-side controller 31 is used to control the actuator 32 to perform the corresponding action according to the control instruction. It can be seen that the vehicle-side execution device 30 of the embodiment of the present application can also be controlled based on the mobile terminal 10.

[0123] Optionally, the vehicle-side execution device 30 is a vehicle air conditioner, then the vehicle-side controller 31 is an air conditioner controller, and the actuator 32 is an air conditioner compressor and other components, which specifically correspond to the vehicle-side execution device 30. The vehicle-side execution device 30 can also be a braking system, a steering system, etc., and the corresponding vehicle-side controllers are a braking controller and a steering controller.

[0124] In this embodiment, the mobile terminal 10 is provided with a smart cockpit application, which is used to execute the smart cockpit function of the vehicle (analyze the smart cockpit data and make corresponding responses), including but not limited to vehicle control, navigation, 3D car model demonstration, voice recognition, automatic driving, etc. In other words, the vehicle terminal 20 can realize the smart cockpit function of the vehicle by utilizing the resources of the mobile terminal 10. Among them, the smart cockpit application includes but is not limited to vehicle control application, navigation, 3D car model application, voice assistant, etc., which are desktop applications of the mobile terminal 10.

[0125] Based on the present embodiment, the mobile terminal 10 is configured with a smart cockpit application, and the smart cockpit function of the vehicle is calculated and implemented using the software and hardware capabilities of the mobile terminal 10. The vehicle terminal 20 may not be configured with an application, or may not be configured with a running program of the application. The vehicle's smart cockpit data is sent to the mobile terminal 10 through the vehicle terminal 20, and the mobile terminal 10 analyzes the smart cockpit data to determine the control of the vehicle. The mobile terminal 10 directly sends the target control instruction to the target vehicle-side execution device 30, so that the vehicle's execution components are controlled by the mobile terminal 10. For example, by triggering the air-conditioning on operation on the display screen of the vehicle terminal 20, the mobile terminal 10 analyzes the touch command collected by the display screen, and determines that it is an air-conditioning on command, and then sends the air-conditioning on command to the vehicle-side execution device 30 (such as the air conditioner), and the vehicle-side execution device 30 responds to the control instruction.

[0126] In this embodiment, the vehicle's smart cockpit application is set on the mobile terminal 10 (the core software unit of the smart cockpit is deployed to the mobile terminal 10), and then the mobile terminal 10 and the vehicle terminal 20 are connected to each other, and the desktop application of the mobile terminal 10 can be projected to the vehicle terminal 20, and displayed and touched based on the display screen of the vehicle terminal 20. Since the desktop application is run by the mobile terminal 10, the touch control command of the display screen of the vehicle terminal 20 is sent to the mobile terminal 10, and the mobile terminal 10 can analyze and process the touch control command. The mobile terminal 10 and the vehicle-side execution device 30 can communicate with each other, and then control the vehicle-side execution device 30. In this way, the display screen of the vehicle terminal 20 can be touched, and the mobile terminal 10 identifies and processes the touch control command, generates the corresponding control command, and then sends it to the vehicle-side execution device 30 or the execution component of the vehicle terminal 20 for response. Based on this, the deployment of the intelligent control function application of the vehicle terminal 20 can be omitted, and the user can be provided with the touch experience of the vehicle terminal 20. The intelligent control functions of the vehicle terminal gradually increase, and the load of the vehicle terminal 20 is not affected. The impact of the function and performance of the vehicle terminal 20 can be avoided, and the function development is not restricted. Based on the interconnection between the vehicle terminal 20 and the mobile terminal 10, other functional applications in the smart cockpit can also be set on the mobile terminal 10, and these functional applications can be run using the resources of the mobile terminal 10. Through the mobile terminal 10, real-time connection with the cloud 40 can be achieved, and the data can be processed using the resources of the cloud 40, which can reduce the hardware cost of the vehicle, such as automatic driving data processing, 3D car model data processing, etc. The embodiment of the present application adds the application scenario of the interconnection between the mobile terminal 10 and the vehicle terminal 20, increasing its universality. In addition, the embodiment of the present application deploys the application on the mobile terminal 10, so the performance requirements of the vehicle-side 20 are reduced. As long as the vehicle has a responsive vehicle-side execution device 30, even if the performance of the vehicle-side 20 is low, the intelligent control function can be implemented through the mobile terminal 10. Therefore, the embodiment of the present application can be applicable to high-end / low-end vehicles (low-cost vehicles), providing high-end services for low-end vehicle users and improving the vehicle usage experience.

[0127] In the desktop application of the mobile terminal 10, applications adapted to the vehicle-side execution device 30 or the execution component of the vehicle-side 20 can be touch-controlled on the display screen of the vehicle-side 20. The following takes the vehicle control application as an example to illustrate the structure and principle of the vehicle control system proposed in this embodiment:

[0128] The vehicle control application is set in the mobile terminal 10. After the mobile terminal 10 and the vehicle terminal 20 are interconnected, the vehicle control application is one of the desktop applications. When the user wants to control the vehicle, he can select the vehicle control application, open the control interface of the vehicle control application, and then control the vehicle.

[0129] Based on this, in the embodiment of the present application, the mobile terminal 10 is also used to monitor the selection instruction of the vehicle control application based on the display screen, and send the control interface data of the vehicle control application to the vehicle terminal 20. Figure 2 As shown, when the user selects to open the vehicle control application based on the desktop application displayed on the display screen, the vehicle terminal 20 sends the selection operation to the mobile terminal 10. The system interface of the mobile terminal 10 monitors the selection instruction and sends the control interface data of the vehicle control application to the vehicle terminal 20.

[0130] The vehicle terminal 20 receives the control interface data sent by the mobile terminal 10, and based on the control interface data, displays the control interface of the vehicle control application on the display screen of the vehicle terminal 20 (the display screen switches to the control interface of the vehicle control application). The control interface includes multiple vehicle control functions, and the user can select the corresponding control function through the control interface to control the vehicle, including but not limited to the following: turn on / off the air conditioner, open / close the windows, play / turn off the ambient light, and open / close the sunroof.

[0131] The vehicle terminal 20 is also used to monitor the touch control instructions of the control interface based on the display screen, and send the touch control instructions to the mobile terminal 10. The user displays the control interface on the display screen and selects the function to be triggered, such as turning on the air conditioner. The vehicle terminal 20 sends the touch control instructions to the mobile terminal 10 for the mobile terminal 10 to analyze the touch control instructions.

[0132] The mobile terminal 10 is also used to monitor the touch commands sent by the vehicle terminal 20, and generate target control commands for the target vehicle terminal execution device 30 according to the touch commands, and send the target control commands to the target vehicle terminal execution device 30; the target vehicle terminal execution device 30 is used to receive the target control commands and respond to the target control commands.

[0133] The mobile terminal 10 monitors the touch command sent by the vehicle terminal 20 through the system interface, and then calls the vehicle control application to identify the touch command, generates a target control command for the target vehicle terminal execution device 30 according to the identification result, and then sends the target control command to the target vehicle terminal execution device 30. The target vehicle terminal execution device 30 receives the target control command and executes the corresponding action. For example, if the mobile terminal 10 calls the vehicle control application to identify the touch command as turning on the air conditioner, a vehicle air conditioner start command is generated, and the target vehicle terminal execution device 30 is determined to be a vehicle air conditioner, and the vehicle air conditioner start command is sent to the vehicle air conditioner. After the vehicle air conditioner receives the vehicle air conditioner start command, it starts the compressor and other refrigeration components, and the vehicle air conditioner is turned on.

[0134] For other applications, the usage process is the same as that of the above-mentioned vehicle control application. For example, the music playback application is set in the mobile terminal 10. After the mobile terminal 10 and the vehicle terminal 20 are interconnected, the music playback application is one of the desktop applications. When the user wants to play music, he can select the music playback application, open the playback interface of the music playback application, and select the music to be played based on the playback interface. The mobile terminal 10 sends the music data to the vehicle terminal 20, and the vehicle terminal 20 plays the music data through the player to realize the control of the player of the vehicle terminal 20. The specific operation process and control process can refer to the embodiments listed above.

[0135] Furthermore, the vehicle control system also includes a cloud 40, and the mobile terminal 10 communicates with the cloud 40. The mobile terminal 10 is also used to analyze the smart cockpit data in the smart cockpit application, call the local model to analyze the smart cockpit data, or send the smart cockpit data to the cloud 40, and analyze the smart cockpit data through the model of the cloud 40. After the mobile terminal 10 obtains the analysis result, it obtains the control instruction based on the analysis result and sends the control instruction to the target vehicle-side execution device 30.

[0136] For example, desktop applications also include voice assistants, 3D car model applications, autonomous driving applications, etc. For these applications, during operation, it is necessary to process the smart cockpit data through the model to realize the application functions. In this embodiment, the mobile terminal 10 and the cloud 40 can process the smart cockpit data through the local model of the mobile terminal 10, or through the model of the cloud 40. Correspondingly, the model includes one or more of the following: a speech recognition model, an autonomous driving model, and a 3D car model control model.

[0137] As an example, Figure 6 As shown, the mobile terminal 10 can also process the smart cockpit data through the mobile terminal server, provide capability compensation for the mobile terminal 10, and implement analysis of the vehicle's smart cockpit data based on the mobile terminal 10, as well as control of the vehicle's vehicle-side execution device 30.

[0138] As an example, desktop applications can also include home appliance applications and office equipment applications, such as home monitoring applications, home air conditioning applications, office monitoring applications or office air conditioning applications, etc. The monitoring status can be viewed through the vehicle terminal 20, or the air conditioner can be controlled to turn on.

[0139] As an example, in order to make the vehicle terminal 20 adapt to mobile terminals 10 of different brands, the vehicle terminal 20 of this embodiment is configured with interconnection protocols corresponding to multiple systems. The vehicle terminal 20 selects an interconnection protocol adapted to the system of the mobile terminal 10 according to the terminal information of the mobile terminal 10 for establishing connection, and interconnects with the mobile terminal 10 to realize data transmission with the mobile terminal 10. In this way, the problem of being unable to expand the application of the interconnected mobile terminal 10 and the vehicle terminal 20 due to the barrier problem between the mobile terminal 10 manufacturer and the automobile manufacturer can be solved.

[0140] Users can use mobile terminals 10 of different brands to interconnect with the vehicle-side terminal 20, project the desktop application of the mobile terminal 10 to the display screen of the vehicle-side terminal 20, and project the application interface of each application to the display screen of the vehicle-side terminal 20. The display screen of the vehicle-side terminal 20 is touched, and the mobile terminal 10 recognizes and responds to the touch operation, and then sends corresponding control instructions to the vehicle-side execution device 30 to control the vehicle.

[0141] As an example, the display screen of the vehicle terminal 20 includes a smart desktop, and the desktop application of the mobile terminal 10 is displayed on the smart desktop. The smart desktop can select the number of split screens according to the number of open applications, thereby realizing the display of multiple application interfaces on the display screen. For example, the user can open the navigation application and the vehicle control application interface at the same time, and control the vehicle based on the vehicle control interface.

[0142] Based on the above-mentioned vehicle control system, the embodiment of the present application further proposes a vehicle control method, which enables the vehicle control system to operate normally. The implementation of the vehicle control method is specifically described through the following embodiments.

[0143] Figure 3 An interactive flow diagram of a vehicle control method provided for an embodiment of the present application is provided. Based on the interactive flow diagram, a method for implementing interconnection among a mobile terminal, a vehicle-side computer, and a vehicle-side execution device in a vehicle control system is specifically described.

[0144] like Figure 3 As shown, the method includes:

[0145] S301, the hand-car interconnection control on the vehicle side is triggered, the pairing information is output, and the interconnection request is broadcast;

[0146] This step is performed on the vehicle side, which is equipped with a hand-car interconnection control. When the vehicle and the mobile terminal are interconnected for the first time, the connection is carried out through the hand-car interconnection control. When the user triggers the hand-car interconnection control, the vehicle side outputs pairing information and broadcasts an interconnection request at the same time. Optionally, the interconnection request is broadcast through the first communication module. Mobile terminals that can be paired with the first communication module can monitor the interconnection request. For example, when the first communication module is WiFi, the mobile terminal based on the same local area network can monitor the interconnection request, or when the first communication module is USB, the mobile terminal inserted into the USB of the vehicle side can monitor the interconnection request.

[0147] As an example, the pairing information includes but is not limited to a pairing code.

[0148] S302, when the mobile terminal receives the interconnection request, it obtains the verification information for interconnection with the vehicle terminal and sends the verification information to the vehicle terminal.

[0149] This step is performed on the mobile terminal. When the mobile terminal monitors the interconnection request through the first communication module, it outputs a verification input window, and the user enters verification information based on the verification input window. The authentication is passed only when the verification information matches the pairing information output by the vehicle terminal.

[0150] As an example, the verification information includes a pairing code, the vehicle terminal outputs the pairing code, the user can obtain the pairing code through the vehicle terminal, and then enter the pairing code through the verification input window of the mobile terminal. The mobile terminal then sends the pairing code to the vehicle terminal.

[0151] As an example, the verification information includes identity authentication information of the mobile terminal.

[0152] As an example, the verification information includes a pairing code and configuration information of the mobile terminal, wherein the configuration information reflects the brand of the mobile terminal or the system adopted by the mobile terminal, and the verification information is sent to the vehicle terminal.

[0153] S303, the vehicle terminal receives the verification information sent by the mobile terminal, and establishes interconnection with the mobile terminal based on the verification information.

[0154] As an example, the verification information includes a pairing code, and the vehicle terminal determines that the pairing code sent by the mobile terminal matches the pairing code output by the vehicle terminal, that is, the vehicle terminal establishes a connection with the mobile terminal.

[0155] As an example, in order to improve the safety of vehicle control and prevent illegal personnel from controlling the vehicle, the verification information sent by the mobile terminal includes a pairing code and the identity authentication information of the mobile terminal. The vehicle terminal verifies whether the identity authentication information of the mobile terminal matches the user authentication information associated with the vehicle terminal, and whether the pairing code sent by the mobile terminal matches the pairing code output by the vehicle terminal. If both match, the mobile terminal is associated with the vehicle terminal.

[0156] In the above example, the systems of the mobile terminal and the vehicle terminal are required to match to realize data transmission and control between the mobile terminal and the vehicle terminal.

[0157] As an example, the verification information also includes the configuration information of the mobile terminal, which reflects the brand of the mobile terminal or the system used by the mobile terminal. The vehicle terminal is configured with a variety of interconnection protocols, and different interconnection protocols correspond to mobile terminals of different brands. When the vehicle terminal receives the verification information, it determines the match based on the pairing code or identity authentication information, and also determines the interconnection protocol based on the configuration information of the mobile terminal, and then establishes an interconnection channel based on the interconnection protocol to interconnect with the mobile terminal.

[0158] In this example, the vehicle computer selects an interconnection protocol suitable for the mobile terminal to establish interconnection with the mobile terminal based on the configuration information of the mobile terminal. There is no need to restrict the brand of the mobile terminal based on the vehicle computer. In other words, the vehicle computer can adapt to mobile terminals of various brands and is not restricted by the barriers between mobile terminal manufacturers and vehicle computer manufacturers, thereby improving convenience and user experience.

[0159] It should be noted that the above steps S301 to S303 are based on the operation process when the mobile terminal and the vehicle terminal are connected for the first time. When the mobile terminal and the vehicle terminal are connected, the vehicle terminal records the information of the mobile terminal. When the connection is established again, the connection can be automatically completed directly based on the first communication module connection, and there is no need to verify the mobile terminal again.

[0160] S304, the mobile terminal establishes an association with the vehicle terminal, and projects the desktop application to the vehicle terminal.

[0161] Optionally, all desktop applications of the mobile terminal can be projected to the vehicle terminal, and applications associated with the vehicle can be projected to the vehicle terminal based on a preset program. Alternatively, applications associated with the vehicle can be collected in a folder, and the desktop applications in the folder can be projected to the vehicle terminal.

[0162] S305, the vehicle computer displays the desktop application of the mobile terminal on the display screen.

[0163] This step is performed on the vehicle computer side. The vehicle computer side receives the desktop application sent by the mobile terminal and projects the desktop application onto the display screen.

[0164] As an example, the display mode of the desktop application can be the same as that of the mobile terminal. Or, as another example, the display mode of the desktop application can also be adjusted based on the smart desktop of the vehicle terminal, for example, sorted based on user convenience or based on the frequency of use of the user on the vehicle terminal, and displayed on the display screen.

[0165] Optionally, after the vehicle terminal and the mobile terminal are interconnected, the interconnection channel can transmit and communicate data streams, video streams, and audio streams. Therefore, the desktop application can be transmitted via data streams.

[0166] S306, the vehicle computer sends touch commands and smart cockpit data to the mobile terminal.

[0167] This step is performed on the vehicle side, where the smart cockpit data includes one or more of the voice information collected by the microphone, the perception information of the vehicle perception system, the environmental information in the cockpit, and the setting information, and the setting information includes the setting information of the function, such as the set temperature of the air conditioner, the set opening of the sunroof, etc.

[0168] The vehicle-side display screen displays the desktop application sent by the mobile terminal. The user can trigger any application in the desktop application through the display screen to trigger control of the application and generate touch commands; or wake up the microphone through voice to trigger the wake-up command. The vehicle-side is deployed with a microphone or microphone array to collect voice information in the cabin in real time; or the vehicle is deployed with a vehicle perception system to collect perception information to achieve assisted driving or automatic driving; or an environmental detection device is deployed in the cabin to detect environmental information in the cabin.

[0169] S307, receiving the touch control command and smart cockpit data sent by the vehicle terminal, analyzing the smart cockpit data, and obtaining a control command corresponding to the touch control command;

[0170] This step is applied to mobile terminals. The mobile terminals deploy smart cockpit applications, which can analyze and process smart cockpit data, replacing the vehicle-side smart cockpit function. Among them, smart cockpit data is associated with the function triggered by the touch command indication. For example, if the touch command indication triggers turning on the air conditioner, the smart cockpit data sent is the environmental information in the cabin, the set temperature, etc.; if the touch command indication triggers voice recognition, the smart cockpit data sent is the voice information collected by the microphone, etc.; if the touch command indication triggers automatic driving, the smart cockpit data sent is perception information.

[0171] In the related technology, a smart cockpit function is set on the vehicle to control the vehicle through touch operation of the display screen; voice information is recognized through a voice assistant to complete human-computer interaction (voice control); assisted driving or automatic driving of the vehicle is achieved through the perception information collected by the vehicle perception system; and automatic adjustment of the environmental comfort level in the cabin is achieved through the detected environmental information in the cabin.

[0172] In the embodiment of the present application, the smart cockpit application is deployed to the mobile terminal, combined with the hardware resources of the mobile terminal, the smart cockpit data is analyzed based on the smart cockpit application, and the vehicle-side execution device is controlled according to the analysis results, so that the vehicle-side and the vehicle do not need to deploy corresponding applications and the hardware to run these applications, thereby avoiding an increase in the load on the vehicle-side due to the increase in intelligent control functions.

[0173] Based on this, the present embodiment is arranged that after the vehicle terminal and the mobile terminal are interconnected, the vehicle terminal sends the smart cockpit data to the mobile terminal, which is controlled by the mobile terminal.

[0174] The specific implementation method can be: after the vehicle-side and the mobile terminal are interconnected, data can be transmitted between the vehicle-side and the mobile terminal. After the mobile terminal sends the desktop application to the vehicle-side, the vehicle-side display screen displays the desktop application, and the user can trigger the control through the vehicle-side display screen. The vehicle-side sends the trigger instruction and the smart cockpit data to the mobile terminal. The mobile terminal determines the triggered function through the trigger instruction, determines the target control parameters of the function by analyzing the smart cockpit data, and then generates a control instruction. The vehicle-side execution device responds to the control instruction, thereby triggering the function application.

[0175] S308, sending the control instruction to the vehicle-side execution device.

[0176] After receiving the control command, the vehicle-side execution device responds to the control command.

[0177] In some embodiments, the mobile terminal may send the control command to the vehicle-side execution device through the vehicle-side computer, or may send the control command to the vehicle-side execution device through the cloud.

[0178] Alternatively, in some other embodiments, the mobile terminal also establishes a communication connection with the vehicle-side execution device. The mobile terminal sends the control instruction to the vehicle-side execution device through the communication connection to control the vehicle-side execution device to respond to the control instruction.

[0179] The mobile terminal communicates with the vehicle-side execution device and transmits control instructions through the communication, directly transmitting the control instructions to the vehicle-side execution device without going through the cloud or the vehicle-side. There are two communication channels with the vehicle-side, which do not affect each other, realizing the mobile terminal's vehicle control function without going through multi-level transmission, ensuring the timeliness of transmission and timely response of the vehicle-side execution device.

[0180] Optionally, the mobile terminal and the vehicle-side execution device are connected via a second communication module. Specifically, when the mobile terminal and the vehicle-side execution device are connected for the first time, the vehicle-side execution device verifies whether the vehicle bound to the mobile terminal matches the vehicle to which the vehicle-side execution device belongs through the application account information of the mobile terminal. If they match, a connection can be established. If not, the vehicle-side execution device does not establish a connection with the mobile terminal.

[0181] As an example, in order to ensure communication security, when the mobile terminal sends a control instruction to the vehicle-side execution device, the control instruction is encrypted. The encryption is specifically based on the adopted communication protocol.

[0182] In some examples, the second communication module of the vehicle-side execution device may include multiple types, such as a Bluetooth module, a 4G / 5G module, a WiFi module, an NFC module, etc. When the mobile terminal and the vehicle-side execution device are connected based on different second communication modules, the communication protocols used are different. Based on this, in this example, when the mobile terminal sends a control instruction to the vehicle-side execution device, the vehicle-side execution device can receive the control instruction according to the communication method selected by the mobile terminal, and parse and decrypt the control instruction.

[0183] For example, the mobile terminal uses a Bluetooth module to send control instructions, which are encrypted and sent to the vehicle-side execution device through a custom protocol. The Bluetooth module of the vehicle-side actuator receives the control instructions and sends them to the vehicle-side controller for parsing and decryption.

[0184] The mobile terminal uses a 4G / 5G module to send control instructions, which are encrypted through a custom protocol and sent to the vehicle-side execution device. The networking module of the vehicle-side execution device receives the control instructions and sends them to the vehicle-side controller for parsing and decryption.

[0185] The mobile terminal uses a WiFi module to send control instructions, which are encrypted through a custom protocol and sent to the vehicle-side execution device. The WiFi module of the vehicle-side execution device receives the control instructions and sends them to the vehicle-side controller for parsing and decryption.

[0186] The mobile terminal uses the NFC module to send control instructions, which are encrypted and sent to the vehicle-side execution device through a custom protocol. The NFC module of the vehicle-side execution device receives the control instructions and sends them to the vehicle-side controller for parsing and decryption.

[0187] The technical solution of this embodiment realizes touch operation on the vehicle-side display screen, analyzes and processes the smart cockpit data on the mobile terminal, generates corresponding control instructions, and then controls the vehicle-side execution device to respond. It can not only save the deployment of the smart cockpit function on the vehicle-side, but also provide users with a touch experience on the vehicle-side. The smart cockpit function is developed on the mobile terminal, which does not affect the load on the vehicle-side, can avoid the impact on the function and performance of the vehicle-side, and the function development is not restricted. This embodiment expands the interconnection application between the mobile terminal and the vehicle-side. In addition, by utilizing the hardware resources of the mobile terminal, the deployment cost of the hardware and software on the vehicle-side can be saved or low-cost hardware can be deployed on the vehicle-side, which can also achieve high-end intelligent control and reduce vehicle costs.

[0188] Figure 4 This is a schematic diagram of an interaction process of a vehicle control method provided by another embodiment of the present application. Based on this interactive process diagram, the interactive process of vehicle control is described by taking the touch control instructions of the display screen as an example of smart cockpit data. Figure 4 As shown, the method includes:

[0189] S401, the mobile terminal establishes an association with the vehicle terminal, and projects the desktop application to the vehicle terminal.

[0190] S402, the vehicle computer displays the desktop application of the mobile terminal on the display screen.

[0191] In this embodiment, the vehicle control application on the vehicle side is set on the mobile terminal in the related technology, and the intelligent control function development on the vehicle side needs to be transferred to the mobile terminal, and the intelligent control function is developed on the mobile terminal, thereby reducing the load on the vehicle side. Then, by projecting the vehicle control application on the mobile terminal to the display screen on the vehicle side, the user can trigger the vehicle control application through the display screen and control the vehicle.

[0192] S403, the vehicle terminal sends an application selection instruction for the desktop application based on the display screen to the mobile terminal.

[0193] When the user selects an application from the desktop applications displayed on the display screen, the vehicle terminal sends an application selection instruction to the mobile terminal.

[0194] S404, determining a target application according to the application selection instruction sent by the vehicle computer, and sending control interface data of the target application to the vehicle computer.

[0195] After the mobile terminal monitors the application selection command sent by the vehicle computer, it determines the target application according to the trigger position of the application selection command and the application at the corresponding position, then performs data conversion on the control interface of the target application to obtain the control interface data, and then sends the control interface data to the vehicle computer.

[0196] In this step, the mobile terminal sends the control interface data to the vehicle computer, and the vehicle computer can generate an adaptive control interface based on the control interface data. Compared with directly projecting the control interface to the vehicle computer, this embodiment can avoid dominating the display screen of the vehicle computer. While the vehicle computer displays the control interface, other operations can also be performed on the display screen, such as exiting full screen, shrinking the display window, moving the display window, splitting the screen, etc.

[0197] As an example, when the target application is a 3D car model application, the control interface data of the target application is sent to the vehicle computer, including:

[0198] Generate a 3D vehicle model based on vehicle information and a preset 3D model; wherein, after the mobile terminal and the vehicle terminal are interconnected, the vehicle terminal sends the vehicle information to the mobile terminal, or the smart cockpit data also includes vehicle information. For example, when the vehicle terminal sends an application selection instruction to the mobile terminal, if the target application corresponding to the application selection instruction is a 3D car model application, the vehicle information and the application selection instruction are packaged and sent to the mobile terminal. Alternatively, the mobile terminal registers a personal account in the 3D car model application, and obtains the vehicle information through the vehicle information associated with the personal account. Among them, the vehicle information includes vehicle model, vehicle color, brand, etc.

[0199] The control interface data of the 3D vehicle model is sent to the vehicle computer, and the control interface data includes the 3D vehicle model data and the touch function data of the 3D vehicle model.

[0200] In this embodiment, a 3D vehicle model of the vehicle is generated on the mobile terminal side, and then the generated 3D vehicle model is sent to the vehicle side in the form of control interface data. After the vehicle side receives the control interface data, it can be displayed on the display screen based on the data. Since the generation process of the 3D vehicle model requires high-configuration hardware and software support, this application sets the generation process of the 3D vehicle model in the mobile terminal and generates it using the resources of the mobile terminal. The vehicle side does not need to generate the 3D vehicle model. For the vehicle side with low-configuration hardware, the display of the 3D vehicle model and the control of the vehicle based on the 3D vehicle model can also be realized.

[0201] As an example, the control interface data of the target application is sent to the vehicle computer, including:

[0202] Obtain the size of the window to be displayed of the display screen of the vehicle terminal; adapt the control interface data of the vehicle control application according to the size of the window to be displayed; and send the control interface data to the vehicle terminal.

[0203] When the display screen does not display an application interface, the size of the window to be displayed is the display size of the display screen; when the display screen displays an application interface, the size of the window to be displayed is the preset split-screen window size.

[0204] In this example, the mobile terminal configures the control interface data based on the size of the window to be displayed, and then sends the control interface data of the corresponding size to the vehicle terminal, so that the vehicle terminal can generate an adapted control interface based on the control interface data. In this way, this embodiment can be adapted to high-end and low-end vehicle terminals and has universality.

[0205] As an example, the size of the window to be displayed can be requested to be sent by the vehicle terminal. Or, as another example, it can be determined based on the number of applications currently opened on the vehicle terminal. For example, when the vehicle terminal opens the navigation application and then opens the vehicle control interface, it is determined that the vehicle terminal needs to display two applications in split screen. Based on the preset dual-screen allocation ratio, the size of the window to be displayed is determined. The scenario of opening N applications is similar.

[0206] S405, the vehicle terminal displays the control interface of the target application on the display screen according to the control interface data;

[0207] After receiving the control interface data, the vehicle computer generates a control interface according to the control interface data, and then displays the control interface on the display screen.

[0208] In this embodiment, the control interface displayed on the vehicle terminal is the same as the control interface of the target application of the mobile terminal. The user can trigger the function on the target application based on the control interface, so that the mobile terminal controls the vehicle terminal execution device to execute the function.

[0209] Optionally, the target application includes, but is not limited to, a vehicle control application, a 3D car model application, navigation, a voice assistant, etc. For example, the functions of the vehicle control application include turning on the air conditioner, opening the car window, and the like.

[0210] In this embodiment, the vehicle terminal determines the display window of the control interface based on the application currently displayed on the display screen. When the display screen does not display the application interface, the display screen displays the control interface in full screen. When the display screen displays the application interface, the corresponding application interface is displayed in each display window based on the preset split-screen specifications.

[0211] S406, the vehicle terminal sends a touch command triggered by the control interface of the target application to the mobile terminal;

[0212] S407, the mobile terminal determines the target function indicated by the touch instruction according to the touch instruction and the functions configured in the target application, and determines the target control instruction based on the target function and the smart cockpit data.

[0213] After the mobile terminal monitors the touch command, it analyzes the touch command, determines the target function indicated by the touch command, and determines the target vehicle-side execution device to be controlled based on the target function. Then the target control command is sent to the target vehicle-side execution device. For example, if the touch command indicates to turn on the car air conditioner, the target vehicle-side execution device is the car air conditioner, and the target control command is to turn on the car air conditioner.

[0214] The following three examples illustrate how the original applications on the vehicle computer are transferred to the mobile terminal and run and analyzed by the mobile terminal. The vehicle computer only displays the applications and does not process the data.

[0215] Taking the target application as the vehicle control application and the target function as turning on the air conditioner as an example, the mobile terminal determines the operating parameters of the air conditioner according to the set temperature of the air conditioner and the environmental information in the cabin. Among them, if the touch command indicates that the control is to turn on the air conditioner, the set temperature and the environmental information in the cabin are packaged as smart cabin data and sent to the mobile terminal together with the touch command. The mobile terminal analyzes the operating parameters of the air conditioner, and then generates a target control command based on the operating parameters, sends the set temperature and environmental information to the mobile terminal, and uses the resources of the mobile terminal to analyze the environment in the cabin, so that the mobile terminal can intelligently control the vehicle air conditioner to operate according to the user's comfort. In this way, even if the vehicle air conditioner does not have intelligent functions, it can also be intelligently controlled by the mobile terminal to improve the comfort of the cabin.

[0216] In this embodiment, the vehicle computer does not need to process the data of turning on the air conditioner, and the mobile terminal analyzes and controls it. Therefore, the vehicle computer does not need to deploy the vehicle control application, and the development of functional applications is omitted. Instead, the vehicle control application is deployed to the mobile terminal, and the original resources of the mobile terminal are used to realize intelligent control of the vehicle air conditioner and achieve comfort adjustment.

[0217] Take the target application as a vehicle control application and the target function as playing the ambient light as an example: when the touch command monitored by the mobile terminal is to play the ambient light, the music playing information of the cockpit is obtained, and the ambient light working parameters are determined based on the music playing information; the target control instruction is generated based on the ambient light working parameters, so that the vehicle's ambient light (vehicle-side execution device) performs lighting control according to the target control instruction, so that the vehicle's ambient light flashes according to the rhythm of the played music, increasing the sense of atmosphere and improving the user experience.

[0218] It should be noted that when the touch command monitored by the mobile terminal is to play the ambient light, the music playing information is obtained through the music player of the mobile terminal, or the music playing information in the cockpit is collected through the microphone of the mobile terminal, or the music playing information is sent to the mobile terminal as smart cockpit data through the vehicle terminal. If the music playing information is not obtained, the target control command is generated with the default ambient light working parameters. If the music playing information is obtained, the ambient light working parameters are determined according to the music playing information, and then the target control command is generated.

[0219] Taking the target application as a 3D car model application as an example, the control interface of the 3D vehicle application displays a 3D vehicle model, and the user can trigger control through the 3D vehicle model. For example, when the user clicks on the door of the 3D vehicle model, the touch door opens. It can be seen that in this example, after the mobile terminal monitors the touch command, it determines the target function indicated by the touch command based on the trigger position of the touch command in the 3D vehicle model, and then generates the corresponding target control command according to the target function.

[0220] The functions in the 3D car model application include rotating the 3D vehicle model, opening / closing the door, opening / closing the trunk, rendering the 3D car model, or one or more of the trigger position map of the 3D car model. The mobile terminal performs corresponding analysis according to the function triggered by the user, and then generates corresponding control instructions. For example, if the target function is to rotate the 3D vehicle model, the mobile terminal needs to determine the direction of the 3D vehicle model according to the direction indicated by the touch instruction, and then generate the 3D vehicle model data after the rotation according to the direction, and send it to the car machine end, so that the car machine end can display the rotated 3D vehicle model. Alternatively, if the target function is to render a 3D vehicle, the mobile terminal determines the position to be rendered and the rendering information according to the touch instruction, calls the rendering tool to render the position to be rendered on the 3D vehicle model, and sends the rendered 3D vehicle model data to the car machine end, so that the car machine end can display the rendered 3D vehicle model. Alternatively, if the target function is to open the door, the mobile terminal generates a door opening instruction and sends it to the door controller, and the door controller controls the door to open. The examples listed above are to illustrate that in this embodiment, the control data of the vehicle end is analyzed and controlled by the mobile terminal, and the display screen of the vehicle end collects data but does not analyze and control the data. Therefore, the embodiment of the present application realizes the intelligent control of the vehicle by utilizing the resources of the mobile terminal and reduces the load on the vehicle end.

[0221] As an example, the mobile terminal calls the system interface to listen to the touch command, and then calls the target application to analyze the touch command to achieve fast and accurate recognition and response to the touch operation.

[0222] S408, the mobile terminal sends the target control instruction to the target vehicle-side execution device that executes the target function;

[0223] S409, the target vehicle-side execution device responds to the target control instruction.

[0224] The target vehicle-side execution device performs corresponding operations according to the target control instructions.

[0225] As an example, in order to prompt the user of the control result of the vehicle-side execution device, the target vehicle-side execution device responds to the target control instruction and feeds back the response information to the mobile terminal, and the mobile terminal feeds back the response information to the vehicle-side, and the vehicle-side displays the response information on the display screen. If the response information is not received, the user can find out the abnormal control situation in time, and through the feedback information, the user can know the current control situation of the vehicle.

[0226] It should be noted that this embodiment is not limited to the above-mentioned applications, and other applications and control processes of other applications are similar.

[0227] In this embodiment, in the interconnected mode, mobile phone resources can be used to solve the problem of vehicle control function.

[0228] Based on all the above embodiments, the intelligent cockpit data is taken as the voice information collected by the microphone as an example, and the process of cockpit data analysis based on the mobile terminal is described as an example:

[0229] After the mobile terminal monitors the voice information, it recognizes the voice information based on the local voice assistant recognition model to obtain the recognition result, or sends the voice information to the cloud, recognizes the voice information through the cloud voice recognition model to obtain the recognition result;

[0230] Since it is inconvenient for the driver to operate the display screen during vehicle driving, human-computer interaction has become an essential function on the vehicle side. Human-computer interaction requires the use of a voice assistant recognition model to recognize voice information, and the space occupied by the model and the required computing power are relatively large. Mobile terminals generally have voice assistant functions. Therefore, the embodiment of the present application is based on the interconnection between the mobile terminal and the vehicle side, and the voice assistant function of the mobile terminal can be used to realize voice recognition on the vehicle side. Based on this, after the vehicle side and the mobile terminal are interconnected, the voice information collected by the microphone is sent to the mobile terminal, and the local voice assistant recognition model is called by the mobile terminal or the voice recognition model in the cloud is used to recognize the voice information to obtain the recognition result. The mobile terminal then controls the vehicle to respond to the voice information based on the recognition result.

[0231] For example, when the recognition result is a voice control instruction of the target vehicle-side execution device, the target control instruction is determined based on the voice control instruction, and then the target control instruction is sent to the target vehicle-side execution device, and the target vehicle-side execution device executes the target control instruction to achieve voice control. For example, if the voice information is a voice control instruction to increase the temperature of the air conditioner, after the mobile terminal recognizes the voice control instruction, it generates a target control instruction according to the voice control instruction, and then sends the target control instruction to the air conditioner controller to adjust the operating parameters of the air conditioner so that the temperature in the cabin increases.

[0232] When the recognition result is voice-to-text, the recognized target text is sent to the vehicle terminal and displayed on the display screen of the vehicle terminal. If the voice sent by the user is for transcription (such as conference-to-text), the recognized target text is sent to the vehicle terminal and displayed on the display screen, or is formed into a word file and stored in the memory of the mobile terminal.

[0233] In this embodiment, the mobile terminal recognizes and processes the voice information of the vehicle terminal, and performs corresponding interaction based on the recognition result, without setting up a voice assistant on the vehicle terminal.

[0234] In an embodiment, when the user wakes up the voice assistant, the microphone on the vehicle side is awakened, and the voice information collected in real time is sent to the mobile terminal, wherein the wake-up command of the voice assistant is a touch command.

[0235] Based on all the above embodiments, the intelligent cockpit data is taken as the perception information of the vehicle perception system as an example, and the process of cockpit data analysis based on the mobile terminal is described as an example:

[0236] After receiving the perception information, the mobile terminal processes the perception information based on a preset autonomous driving model, or sends the perception information to the cloud, where the autonomous driving model processes the perception information to obtain driving control instructions; the driving control instructions are then sent to the corresponding target vehicle-side execution device.

[0237] When the automatic driving function is started, the vehicle computer will send the start-up command to the mobile terminal. The mobile terminal will trigger the automatic driving function, receive the perception information in real time, analyze the perception information, and then control the vehicle based on the analysis results.

[0238] In this embodiment, the automatic driving function or assisted driving function of the vehicle is set in the mobile terminal. The vehicle terminal sends the perception information of the vehicle perception system to the mobile terminal, and the mobile terminal analyzes and processes the perception information to obtain the driving control instruction, and then sends the driving control instruction to the corresponding vehicle-side execution device. For example, when the driving control instruction is braking, it is sent to the braking controller, and the braking controller controls the vehicle braking; when the driving control instruction is steering, it is sent to the direction controller, and the direction controller controls the steering wheel rotation of the vehicle; when the driving control instruction is acceleration, it is sent to the acceleration controller, and the driving controller controls the acceleration of the vehicle. The automatic driving of the vehicle is controlled by the mobile terminal.

[0239] Based on the above embodiments, the following takes a mobile phone as a mobile terminal, WiFi / USB as a screen projection channel, and BLE as a data transmission channel as an example to illustrate the workflow of controlling the air conditioner based on a vehicle control application. Figure 5 The detailed workflow is as follows:

[0240] 1. The process of establishing the screen projection channel between the mobile phone and the vehicle side is as follows: the vehicle side starts the USB device insertion event monitoring to monitor whether there is a USB device connected. At the same time, it starts the BLE broadcast to monitor whether there is a connection event. If there is a USB device or a connection event connected, an interconnection channel is established after negotiation. At the same time, the data transmission channel establishment process is as follows: the mobile phone scans the vehicle-side key channel broadcast information, initiates a connection after scanning, the vehicle-side BLE authenticates the connection event and negotiates the key. After the authentication is passed, a secure channel is established for data transmission.

[0241] 2. After establishing the screen projection channel and data transmission channel, the mobile phone converts the application APP data, where the converted data includes the air conditioning control interface in the application. Specifically, in this process, the application can call the car-side interface to obtain the size information of each window, and the interface display of the application is adapted according to the window size to complete the display of the application interface and information.

[0242] 3. The converted data is transmitted to the vehicle computer via the WiFi / USB module.

[0243] 4. After receiving the data, the WiFi / USB module on the vehicle side converts it into the original application and sends it to the display screen for display.

[0244] 5. The user generates a screen click event through the display screen, and the interconnected application monitors the display screen click event. When there is a click event, the click event is sent to the WiFi / USB module, such as clicking to turn on the air conditioning control.

[0245] 6. The WiFi / USB module on the vehicle sends the screen click event to the WiFi / USB module on the mobile phone, and reports the click event to the mobile phone.

[0246] 7. The WiFi / USB module of the mobile phone notifies the application of the click event, and the APP monitors that the air conditioner turn on button is triggered.

[0247] 8. The application APP encrypts the air conditioner start command through the secure channel and calls the BLE module;

[0248] 9. The data transmission channel sends the encrypted command to turn on the air conditioner to the vehicle-side execution device via BLE.

[0249] 10. The BLE of the vehicle-side execution device receives the command and parses the data, and then sends it to the actuator for execution. For example, the air-conditioning turn-on command is sent to the air-conditioning controller, and the air-conditioning controller turns on the air-conditioner.

[0250] 11. After the air conditioner completes the command, it will feedback the execution status to BLE. If the air conditioner is turned on normally, it will send a successful execution to BLE;

[0251] 12. The BLE of the vehicle-side actuator encrypts the control feedback and sends it to the mobile phone through the data transmission channel;

[0252] 13. The BLE on the mobile phone receives the control feedback and sends it to the application APP. The APP decrypts and displays the execution result. The execution result is displayed on the car display screen through the screen projection channel.

[0253] The embodiment of the present application also provides an electronic device, the electronic device comprising: a memory, a processor;

[0254] The memory is used to store computer programs / instructions; the processor is used to execute the computer programs / instructions stored in the memory to implement the methods involved in the above embodiments.

[0255] The electronic device also includes a communication interface and a CAN bus, wherein the processor is used to provide computing power and control capabilities, and can be a GPU, CPU, NPU, MCU, FPGA, etc. The storage device includes an internal memory and a non-volatile memory. The non-volatile memory stores a computer program that implements the above method. The internal memory provides an environment for program startup and operation. The communication interface is used to communicate with an external terminal by wire or wireless.

[0256] In this embodiment, the electronic device may be an electronic component in a car, or may be a car. Alternatively, the electronic device may be a mobile terminal.

[0257] The present invention also provides a computer-readable storage medium / computer program product, in which computer control instructions are stored / the computer program product includes computer control instructions, and when the computer control instructions are executed by a processor, they are used to implement the methods involved in the above-mentioned embodiments.

[0258] The above embodiments are only preferred embodiments for fully illustrating the present invention, and the protection scope of the present invention is not limited thereto. Any equivalent substitution or change made by a person skilled in the art based on the present invention is within the protection scope of the present invention.

Claims

1. A vehicle control method, characterized in that: Applied to a mobile terminal, the method comprises: Establish interconnection with the vehicle terminal; Sending the desktop application to the vehicle terminal, wherein the vehicle terminal displays the desktop application on a display screen, and upon detecting a touch command to the display screen, sends the touch command to the mobile terminal; Receiving the touch control command and smart cockpit data sent by the vehicle terminal; The smart cockpit data is analyzed to obtain a control instruction corresponding to the touch instruction, and the vehicle-side execution device is controlled to respond to the control instruction.

2. The method according to claim 1, characterized in that The mobile terminal is provided with a smart cockpit application, and the smart cockpit data is analyzed based on the smart cockpit application.

3. The method according to claim 1, characterized in that The smart cockpit data includes one or more of voice information collected by a microphone, perception information of a vehicle perception system, environmental information in the cockpit, and setting information.

4. The method according to claim 3, characterized in that The analyzing the smart cockpit data, obtaining a control instruction corresponding to the touch instruction, and controlling the vehicle-side execution device to respond to the control instruction includes: Determining a touched target application according to the touch instruction; Determining a target function indicated by the touch instruction according to the touch instruction and the functions configured in the target application; Determining a target control instruction based on the target function and the smart cockpit data; The target control instruction is sent to a target vehicle-side execution device that executes the target function.

5. The method according to claim 4, characterized in that The target application is a vehicle control application, the target function is to turn on the air conditioner, the smart cockpit data includes the environment information in the cockpit and the set temperature of the air conditioner, and the determining the target control instruction based on the target function and the smart cockpit data includes: Determining operating parameters of the air conditioner according to the set temperature of the air conditioner and the environmental information; A target control instruction is generated based on the operating parameters.

6. The method according to claim 4, characterized in that The target function is playing an atmosphere light, the smart cockpit data includes music playing information, and determining a target control instruction based on the target function and the smart cockpit data includes: Acquiring music playing information of the cockpit, and determining working parameters of the ambient light according to the music playing information; A target control instruction is generated based on the ambient light operating parameters.

7. The method according to claim 4, characterized in that The target application is a 3D car model application, the target function is to open a car door, and determining the target function indicated by the touch instruction according to the touch instruction and the function configured in the target application includes: Determining a target function indicated by the touch instruction according to the touch instruction and the functions configured in the target application; Determine the trigger position of the touch command on the 3D vehicle model, and determine the target function indicated by the touch command according to the trigger position, wherein the target function includes rotating the 3D vehicle model, opening / closing the door, opening / closing the trunk, rendering the 3D vehicle model, or one or more of the trigger position mapping of the 3D vehicle model.

8. The method according to claim 3, characterized in that The smart cockpit data includes voice information collected by the microphone of the vehicle end, and the analyzing the smart cockpit data, obtaining the control instruction corresponding to the touch instruction, and controlling the vehicle end execution device to respond to the control instruction includes: Recognize the voice information based on the local voice assistant recognition model to obtain a recognition result, or send the voice information to the cloud, recognize the voice information through the voice recognition model of the cloud, and obtain a recognition result; When the recognition result is a voice control instruction of the target vehicle-side execution device, determining a target control instruction according to the voice control instruction, and sending the target control instruction to the target vehicle-side execution device; When the recognition result is speech-to-text, the recognized target text is sent to the vehicle terminal, and the display screen of the vehicle terminal displays it; Wherein, the touch control instruction includes a voice assistant wake-up instruction.

9. The method according to claim 3, characterized in that: The smart cockpit data includes perception information of a vehicle perception system, and the analyzing the smart cockpit data, obtaining a control instruction corresponding to the touch instruction, and controlling a vehicle-side execution device to respond to the control instruction includes: Processing the perception information based on a preset autonomous driving model, or sending the perception information to the cloud, where the perception information is processed by the autonomous driving model in the cloud to obtain a driving control instruction; Sending the driving control instruction to a corresponding target vehicle-side execution device, wherein the target vehicle-side execution device includes one or more of a brake controller, a direction controller and an acceleration controller; Among them, the touch command includes an automatic driving start command.

10. The method according to claim 1, characterized in that After sending the desktop application to the vehicle terminal, the method further includes: Receive an application selection instruction for the desktop application based on the display screen sent by the vehicle terminal, determine the target application according to the application selection instruction, and send the control interface data of the target application to the vehicle terminal, wherein the vehicle terminal displays the control interface of the target application on the display screen according to the control interface data.

11. The method according to claim 10, characterized in that When the target application is a 3D car model application, sending the control interface data of the target application to the vehicle machine end includes: Generate a 3D vehicle model based on vehicle information and a preset 3D model; The control interface data of the 3D vehicle model is sent to the vehicle computer end, and the control interface data includes the 3D vehicle model data and the touch function data of the 3D vehicle model.

12. The method according to claim 10, characterized in that The sending the control interface data of the target application to the vehicle terminal includes: Obtaining the size of a window to be displayed on the display screen of the vehicle terminal, where the window to be displayed is used to display a control interface of a target application; Adapting the control interface data of the target application according to the size of the window to be displayed; The control interface data is sent to the vehicle computer end.

13. The method according to claim 1, characterized in that The method further comprises: It also establishes a communication connection with the vehicle-side execution device; The control instruction is sent to the vehicle-side execution device through the communication connection.

14. The method according to claim 1, characterized in that The establishing of interconnection with the vehicle terminal includes: Listening to the interconnection request of the vehicle terminal, obtaining verification information for interconnection with the vehicle terminal, wherein the verification information includes one or more of a pairing code input based on the output verification input window, identity authentication information of the mobile terminal, and configuration information of the mobile terminal; The verification information is sent to the vehicle terminal, wherein after the verification by the vehicle terminal is completed, the mobile terminal and the vehicle terminal establish an interconnection channel.

15. A vehicle control method, characterized in that: Applied to a vehicle terminal, the vehicle terminal includes a display screen, and the method includes: After establishing interconnection with the mobile terminal, receiving a desktop application sent by the mobile terminal, and displaying the desktop application on the display screen; When the touch control command and the smart cockpit data are acquired, the touch control command and the smart cockpit data are sent to the mobile terminal.

16. The method according to claim 15, characterized in that The method further comprises: detecting an application selection instruction for the desktop application based on the display screen, and sending the application selection instruction to the mobile terminal; The control interface data of the target application sent by the mobile terminal is received, and the control interface of the target application is displayed on the display screen according to the control interface data.

17. The method according to claim 15, characterized in that Before establishing interconnection with the mobile terminal, it also includes: Broadcasting an interconnection request and outputting pairing information, wherein when the mobile terminal monitors the interconnection request, it feeds back verification information to the vehicle terminal; When the verification information is received, the mobile terminal is verified based on the verification information, and interconnection is established with the mobile terminal according to the verification result, wherein the verification information includes one or more of a pairing code input based on the output verification input window, identity authentication information of the mobile terminal, and configuration information of the mobile terminal.

18. The method according to claim 17, characterized in that The establishing interconnection with the mobile terminal according to the verification result includes: When the verification result is that the pairing code and / or the identity authentication information match, determining the interconnection protocol according to the configuration information of the mobile terminal, the configuration information reflecting the system of the mobile terminal; An interconnection channel is established based on the interconnection protocol to interconnect with the mobile terminal.

19. A vehicle control system, characterized in that: include: A mobile terminal, a vehicle terminal and a vehicle terminal execution device; the vehicle terminal includes a display screen, and the mobile terminal can be interconnected with the vehicle terminal; wherein: The mobile terminal is used to send the desktop application to the vehicle terminal; The vehicle terminal is used to receive the desktop application sent by the mobile terminal and display the desktop application on the display screen; the vehicle terminal is also used to send the touch command to the mobile terminal when detecting a touch command to the display screen; The mobile terminal is also used to receive the touch control command and smart cockpit data sent by the vehicle terminal, analyze the smart cockpit data, obtain the control command corresponding to the touch control command, and control the vehicle terminal execution device to respond to the control command.

20. The system according to claim 19, characterized in that The mobile terminal is provided with a smart cockpit application, and the smart cockpit data is analyzed based on the smart cockpit application.

21. The system according to claim 19, characterized in that The smart cockpit data includes one or more of voice information collected by a microphone, perception information of a vehicle perception system, environmental information in the cockpit, and setting information.

22. The system according to claim 20, characterized in that It also includes a cloud, and the mobile terminal communicates with the cloud. The mobile terminal is also used to analyze the smart cockpit data in the smart cockpit application, call the local model to analyze the smart cockpit data, or send the smart cockpit data to the cloud, and analyze the smart cockpit data through the model on the cloud. After the mobile terminal obtains the analysis result, it obtains the control instruction based on the analysis result, and controls the target vehicle-side execution device based on the control instruction. The model includes one or more of a speech recognition model, an automatic driving model, and a 3D vehicle model control model.

23. The system according to any one of claims 19 to 22, characterized in that The system also includes: a first communication module and a second communication module. The mobile terminal and the vehicle-side are interconnected through the first communication module, and the mobile terminal and the vehicle-side execution device are connected through the second communication module.

24. The system according to any one of claims 19 to 22, characterized in that The vehicle terminal is configured with interconnection protocols corresponding to multiple systems, and the vehicle terminal is also used to select an interconnection protocol adapted to the system of the mobile terminal according to the configuration information of the mobile terminal.

Images