Vehicle control method and device, vehicle and storage medium

Abstract

The invention provides a vehicle control method and device, a vehicle and a storage medium, the method is applied to an in-vehicle infotainment system, and the in-vehicle infotainment system comprises an HUD application program and a bus service; the method comprises the steps that if a target operation on an HUD application program is detected, the HUD application program obtains a target control instruction corresponding to the target operation; the HUD application program sends a target control instruction to the bus service; wherein the bus service is used for realizing communication and data exchange between internal components or services of the in-vehicle infotainment system; and the bus service sends the target control instruction to a target component corresponding to the HUD application program, so that the target component executes the target control instruction. According to the method, the data transmission speed of the HUD application program can be improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of vehicles, and more particularly, to a vehicle control method and device, a vehicle and a storage medium. BACKGROUND

[0002] In the prior art, a head-up display (HUD) of a vehicle can project current speed, navigation and other information onto a display device on a windshield glass to form an image in front of a driver, so that the driver can see relevant information of vehicle driving without turning his head or lowering his head, thereby enriching the driving experience of the driver and improving the safety during driving of the vehicle.

[0003] An object is that a car machine system usually adopts an Android system architecture; in the Android system architecture, data transmission of an application is usually transmitted layer by layer according to a hierarchical architecture; however, for data of a HUD application of a vehicle, a data transmission link is relatively long, which results in slow data transmission speed of the HUD application; therefore, how to improve the data transmission speed of the HUD application is a technical problem to be solved at present. SUMMARY

[0004] The present application provides a vehicle control method and device, a vehicle and a storage medium, which acquire a target control instruction corresponding to a target operation when detecting the target operation on a HUD application; the HUD application sends the target control instruction to a bus service, and the bus service sends the target control instruction to a target component; data of the HUD application is avoided from being transmitted layer by layer; thereby improving the data transmission speed of the HUD application.

[0005] In a first aspect, a vehicle control method is provided, which is applied to a car machine system including a HUD application and a bus service; the method includes:

[0006] If a target operation on the HUD application is detected, the HUD application acquires a target control instruction corresponding to the target operation;

[0007] The HUD application sends the target control instruction to the bus service; wherein the bus service is used to realize communication and data exchange between internal components or services of the car machine system;

[0008] The bus service sends the target control instruction to a target component corresponding to the HUD application, so that the target component executes the target control instruction.

[0009] In the embodiments of this application, if a target operation is detected, the HUD application obtains the target control instruction corresponding to the target operation and sends the target control instruction to the bus service. The bus service then sends the target control instruction to the target component corresponding to the application, so that the target component executes the target control instruction. Since the target control instruction is transmitted via "HUD application—bus service—target component" in this application, compared to the layer-by-layer transmission of "HUD application—bus service—vehicle service layer—middleware layer—target component" in the prior art, the control instruction transmission link in this solution can be transmitted directly from the bus service to the target component without passing through the vehicle service layer, hardware abstraction layer, and middleware layer. This avoids the layer-by-layer transmission of the target control instruction of the HUD application, ensuring that the target control instruction can be transmitted via a shorter data transmission link, thereby improving the transmission speed of the target control instruction and further improving the data transmission speed of the HUD application.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, the vehicle infotainment system includes a first operating system and a second operating system;

[0011] The bus service sends target control commands to the target components corresponding to the HUD application, including:

[0012] The bus service determines the target communication mechanism corresponding to the target component based on the target operating system where the target component resides; wherein the target operating system is either a first operating system or a second operating system.

[0013] The bus service sends target control commands to the target component based on the target communication mechanism.

[0014] In the embodiments of this application, the vehicle system includes a first operating system and a second operating system; the operating systems of the target components are different; the communication mechanisms of the corresponding target components are also different; therefore, the bus service determines the target communication mechanism corresponding to the target component based on the target operating system of the target component; and sends target control commands to the target component based on the target communication mechanism; ensuring that the target control commands can be sent to the target component in the target control system.

[0015] Combining the first aspect and the above implementation methods, in some implementation methods of the first aspect, the HUD application resides in the first operating system; based on the operating system where the target component resides, the target communication mechanism corresponding to the target component is determined, including:

[0016] If the target component is located in the first operating system, the bus service will determine the first communication mechanism as the target communication mechanism;

[0017] If the target component is located in the second operating system, the bus service will determine the second communication mechanism as the target communication mechanism.

[0018] The first communication mechanism is an inter-process communication mechanism within a system, and the second communication mechanism is an inter-process communication mechanism between different systems.

[0019] In the embodiments of the present application, the first communication mechanism is an inter-process communication mechanism within a system, and the second communication mechanism is an inter-process communication mechanism between different systems; the HUD application is located in the first operating system; if the target component is located in the first operating system, it means that the target component and the HUD application are located in the same operating system; the communication between the HUD application and the target component is an intra-system communication of the same operating system; therefore, the first communication mechanism is determined as the target communication mechanism; if the target component is located in the second operating system, it means that the target component and the HUD application are located in different operating systems, and the communication between the HUD application and the target component is an inter-system communication; therefore, the second communication mechanism is determined as the target communication mechanism; it is ensured that the accurate communication mechanism can be selected according to the operating system where the target component is located, so as to realize the transmission of the target control instruction; and the situation that the target component cannot respond to the target control instruction due to the error of the communication mechanism is avoided.

[0020] In an implementation manner, the first operating system is an Android operating system, the second operating system is a real-time operating system, and the HUD application is located in the Android operating system; if the target component is located in the Android operating system, the bus service determines the first communication mechanism as the target communication mechanism; if the target component is located in the real-time operating system, the bus service determines the second communication mechanism as the target communication mechanism.

[0021] With reference to the first aspect and the implementation manners, in some implementation manners of the first aspect, the target component includes a first component; the first component is configured to generate a simulation environment image.

[0022] The target component executes the target control instruction, including:

[0023] The first component obtains environment information of the vehicle and a vehicle model of the vehicle; the environment information includes lane line information, a second vehicle within a preset distance of the vehicle, and position information of the second vehicle;

[0024] The first component generates a simulation environment image based on the environment information and the vehicle model of the vehicle, and displays the simulation environment image in the HUD of the vehicle.

[0025] In the embodiments of the present application, the target component includes a first component for generating a simulation environment image; for example, the first component is a restored world component; when the target control instruction is executed, the first component acquires environment information of the vehicle and a vehicle model of the vehicle; generates a simulation environment image according to the environment information and the vehicle model of the vehicle; and displays the simulation environment image in the HUD of the vehicle; since the simulation environment image is an image generated according to the current environment information of the vehicle and the vehicle model, the simulation environment image can accurately display the current real driving environment of the vehicle; so that the driver does not need to turn his head or bend down to see the current real driving environment of the vehicle, thereby improving the safety of the vehicle during driving.

[0026] With reference to the first aspect and the above implementation manners, in some implementation manners of the first aspect, before the target control instruction is sent to the target component corresponding to the HUD application program, the method further includes:

[0027] The bus service acquires the associated application components of the HUD application program;

[0028] The bus service determines the associated application components as the target components; or, based on the target control instruction, determines the target components in the associated application components.

[0029] In the embodiments of the present application, before the target control instruction is sent to the target component, the target component corresponding to the HUD application program needs to be determined; the bus service acquires the associated application components of the HUD application program; when the target component is determined, one case is that all the associated components are determined as the target components; another case is that the target components are determined in the associated application components according to the target control instruction. Since different application components are used to depict different display elements, when the display elements are displayed in the HUD, if there is mutual influence between the display elements, all the associated components are taken as the target components to ensure the accuracy of the display elements; if there is no mutual influence between the display elements, the target components are determined according to the target control instruction.

[0030] With reference to the first aspect and the above implementation manners, in some implementation manners of the first aspect, the method further includes: acquiring a correspondence between each display element in the HUD and each application component;

[0031] Based on the target control instruction, the target components are determined in the associated application components, including:

[0032] Based on the target control instruction, a target display element in the HUD is determined;

[0033] Based on the target display element and the correspondence, a target component corresponding to the target display element is determined.

[0034] In the embodiments of the present application, the correspondence between each display element and each application component is acquired; and the target display element is determined based on the target control instruction; the target component corresponding to the target display element is determined according to the correspondence; it is ensured that the target component corresponding to the target control instruction can be determined according to the target control instruction; so that the target component can execute the target control instruction.

[0035] With reference to the first aspect and the above implementation manners, in some implementation manners of the first aspect, the method further includes:

[0036] If the upgrade operation on the HUD application program is detected, the bus service acquires an upgrade data packet; the upgrade data packet is used to upgrade the HUD application program and / or the associated application component of the HUD application program;

[0037] The bus service sends the upgrade data packet to the storage space of the HUD application program and / or the associated application component, so as to upgrade the HUD application program and / or the associated application component.

[0038] In the embodiments of the present application, if the upgrade operation on the HUD application program is detected, the bus service acquires an upgrade data packet; and the bus service sends the upgrade data packet to the storage space where the HUD application program and / or the associated application component are located, so as to ensure that the HUD application program and / or the associated application component can be updated and upgraded.

[0039] In a second aspect, a vehicle control device is provided, and the device includes:

[0040] The acquisition module is configured to acquire a target control instruction corresponding to a target operation on the HUD application program if the target operation is detected.

[0041] The first sending module is configured to send the target control instruction to a bus service; the bus service is used to realize communication and data exchange between internal components or services of the vehicle machine system.

[0042] The second sending module is configured to send the target control instruction to a target component corresponding to the HUD application program, so that the target component executes the target control instruction.

[0043] With reference to the second aspect, in some implementation manners of the second aspect, the second sending module is specifically configured to determine a target communication mechanism corresponding to the target component based on a target operating system where the target component is located; the target operating system is the first operating system or the second operating system; and the bus service sends the target control instruction to the target component based on the target communication mechanism.

[0044] In some implementation forms of the second aspect, in combination with the above implementation forms, the second sending module is specifically configured to: if the target component is located in the first operating system, determine the first communication mechanism as the target communication mechanism; and if the target component is located in the second operating system, determine the second communication mechanism as the target communication mechanism; wherein the first communication mechanism is an inter-process communication mechanism within the system, and the second communication mechanism is an inter-process communication mechanism between different systems.

[0045] In some implementation forms of the second aspect, in combination with the above implementation forms, the control device further comprises an executing module configured to: acquire environmental information of the vehicle and a vehicle model of the vehicle; wherein the environmental information comprises lane line information, a second vehicle within a preset distance of the vehicle, and position information of the second vehicle; generate a simulated environmental image based on the environmental information and the vehicle model of the vehicle; and display the simulated environmental image in the HUD of the vehicle.

[0046] In some implementation forms of the second aspect, in combination with the above implementation forms, the control device further comprises a determining module, and the acquiring module is further configured to: acquire an associated application component of the HUD application program; and the determining module is configured to: determine the associated application component as the target component; or determine the target component in the associated application component based on the target control instruction.

[0047] In some implementation forms of the second aspect, in combination with the above implementation forms, the acquiring module is further configured to: acquire a correspondence between each display element in the HUD and each application component; and the determining module is specifically configured to: determine a target display element in the HUD based on the target control instruction; and determine a target component corresponding to the target display element based on the target display element and the correspondence.

[0048] In some implementation forms of the second aspect, in combination with the above implementation forms, the acquiring module is further configured to: if an upgrade operation on the HUD application program is detected, acquire an upgrade data packet; wherein the upgrade data packet is used to upgrade the HUD application program and / or an associated application component of the HUD application program; and the second sending module is further configured to: send the upgrade data packet to a storage space of the HUD application program and / or the application component, so as to upgrade the HUD application program and / or the application component.

[0049] In a third aspect, a vehicle is provided, comprising a memory and a processor, the memory is configured to store executable program code, and the processor is configured to call and run the executable program code from the memory, so that the vehicle executes the method in the first aspect or any possible implementation form of the first aspect.

[0050] In a fourth aspect, a computer program product is provided, which includes computer program codes, when the computer program codes are run on a computer, the computer is caused to execute the method in the first aspect or any possible implementation manner of the first aspect.

[0051] In a fifth aspect, a computer readable storage medium is provided, which stores instructions, when the instructions are run on a vehicle, the vehicle is caused to execute the method in the first aspect or any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0052] Figure 1 is a scene schematic diagram provided by an embodiment of the application;

[0053] Figure 2 is a system architecture diagram of a car machine system provided by an embodiment of the application;

[0054] Figure 3 is another system architecture diagram of a car machine system provided by an embodiment of the application;

[0055] Figure 4 is a schematic flow diagram of a vehicle control method provided by an embodiment of the application;

[0056] Figure 5 is an interaction flow diagram of a vehicle control method provided by an embodiment of the application;

[0057] Figure 6 is a structural schematic diagram of a vehicle control device provided by an embodiment of the application;

[0058] Figure 7 is a structural schematic diagram of a vehicle provided by an embodiment of the application. DETAILED DESCRIPTION

[0059] The technical solutions in the application will be described clearly and exhaustively in combination with the drawings. In the description of the embodiments of the application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B: "and / or" in the text only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the application, "multiple" means two or more than two.

[0060] Hereinafter, the terms "first", "second" are only used for description purposes, and cannot be understood as implying or implying relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first", "second" can explicitly or implicitly include one or more features.

[0061] Figure 1 This is a schematic diagram of a scenario provided in an embodiment of this application.

[0062] For example, such as Figure 1 As shown in (a), the scene includes a vehicle and a HUD display area 110; the HUD is located in a preset area on the vehicle's windshield; when the vehicle is in motion, the HUD can use optical reflection principles and projection technology to project driving information during the driving process onto the windshield or a dedicated transparent display screen; the driving information includes basic driving information, navigation information, entertainment information, and warning information, etc. Figure 1 As shown in (a), when the vehicle is in motion, the HUD displays driving information in display area 110 on the vehicle's windshield.

[0063] For example, such as Figure 1 (b) shows a schematic diagram of the display interface on the HUD screen; the displayed content is the vehicle's current driving information, including vehicle speed, navigation, and other driving information, as well as a simulated environment image; wherein, the simulated environment image is a simulated view of the current driving environment generated based on the current vehicle's environmental information and vehicle model. Furthermore, related application components of the HUD (e.g., a world reconstruction component) can present a 3D map based on the vehicle's position and, combined with the vehicle's sensor data (e.g., radar and cameras), display the real-time positions of surrounding vehicles, pedestrians, and other obstacles, increasing driving safety; and overlay actual street view images, making navigation instructions more intuitive and easier to understand.

[0064] Optionally, the HUD screen can display various elements such as a simulated world, vehicle speed, alarm information, and navigation. Some of these elements are drawn by the HUD service component (vehicle speed, alarms, etc.), while others are drawn by the application on the Android system side (simulated world, navigation, etc.). In other words, the display elements on the HUD screen require the cooperation of multiple component projects to achieve mode display, mode switching, entry and exit animation effects, etc.

[0065] It should be noted that the above is an example of the display interface of HUD, and this application does not limit it.

[0066] In existing technology, a vehicle's head-up display (HUD) can project information such as current speed and navigation onto a display device on the windshield to form an image in front of the driver. The driver can see relevant information about the vehicle's movement without turning or looking down, thus enriching the driver's experience and improving driving safety.

[0067] Currently, the car machine system usually adopts an Android system architecture; in the Android system architecture, data transmission of an application is usually strictly layer-by-layer transmission according to a hierarchical architecture; the following will be described in combination with Figure 2 With Figure 3 the system architecture and data transmission link of the car machine system.

[0068] Figure 2 is a system architecture diagram of a car machine system provided by an embodiment of the present application; as shown in Figure 2 , under the Android system architecture, the data transmission link of the HUD application is "HUD application - bus service - vehicle service layer - middleware layer - target component", and it can be seen that the data transmission link is relatively long; for the data of the HUD of the vehicle, the long data transmission link leads to slow HUD data transmission speed; therefore, how to improve the data transmission speed of the HUD is a technical problem to be solved at present.

[0069] Therefore, the present application provides a vehicle control method and device, a vehicle and a storage medium, through the embodiments of the present application, the HUD application obtains a target control instruction and sends the target control instruction to the bus service, and the bus service sends the target control instruction to the target component; the data of the HUD application is avoided to be transmitted layer by layer; and thus the data transmission speed of the HUD application is improved.

[0070] It should be noted that Figure 2 the functions of the components and layers in the Figure 3 are described in the corresponding description.

[0071] Figure 3 is another system architecture diagram of a car machine system provided by an embodiment of the present application.

[0072] For example, as shown in the system architecture 300 in Figure 3 , the car machine system of the vehicle includes a Quick Unix (QNX) operating system and an Android operating system; the Android operating system includes application components of the HUD application 201, the application store 202 and the application of the restore world 203; and the system message bus service 204, the vehicle service layer 205 and the hardware abstraction layer 206; the QNX operating system includes the driving layer 207, the middleware layer 208 and the application component of the HUD service 209.

[0073] For example, HUD application 201 is an application that responds to user operations on the HUD, and can switch the HUD display mode and set the on / off state; application store 202 is another application in the vehicle system, used to obtain upgrade packages from the cloud and manage and update applications; simulated world 203 is an application component for simulated world, used to generate simulated environment images based on environmental information and vehicle model; system message bus service 204 is used for communication and data exchange between components or services within the vehicle system; vehicle service layer 204 is used to abstract and encapsulate various vehicle data and control commands; hardware abstraction layer 206 is used to provide a unified interface for upper-layer software.

[0074] For example, in the QNX operating system, the driver layer 207 is responsible for managing hardware resources (e.g., sensors, network interfaces, displays, etc.); the middleware layer 208 is used to provide pre-packaged, reusable components; and the HUD service 209 is used to display information such as vehicle speed, alarms, and telephone calls.

[0075] Optionally, the above description of the functions of each component and layer in the Android and QNX operating systems is illustrative and can be understood in conjunction with the functions of each component and layer in the prior art; this application does not make any specific limitations on this.

[0076] For example, with Figure 3 Taking the system architecture as an example, the transmission link of the control command of the HUD application is explained as follows: When the user's operation in the HUD application 201 is detected, the HUD application 201 sends the control command corresponding to the operation to the system message bus service 204; the system message bus service 204 determines the corresponding application component according to the control command; the system message bus service 204 sends the control command to the corresponding application component (HUD service 209 and / or restore world 203).

[0077] For example, the HUD application serves as the control terminal for mode switching and basic HUD settings. When a user switches modes via touch or voice, the HUD application receives the message and, as a unified management service, sends the corresponding mode to related components such as the navigation component, the world view component, and the HUD service component. Upon receiving the mode switching message or the new mode layout message, each related component exits or displays the new mode according to certain rules.

[0078] It should be noted that the HUD application 201 and the system message bus service 204 are bidirectional arrows; the restored world 203 and the system message bus service 204 are bidirectional arrows. Since the vehicle service layer and the hardware abstraction layer are used for transparent message transmission, there is no specific HUD-related business logic; therefore, the related data and instructions of the HUD can not pass through the vehicle service layer and the hardware abstraction layer. By optimizing the communication transmission link, reducing the message transmission level, improving transmission efficiency and reducing latency, the user experience is improved.

[0079] The vehicle control method will be described in detail below in combination with the system architecture in Figure 3 . Figure 4

[0080] Figure 4 is a schematic flowchart of a vehicle control method provided by an embodiment of the present application.

[0081] The method 400 shown in the example can be executed by the vehicle in Figure 4 ; or can be executed by the car machine system in the vehicle; or can be executed by the processor or chip in the vehicle. Figure 1 As shown in

[0082] , the vehicle control method 400 includes S410 to S430, which will be described in detail below. Figure 4

[0083] S410, if a target operation on the HUD application is detected, the HUD application obtains a target control instruction corresponding to the target operation.

[0084] The HUD application is the control end of the HUD mode switching and the HUD basic setting item; the target operation for controlling the display content of the HUD screen is triggered by operating in the HUD application; the triggering target operation includes but is not limited to touch screen (center control screen), voice command, physical key and gesture recognition, etc.

[0085] The example is that when the target operation on the HUD application is detected, the HUD application obtains the target control instruction corresponding to the target operation, which can be understood as detecting user operation through an event listener (such as a button click event); when the user operation is detected, the event processing mechanism is used to analyze the user operation and determine the target control instruction corresponding to the user operation, for example, the event processing function is used to analyze the user operation and determine the corresponding control instruction.

[0086] ​​Optionally, the event processing mechanism determines the control instruction corresponding to the user operation according to a pre-created mapping table when analyzing the user operation; the mapping table is a corresponding relationship between different user operations and preset control instructions.

[0087] S420, the HUD application program sends the target control instruction to the bus service.

[0088] The bus service is used to realize communication and data exchange between internal components or services of the car machine system; for example, the bus service can be a system message bus service, such as Figure 3 As shown: the HUD application program 201 sends the target control instruction to the system message bus service 204.

[0089] Exemplarily, the bus service is a message passing-based communication mechanism, and different components exchange information by sending and receiving messages through the bus service. This mechanism helps to realize the decoupling of each subsystem, improve the maintainability and scalability of the system. Further, through the bus service, different subsystems can realize data sharing, such as engine speed, vehicle speed, etc.; when an event occurs, the event can be notified to other components through the bus service.

[0090] In a possible implementation, the HUD application program converts the target control instruction into a message format that can be understood or processed by the system before sending the target control instruction to the bus service; and sends the target control instruction to the bus service in the message format.

[0091] It should be understood that when the target control instruction is converted into the message format, a unified message format needs to be defined, and the message format contains related information of the control instruction; the event processing mechanism creates and encapsulates the message according to the parsed control instruction.

[0092] S430, the bus service sends the target control instruction to the target component corresponding to the HUD application program, so that the target component executes the target control instruction.

[0093] Exemplarily, the bus service needs to determine the target component corresponding to the HUD application program before sending the target control instruction to the target component; the way of determining the target component is described in detail below.

[0094] In an implementation, the bus service acquires the associated application component of the HUD application program;

[0095] The bus service determines the associated application component as the target component; or, based on the target control instruction, determines the target component in the associated application component.

[0096] The associated components of the HUD application refer to application components related to each display element in the HUD screen, including but not limited to: a HUD service component, a navigation component, and a world restoration component; the HUD service component is used to depict vehicle speed and warning information in the vehicle HUD screen; the navigation component is used to depict navigation information, and the world restoration component is used to generate a simulated environment image;

[0097] For example, in determining the target component, one case is to determine all the associated components as the target component; another case is to determine the target component from the target control instruction among the associated application components. Different application components are used to depict different display elements. When displaying each display element in the HUD, if there is mutual influence between the display elements, all the associated components need to be taken as the target component to ensure the accuracy of the display elements; if there is no mutual influence between the display elements, the target component is determined according to the target control instruction. The following describes the above two different cases.

[0098] For example, when there is mutual influence between the display elements of the HUD, such as when a simulated environment image is displayed in the HUD, the vehicle speed is displayed on the left side of the HUD to avoid the vehicle speed from blocking the simulated environment image; when the simulated environment image is not displayed in the HUD, the vehicle speed is displayed in the middle of the HUD; in this case, all the associated components of the HUD application need to be taken as the target component; and the HUD service component can adjust the display position of the vehicle speed according to the display instruction of the simulated environment image. When there is no mutual influence between the display elements of the HUD, only the component corresponding to the target control instruction needs to be determined as the target component.

[0099] It should be noted that the above is an example of the display component association relationship; the present application is not limited thereto.

[0100] In an implementation manner, a corresponding relationship between each display element in the HUD and each application component is obtained; a target display element in the HUD is determined based on a target control instruction; and a target component corresponding to the target display element is determined based on the target display element and the corresponding relationship.

[0101] For example, the corresponding relationship between each display element in the HUD and each application component is obtained; if the application component is used to depict the display element, the application component is the application component corresponding to the display element.

[0102] For example, the HUD service component is used to depict vehicle speed and warning information, so the application component corresponding to the vehicle speed and the warning information is the HUD service component; the navigation component is used to depict navigation information, so the application component corresponding to the navigation information is the HUD application component; and the world restoration component is used to generate a simulated environment image, so the application component corresponding to the simulated environment image is the world restoration component.

[0103] In the embodiments of the present application, the target display element is determined based on the target control instruction; the target component corresponding to the target display element is determined according to the correspondence relationship; it is ensured that the target component corresponding to the target control instruction can be determined according to the target control instruction; and the target component can execute the target control instruction.

[0104] In an implementation manner, the car machine system includes a first operating system and a second operating system.

[0105] The bus service sends the target control instruction to the target component corresponding to the HUD application, including:

[0106] The bus service determines the target communication mechanism corresponding to the target component based on the target operating system in which the target component is located; the target operating system is the first operating system or the second operating system; and the bus service sends the target control instruction to the target component based on the target communication mechanism.

[0107] For example, the car machine system of the vehicle is composed of the first operating system and the second operating system; the target communication mechanism corresponding to the target component is different when the target component is located in different target operating systems; therefore, the bus service determines the target communication mechanism corresponding to the target component according to the target operating system in which the target component is located; and sends the target control instruction to the target component based on the target communication mechanism; it is ensured that the target control instruction can be sent to the target component in the target control system.

[0108] In an implementation manner, the HUD application is located in the first operating system; the target communication mechanism corresponding to the target component is determined based on the operating system in which the target component is located, including:

[0109] If the target component is located in the first operating system, the bus service determines the first communication mechanism as the target communication mechanism; if the target component is located in the second operating system, the bus service determines the second communication mechanism as the target communication mechanism; the first communication mechanism is an inter-process communication mechanism within the system, and the second communication mechanism is an inter-process communication mechanism between different systems.

[0110] For example, the first communication mechanism is a Binder communication mechanism, and the second communication mechanism is an FDBus communication mechanism. Binder is a mechanism for inter-process communication in the Android operating system. It provides a method for cross-process calling of remote objects and supports cross-process sharing of services. The Binder framework includes the communication mechanism of the client and the server, and a kernel module called Binder driver to realize the inter-process communication. FDBus is a cross-system communication protocol that can realize inter-process communication between systems.

[0111] Optionally, the first operating system is an Android operating system, the second operating system is a real-time operating system, and the HUD application is located in the Android operating system. If the target component is located in the Android operating system, the bus service determines the first communication mechanism as the target communication mechanism. If the target component is located in the real-time operating system, the bus service determines the second communication mechanism as the target communication mechanism.

[0112] For example, the first communication mechanism can be a Binder communication mechanism, and the second communication mechanism can be an FDBus communication mechanism. Binder is a mechanism for inter-process communication in the Android operating system. It provides a method for cross-process calling of remote objects and supports cross-process sharing of services. The Binder framework includes the communication mechanism of the client and the server, and a kernel module called Binder driver to realize the inter-process communication. FDBus is a cross-system communication protocol that can realize inter-process communication between systems.

[0113] It should be noted that the Android operating system and the QNX operating system of the car machine system are two different embedded operating systems. The Android operating system is applied in the field of vehicle technology and is usually used as an information entertainment system or a vehicle operating system. It allows users to access applications on mobile phones through the touch screen or voice control of the car. Based on the Android operating system as the main operating system of the vehicle, it provides integrated information entertainment, navigation, telephone and other functions. Compared with the Android operating system, the QNX operating system has very high real-time performance and can complete tasks within a certain time. The system is composed of multiple independent processes, each of which runs in its own address space and has minimal impact on each other. Therefore, the QNX operating system is more suitable for systems that require high reliability and real-time performance, such as vehicle control, autonomous driving, and display of some elements in the HUD. For example, some elements can be elements that need to be displayed in real time, such as vehicle speed, alarm, etc.

[0114] In an implementation, the target component comprises a first component; the first component is configured to generate a simulation environment image;

[0115] The target component executes the target control instruction, comprising:

[0116] The first component acquires environment information of the vehicle and a vehicle model of the vehicle; wherein the environment information comprises lane line information, a second vehicle within a preset distance of the vehicle, and position information of the second vehicle; the first component generates a simulation environment image based on the environment information and the vehicle model of the vehicle; and displays the simulation environment image in a HUD of the vehicle.

[0117] The first component can be a world restoration component (e.g. 203 in Figure 3 ); and the simulation environment image displayed in the HUD of the vehicle can be as shown in (b) of Figure 1 ; and

[0118] For example, when executing the target control instruction, the first component acquires environment information of the vehicle and a vehicle model of the vehicle; generates a simulation environment image based on the environment information and the vehicle model of the vehicle; and displays the simulation environment image in a HUD of the vehicle; since the simulation environment image is generated based on the current environment information and the vehicle model of the vehicle, the simulation environment image can accurately display the current real driving environment of the vehicle; so that the driver can see the current real driving environment of the vehicle without turning his head or looking down, thereby improving the safety of the vehicle during driving.

[0119] In an implementation, if an upgrade operation on the HUD application is detected, the bus service acquires an upgrade data packet; wherein the upgrade data packet is configured to upgrade the HUD application and / or an associated application component of the HUD application;

[0120] The bus service sends the upgrade data packet to a storage space of the HUD application and / or the application component, so as to upgrade the HUD application and / or the application component.

[0121] For example, the upgrade operation on the HUD application can be an upgrade operation triggered in an application store, or an upgrade operation triggered in the HUD application; the bus service can acquire the upgrade data packet from the cloud (as shown in Figure 3 ), or from a local storage space of the vehicle.

[0122] It should be noted that the HUD application in the Android operating system and the HUD service component in the QNX operating system adopt an end-to-end direct communication mode. Compared with the previous mode of application-bus service-vehicle service layer-hardware abstraction layer-service component on the QNX system side, the intermediate link is reduced, and when a new function upgrade is encountered, the application can be upgraded alone without modifying the system layer code.

[0123] In the embodiment of the present application, if an upgrade operation on the HUD application is detected, the bus service obtains an upgrade data packet; and sends the upgrade data packet to the storage space where the HUD application and / or the associated application component are located, to ensure that the update and upgrade of the HUD application and / or the associated application component can be realized.

[0124] In the above embodiment, if a target operation is detected, the HUD application obtains a target control instruction corresponding to the target operation; and sends the target control instruction to the bus service; the bus service sends the target control instruction to the target component corresponding to the application, so that the target component executes the target control instruction; since in the present application, the transmission mode of the target control instruction is "HUD application-bus service-target component"; compared with the layer-by-layer transmission of the prior art "HUD application-bus service-vehicle service layer-middleware layer-target component", in the present solution, the transmission link of the control instruction can be transmitted by the bus service to the target component, without passing through the vehicle service layer, the hardware abstraction layer and the middleware layer; avoiding layer-by-layer transmission of the target control instruction of the HUD application; ensuring that the present solution can transmit the target control instruction through a shorter data transmission link; thereby improving the transmission speed of the target control instruction; further improving the data transmission speed of the HUD.

[0125] Figure 5 is an interactive flowchart of a vehicle control method provided by the present application.

[0126] Figure 5 The method 500 shown can be executed by a vehicle in Figure 1 ; or can be executed by a car machine system in the vehicle; or can be executed by a processor or chip in the vehicle.

[0127] As shown in Figure 5 , the vehicle control method 500 includes S501 to S508, which are described in detail below.

[0128] S501, detecting a target operation, obtaining a target control instruction corresponding to the target operation.

[0129] For example, when the HUD application detects a target operation, the target control instruction corresponding to the target operation is acquired; the HUD application can detect user operations through an event listener (such as a button click event); when a user operation is detected, the user operation is parsed through an event processing mechanism, and the target control instruction corresponding to the user operation is determined, for example, the user operation is parsed through an event processing function, and the corresponding control instruction is determined.

[0130] Optionally, the implementation of S501 can refer to the implementation of S410 in Figure 4 , which will not be repeated here.

[0131] S502, sending the target control instruction.

[0132] For example, the HUD application sends the target control instruction to the bus service, and the bus service is a message passing-based communication mechanism. Different components and applications exchange information by sending and receiving messages through the bus service.

[0133] Optionally, the implementation of S502 can refer to the implementation of S420 in Figure 4 , which will not be repeated here.

[0134] S503, determining the target component.

[0135] For example, the bus service determines the target component corresponding to the HUD application; optionally, the bus service determines the associated application component corresponding to the application; it is determined whether there is a mutual influence relationship between each associated application component of the HUD; if there is a mutual influence relationship, all associated application components are determined as target components; if there is no mutual influence relationship, the target component in the associated application component is determined based on the target control instruction.

[0136] For example, determining the target component in the associated application component includes: acquiring the corresponding relationship between each display element in the HUD and each application component; determining the target display element corresponding to the target control instruction; based on the target display element and the corresponding relationship, the component corresponding to the target display element is determined as the target component.

[0137] S504, determining the target communication mechanism based on the target operating system where the target component is located.

[0138] For example, the bus service determines the target communication mechanism based on the target operating system where the target component is located; wherein the target communication mechanism is used to represent the communication mechanism between the HUD application and the target component, and the target communication mechanism includes a first communication mechanism and a second communication mechanism.

[0139] Optionally, it is determined whether the target component and the HUD application are located in the same operating system; if the target component and the HUD application are located in the same operating system, the HUD application and the target component communicate through an inter-process communication mechanism within the system; if the target component and the HUD application are located in different operating systems, the HUD application and the target component communicate through an inter-process communication mechanism between different systems.

[0140] S505, sending the target control instruction to the target component based on the target communication mechanism.

[0141] Optionally, the bus service sends the target control instruction to the target component based on the target communication mechanism.

[0142] S506, executing the target control instruction and generating a target display element.

[0143] Optionally, the target component responds to the target control instruction and executes the target control instruction to generate the target display element.

[0144] S507, sending the target display element.

[0145] Optionally, the target component sends the target display element to the HUD screen.

[0146] S508, displaying the target display element in a preset area.

[0147] Optionally, the HUD screen displays the target display element in the preset area; the preset area is a display position of each target display element in the HUD screen.

[0148] Optionally, the implementation of S505 to S508 can refer to the related description of S430 in Figure 4 , which will not be repeated here.

[0149] In the embodiments of the present application, the bus service sends the target control instruction to the target component corresponding to the application, so that the target component executes the target control instruction; without passing through the vehicle service layer, the hardware abstraction layer and the middleware layer; avoiding transmitting the target control instruction of the HUD application layer by layer; ensuring that the transmission of the target control instruction can be performed through a shorter data transmission link; and determining the target communication mechanism according to the operating system where the target component is located, ensuring that the correct communication mechanism is selected for the transmission of the target control instruction; avoiding the situation that the target component cannot respond to the target control instruction due to the error of the communication mechanism.

[0150] Optionally, the HUD application can be a Simulated Reality (SR) HUD application; that is, an SR-HUD application that uses data collected by various sensors in the vehicle to simulate and recreate the environment in which the vehicle is located and the state of the vehicle in that environment in real time, and displays the simulated virtual image through the HUD.

[0151] For example, SR environmental information requires location and orientation information of lane lines, vehicle models, and surrounding vehicles. This information is primarily collected from the intelligent driving domain controller. The intelligent driving domain controller acquires surrounding environmental information through devices such as cameras and radar, and abstracts surrounding scenery and orientation information based on AI algorithms. Then, the intelligent driving domain controller transmits the information to the vehicle's infotainment system via a communication protocol. After receiving the information, the world reconstruction component in the Android operating system of the vehicle's infotainment system parses it according to the agreed-upon protocol format, and then uses this information to reconstruct and outline the surrounding world through design elements such as vehicle models and lane lines. Finally, it is displayed on the central control screen, instrument panel, or HUD screen on the Android operating system side.

[0152] The above text combined Figures 1 to 5 The vehicle control method provided in the embodiments of this application has been described in detail; the following will be combined with Figure 6 and Figure 7 The apparatus embodiments of this application are described in detail below. It should be understood that the apparatus in the embodiments of this application can perform the various methods described in the foregoing embodiments of this application, that is, the specific working processes of the various products described below can be referred to the corresponding processes in the foregoing method embodiments.

[0153] Figure 6 This is a schematic diagram of the structure of a vehicle control device provided in an embodiment of this application.

[0154] For example, such as Figure 6 As shown, the vehicle control device 600 includes:

[0155] The acquisition module 610 is used to acquire the target control command corresponding to the target operation if a target operation on the HUD application is detected.

[0156] The first sending module 620 is used to send target control commands to the bus service; wherein, the bus service is used to realize communication and data exchange between components or services within the vehicle system;

[0157] The second sending module 630 is used to send target control instructions to the target component corresponding to the HUD application, so that the target component executes the target control instructions.

[0158] Optionally, as an embodiment, the second sending module 630 is specifically configured to: determine the target communication mechanism corresponding to the target component based on a target operating system in which the target component is located; the target operating system is the first operating system or the second operating system; and the bus service sends the target control instruction to the target component based on the target communication mechanism.

[0159] Optionally, as an embodiment, the second sending module 630 is specifically configured to: if the target component is located in the first operating system, determine the first communication mechanism as the target communication mechanism; and if the target component is located in the second operating system, determine the second communication mechanism as the target communication mechanism.

[0160] The first communication mechanism is an inter-process communication mechanism within a system, and the second communication mechanism is an inter-process communication mechanism between different systems.

[0161] Optionally, as an embodiment, the control device further comprises an execution module, and the execution module is configured to:

[0162] Obtain environment information of the vehicle and a vehicle model of the vehicle; the environment information comprises lane line information, a second vehicle within a preset distance of the vehicle, and position information of the second vehicle; generate a simulated environment image based on the environment information and the vehicle model of the vehicle; and display the simulated environment image in a HUD of the vehicle.

[0163] Optionally, as an embodiment, the control device further comprises a determination module, and the obtaining module 610 is further configured to: obtain an associated application component of the HUD application program;

[0164] The determination module is configured to: determine the associated application component as the target component; or determine the target component in the associated application component based on the target control instruction.

[0165] Optionally, as an embodiment, the obtaining module 610 is further configured to: obtain a correspondence between each display element in the HUD and each application component;

[0166] The determination module is specifically configured to: determine a target display element in the HUD based on the target control instruction; and determine a target component corresponding to the target display element based on the target display element and the correspondence.

[0167] Optionally, as an embodiment, the obtaining module 610 is further configured to: if an upgrade operation on the HUD application program is detected, obtain an upgrade data packet; the upgrade data packet is used to upgrade the HUD application program and / or the associated application component of the HUD application program;

[0168] The second sending module is further configured to: send the upgrade data packet to a storage space of the HUD application program and / or the application component, so as to upgrade the HUD application program and / or the application component.

[0169] It should be noted that the vehicle control device described above is embodied in the form of functional units. The term "module" herein can be implemented in the form of software and / or hardware, and is not specifically limited.

[0170] For example, the "module" can be a software program, hardware circuit or a combination of both, which implements the above functions. The hardware circuit can include an application specific integrated circuit (ASIC), electronic circuit, processor (such as a shared processor, dedicated processor or group processor, etc.) and memory for executing one or more software or firmware programs, integrated logic circuit and / or other suitable components that support the described functions.

[0171] Therefore, the units of each example described in the embodiments of the present application can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0172] Figure 7 is a structural schematic diagram of a vehicle provided by an embodiment of the present application.

[0173] For example, the vehicle 700 includes a processor 710, a memory 720 and executable program code 730.

[0174] For example, the vehicle 700 includes one or more processors 710, which can support the vehicle 700 to implement the vehicle control method in the method embodiment. The processor 710 can be a general-purpose processor or a special-purpose processor. For example, the processor 710 can be a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, such as a discrete gate, transistor logic device or discrete hardware component.

[0175] For example, the processor 710 can be used to control the vehicle 700, execute software programs and process data of the software programs. The vehicle 700 can also include a communication unit to realize input (reception) and output (transmission) of signals.

[0176] For example, the vehicle 700 can include one or more memories 720 having executable program code 730 stored thereon, which can be executed by the processor 710 to generate instructions for the processor 710 to perform the vehicle control method described in the above method embodiments according to the instructions.

[0177] Optionally, the memory 720 can also store data. Optionally, the processor 710 can also read the data stored in the memory 720, which can be stored in the same storage address as the executable program code 730, or can be stored in a different storage address from the executable program code 730.

[0178] For example, the processor 710 and the memory 720 can be separately arranged, or can be integrated together, for example, integrated on a system on chip (SOC) of the terminal device.

[0179] For example, the memory 720 can be used to store the related programs of the vehicle control method provided in the embodiments of the present application, and the processor 720 can be used to call the executable program code 730 stored in the memory 720 when controlling the vehicle, to execute the vehicle control method of the embodiments of the present application; for example, if a target operation on the HUD application is detected, the HUD application obtains a target control instruction corresponding to the target operation; the HUD application sends the target control instruction to a bus service; the bus service is used to realize the communication and data exchange between internal components or services of the car machine system; the bus service sends the target control instruction to a target component corresponding to the HUD application, so that the target component executes the target control instruction.

[0180] The present application also provides a computer readable storage medium having a computer program stored thereon, which is executed by a processor to implement the steps of the vehicle control method of any of the preceding embodiments.

[0181] The computer readable storage medium can include, but is not limited to, any type of disk including floppy disks, optical disks, Digital Video Discs (DVDs), Compact Disc Read-Only Memories (CD-ROMs), micro drives, and magneto-optical disks, Read-Only Memories (ROMs), Random Access Memories (RAMs), Erasable Programmable Read-Only Memories (EPROMs), Electrically Erasable Programmable Read-Only Memories (EEPROMs), Dynamic Random Access Memories (DRAMs), Video Random Access Memories (VRAMs), flash memory devices, magnetic or optical cards, nano-systems (including molecular memory ICs), or any type of media or device suitable for storing instructions and / or data.

[0182] The application further provides a computer program product, which, when running on a computer, causes the computer to perform the above related steps to implement the vehicle control method in the above embodiments.

[0183] In addition, the vehicle provided by the embodiments of the application can be a chip, a component or a module, and the vehicle can include a connected processor and a memory; the memory is used to store instructions, and the processor can invoke and execute the instructions when the vehicle is running, so that the chip executes the vehicle control method in the above embodiments.

[0184] The vehicle, the computer readable storage medium, the computer program product or the chip provided by the application are all used to execute the corresponding vehicle control method provided above, and thus the beneficial effects that can be achieved by the vehicle, the computer readable storage medium, the computer program product or the chip can refer to the beneficial effects in the corresponding vehicle control method provided above, which will not be described herein again.

[0185] Through the description of the above embodiments, those skilled in the art can understand that, for the convenience and brevity of description, only the division of the above functional modules is taken as an example for illustration, and in actual application, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above.

[0186] In the embodiments of the present disclosure, it should be understood that the disclosed apparatus and method can be implemented in other ways. For example, the apparatus embodiments described above are merely schematic, and the division of the modules or units is merely a logical function division. In actual implementation, another division manner can be adopted, for example, a plurality of units or components can be combined or integrated into another apparatus, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, apparatuses or units, and can be electrical, mechanical or in other forms.

[0187] The above merely describes specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical scope disclosed by the present disclosure, which should be covered by the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

1. A vehicle control method, characterized in that, The method is applied to an in-vehicle infotainment system, which includes a HUD application and bus services; the method includes: If a target operation on the HUD application is detected, the HUD application obtains the target control command corresponding to the target operation; The HUD application sends the target control command to the bus service; wherein, the bus service is used to realize communication and data exchange between components or services within the vehicle system; The bus service sends the target control command to the target component corresponding to the HUD application, so that the target component executes the target control command.

2. The method according to claim 1, characterized in that, The vehicle infotainment system includes a first operating system and a second operating system; The bus service sends the target control command to the target component corresponding to the HUD application, including: The bus service determines the target communication mechanism corresponding to the target component based on the target operating system where the target component resides; wherein, the target operating system is either the first operating system or the second operating system; The bus service sends the target control command to the target component based on the target communication mechanism.

3. The method according to claim 2, characterized in that, The HUD application resides in the first operating system; determining the target communication mechanism corresponding to the target component based on the operating system where the target component resides includes: If the target component is located in the first operating system, the bus service will determine the first communication mechanism as the target communication mechanism; If the target component is located in the second operating system, the bus service will determine the second communication mechanism as the target communication mechanism; The first communication mechanism is an intra-system inter-process communication mechanism, and the second communication mechanism is an inter-process communication mechanism between different systems.

4. The method according to claim 1, characterized in that, The target component includes a first component; the first component is used to generate a simulated environment image; The target component executes the target control command, including: The first component acquires the environmental information of the vehicle and the vehicle model; wherein, the environmental information includes lane line information, the position information of a second vehicle within a preset distance of the vehicle, and the position information of the second vehicle. The first component generates a simulated environment image based on the environmental information and the vehicle model; and displays the simulated environment image in the vehicle's HUD.

5. The method according to claim 1, characterized in that, Before sending the target control command to the target component corresponding to the HUD application, the method further includes: The bus service obtains the associated application components of the HUD application; The bus service identifies the associated application component as the target component; or, based on the target control instruction, identifies the target component among the associated application components.

6. The method according to claim 5, characterized in that, Also includes: Obtain the correspondence between each display element in the HUD and each application component; The step of determining the target component in the associated application components based on the target control command includes: The target display element in the HUD is determined based on the target control command; Based on the target display element and the correspondence, the target component corresponding to the target display element is determined.

7. The method according to any one of claims 1 to 6, characterized in that, Also includes: If an upgrade operation for the HUD application is detected, the bus service obtains an upgrade data packet; wherein the upgrade data packet is used to upgrade the HUD application and / or the associated application components of the HUD application; The bus service sends the upgrade data packet to the storage space of the HUD application and / or the application component to upgrade the HUD application and / or the application component.

8. A vehicle control device, characterized in that, The device includes a HUD application and bus services; the device includes: The acquisition module is configured to, if a target operation on the HUD application is detected, have the HUD application acquire the target control instruction corresponding to the target operation; The first sending module is used for the HUD application to send the target control command to the bus service; wherein, the bus service is used to realize communication and data exchange between components or services within the vehicle system; The second sending module is used for the bus service to send the target control command to the target component corresponding to the HUD application, so that the target component executes the target control command.

9. A vehicle, characterized in that, The vehicles include: Memory, used to store executable program code; A processor for calling and running the executable program code from the memory, causing the vehicle to perform the method as described in any one of claims 1 to 7.

10. A computer storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a vehicle, cause the vehicle to perform the method as described in any one of claims 1 to 7.

Images