System, method and storage medium for realizing man-machine interaction interface based on vehicle machine

Abstract

The application relates to a system and a method for realizing a man-machine interaction interface based on a vehicle machine and a storage medium, and belongs to the technical field of automobile intelligent cockpits. The system comprises a cockpit control component, a first display component and a second display component. The cockpit control component is connected with the first display component and the second display component respectively. The cockpit control component is used for generating a vehicle machine business software window and calculating and generating an instrument business software window according to data transmitted by a vehicle-mounted data acquisition component. The first display component and the second display component are respectively used for displaying the vehicle machine business software window and the instrument business software window. The vehicle machine business software window and the instrument business software window are generated by the cockpit control component, and the calculation business of the original instrument end is also completed by the cockpit control component, so that an instrument control component does not need to be additionally arranged, the weight and the cost of the whole vehicle are reduced, and user individualization functions, upgrade iteration and function expansion can be better realized.

Description

Technical Field

[0001] This invention relates to the field of automotive intelligent cockpit technology, specifically to a system for realizing a human-machine interface based on an in-vehicle infotainment system, a method for realizing a human-machine interface based on an in-vehicle infotainment system, a vehicle, and a computer-readable storage medium. Background Technology

[0002] Traditional instrument cluster software, due to its functional safety attributes and the inability of the instrument cluster itself to connect to the internet, cannot achieve rapid iteration of the instrument cluster's human-machine interface. Adding network functionality to the instrument cluster system would significantly increase costs. As instrument display and animation effects are constantly updated, the current method of iterating instrument cluster software involves downloading the upgrade package through the in-vehicle entertainment system or other network-enabled controllers, then transmitting it to the instrument cluster via a physical connection for a full upgrade. This software package is hundreds of megabytes in size, and this technology has the following problems:

[0003] 1. It is time-consuming. It requires downloading from the Internet first, then transmitting it to the instrument, and then the instrument performs a full package upgrade. The process is cumbersome. Due to the large data package, each step takes a long time, and the whole process takes more than 10 minutes.

[0004] 2. It consumes a lot of data; upgrading the meter once requires hundreds of megabytes of data.

[0005] 3. Slow iteration: Once the instrument cluster software is mass-produced, to ensure stability and cost considerations, car manufacturers or suppliers generally only push out upgrade packages when instrument cluster issues are discovered. Furthermore, the human-machine interface of the instrument cluster can only be controlled via steering wheel buttons, making operation complex.

[0006] For example, invention patent CN109240788A discloses a method for customizable human-computer interaction in automotive instrument panels. This method allows for customization of the main style, displayed information, interface layout, background color, indicator format, display font, prompt sound, skin tone elements, boot animation, and greeting prompts. The basic process involves updating various user-required resources to the host computer via USB, Bluetooth, and WIFI, setting them based on the car's touchscreen, and then upgrading the instrument panel. Like traditional solutions, this process requires upgrading the instrument panel to achieve customizable human-computer interaction for certain parts. It cannot update the instrument panel's human-computer interface without upgrading the panel itself, nor can it achieve rapid iteration of the human-computer interaction interface. Upgrading the instrument panel after the car's infotainment system obtains the resources allows for simple replacement of instrument panel images, sound effects, fonts, etc., but it cannot achieve the rapid updates of currently popular instrument panel human-computer interaction features such as 3D animations and 3D particle effects.

[0007] Furthermore, the current instrument cluster and vehicle infotainment system are two separate controllers, each using its own operating system. Summary of the Invention

[0008] One of the objectives of this invention is to provide a system for realizing a human-machine interaction interface based on a vehicle-mounted system. This system generates the vehicle-mounted system business software window and the instrument business software window only through the cockpit control component, reducing the instrument control component, reducing the overall vehicle weight and cost. When updating the instrument software, it is no longer necessary to transmit the data to the instrument through a physical connection via the vehicle control component, saving time and making the instrument software update more convenient and faster.

[0009] To achieve the above objectives, the technical solution adopted by the present invention is as follows:

[0010] A system for realizing a human-machine interaction interface based on a vehicle-mounted system includes a cockpit control component, a first display component, and a second display component, wherein the cockpit control component is connected to the first display component and the second display component respectively;

[0011] The cockpit control component is used to generate the vehicle infotainment software window and calculate and generate the instrument cluster software window based on the data transmitted by the vehicle data acquisition component.

[0012] The first display component and the second display component are used to display the vehicle infotainment software window and the instrument cluster software window, respectively.

[0013] Based on the aforementioned technical methods, the cockpit control component generates both the vehicle infotainment software window and the instrument cluster software window. Furthermore, the original instrument cluster calculations are also handled by the cockpit control component, eliminating the need for a separate instrument cluster control component. This reduces overall vehicle weight and cost, and decouples the instrument cluster functions from its underlying system and hardware. This makes the instrument cluster software a lightweight application, better enabling user-customized functions, upgrades, and feature expansions. The vehicle infotainment software window and the instrument cluster software window generated by the cockpit control component are displayed using different display components for easy viewing and operation by the user.

[0014] In this embodiment of the application, the step of calculating and generating the instrument business software window based on the data transmitted by the vehicle data acquisition component includes:

[0015] The data displayed on the instrument is calculated based on the data transmitted by the acquisition components;

[0016] Generate the instrument business software window based on the instrument display data and interface layout template.

[0017] Based on the above technical means, the data displayed by the instrument needs to be calculated based on the data collected by the acquisition component. This part belongs to the instrument business. In the traditional solution, the calculation is performed by the instrument control component. In the above technical means, it is realized by the cockpit control component, which eliminates the need to set up an instrument control component on the instrument side, thus saving costs.

[0018] In this embodiment of the application, the cockpit control component includes a processing unit, a random access memory unit, and a drive unit, wherein the processing unit is connected to the random access memory unit and the drive unit;

[0019] The driving unit includes two units, which are respectively connected to the first display component and the second display component, and are used to drive the first display component and the second display component to display content.

[0020] According to the above technical solution, different display components are connected to different driving units to display different content.

[0021] In this embodiment of the application, the processing unit processes the data into an instrument business software window and a vehicle business software window according to the interface display layout template, and the instrument business software window and the vehicle business software window are respectively displayed in a display component.

[0022] According to the above technical solution, the processing unit realizes data processing and generates the instrument business software window and the vehicle business software window.

[0023] In this embodiment, the random access storage unit includes a first frame buffer, a second frame buffer, a first storage area, and a second storage area. The first frame buffer and the second frame buffer are used to cache one of the vehicle infotainment system business software window data stream and the instrument cluster business software window data stream, respectively. The first storage area and the second storage area are used to temporarily store one of the vehicle infotainment system business software window data stream and the instrument cluster business software window data stream, respectively. The first frame buffer corresponds to the first display component and the first storage area, and the second frame buffer corresponds to the second display component and the second storage area.

[0024] According to the above technical solution, the random access storage unit is divided into different areas to store the data streams of different business software windows, so as to avoid data display errors caused by mixed storage of data streams.

[0025] In this embodiment of the application, the cockpit control component is physically connected to the first display component and the second display component.

[0026] A method for implementing a human-machine interface based on an in-vehicle infotainment system, implemented based on the aforementioned system, the method comprising:

[0027] The cockpit control components generate the vehicle infotainment interface, and the instrument cluster interface is calculated and generated based on the data transmitted by the vehicle data acquisition components.

[0028] The first display component and the second display component respectively display one of the vehicle infotainment system interface and the instrument cluster interface.

[0029] According to the above technical solution, the cockpit control component is used to generate the vehicle infotainment software window and the instrument cluster software window. The original instrument cluster calculations are also completed through the cockpit control component, eliminating the need to set up an instrument cluster control component, thus reducing the overall vehicle weight and cost. The vehicle infotainment software window and the instrument cluster software window generated by the cockpit control component are displayed through different display components to facilitate user viewing and operation.

[0030] In this embodiment of the application, the method further includes:

[0031] By changing the mapping relationship between the first frame buffer, the second frame buffer and the data stream of the vehicle infotainment software window and the data stream of the instrument cluster software window through preset operations, the exchange of display content between the first display component and the second display component can be realized.

[0032] The above technical solution enables the exchange of content displayed by different display components, thereby improving the user experience.

[0033] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for implementing a human-machine interface based on a vehicle-mounted system.

[0034] A vehicle equipped with the system that enables human-machine interaction based on the vehicle-mounted infotainment system.

[0035] The beneficial effects of this invention are:

[0036] (1) This invention improves the traditional separate instrument control component for instrument functions by having the cockpit control component simultaneously control both cockpit entertainment and instrument functions. The instrument is transformed from a de facto independent controller into instrument function application software within the cockpit ecosystem, running on the cockpit control component. This achieves the integration of the in-vehicle entertainment system and the instrument system, reducing overall vehicle weight and cost.

[0037] (2) The instrument business software window is generated by the cockpit control component and displayed by the display component. The instrument business software upgrade process no longer requires sending the upgrade package from the vehicle terminal to the instrument terminal. This decouples the instrument function from the underlying system and hardware of the instrument, making the instrument function software a lightweight application software that can better realize user-personalized functions, upgrade iterations and function expansion. Attached Figure Description

[0038] Figure 1 A system block diagram for implementing a human-machine interface based on an in-vehicle system, provided as one embodiment of the present invention;

[0039] Figure 2 A schematic diagram of the processing unit software composition in a system based on a vehicle-mounted infotainment system for implementing a human-machine interface, provided as an embodiment of the present invention;

[0040] Figure 3 A flowchart illustrating a method for implementing a human-machine interface based on an in-vehicle system according to one embodiment of the present invention;

[0041] Figure 4 This is a flowchart illustrating the mapping relationship between the window data stream and the frame buffer in a method for implementing a human-machine interface based on a vehicle-mounted system, according to one embodiment of the present invention. Detailed Implementation

[0042] The embodiments of the present invention will be described below with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention and not for limiting the scope of protection of the present invention.

[0043] It should be noted that the illustrations provided in the following embodiments are only schematic representations of the basic concept of the present invention. Therefore, the illustrations only show the components related to the present invention and are not drawn according to the actual number, shape and size of the components in the actual implementation. In the actual implementation, the form, quantity and proportion of each component can be arbitrarily changed, and the layout of the components may also be more complex.

[0044] The in-vehicle infotainment system (IVS) has evolved from a distributed system to a centralized system due to the rapid increase in chip computing power in the cockpit domain control field, and the continuous enrichment of expandable functions and input / output interfaces. Controllers in various cockpit domains, such as the IVS, network terminals, and reversing cameras, have changed from being composed of distributed controllers to being composed of centralized domain controllers.

[0045] This embodiment proposes a system for implementing a human-machine interface based on an in-vehicle infotainment system, such as... Figure 1 As shown, it includes a cockpit control component, a first display component, and a second display component, wherein the cockpit control component is connected to the first display component and the second display component respectively;

[0046] The cockpit control component is used to generate the vehicle infotainment software window and calculate and generate the instrument cluster software window based on the data transmitted by the vehicle data acquisition component.

[0047] The first display component and the second display component are used to display the vehicle infotainment software window and the instrument cluster software window, respectively.

[0048] In this embodiment, the first display component and the second display component are liquid crystal display components. The display of the liquid crystal display components is controlled by the control component. The vehicle infotainment software includes navigation software, desktop software, voice software, music playback software, etc., while the instrument cluster software includes display functions such as vehicle speed, remaining fuel, and mileage. When the instrument cluster application software needs to be upgraded, the instrument cluster application software human-machine interface (HMI) can be upgraded separately to achieve a rapid upgrade of the instrument cluster software.

[0049] Based on the aforementioned technical methods, the cockpit control component generates both the vehicle infotainment software window and the instrument cluster software window. Furthermore, the original instrument cluster calculations are also handled by the cockpit control component, eliminating the need for a separate instrument cluster control component. This reduces overall vehicle weight and cost, and decouples the instrument cluster functions from its underlying system and hardware. This makes the instrument cluster software a lightweight application, better enabling user-customized functions, upgrades, and feature expansions. The vehicle infotainment software window and the instrument cluster software window generated by the cockpit control component are displayed using different display components for easy viewing and operation by the user.

[0050] In this embodiment of the application, the step of calculating and generating the instrument business software window based on the data transmitted by the vehicle data acquisition component includes:

[0051] The data displayed on the instrument is calculated based on the data transmitted by the acquisition components;

[0052] Generate the instrument business software window based on the instrument display data and interface layout template.

[0053] In practical implementation, the cockpit control component obtains the necessary signal data for instrument cluster operations from various controllers throughout the vehicle via a processing unit or an Ethernet-based data distribution service. This includes vehicle speed information from the speed sensor, fuel level information from the fuel level sensor, and battery level information from the three-electric system. After acquiring this vehicle information, the cockpit control component calculates driving data such as trip mileage and total mileage, combining this data with time units like driving duration and signal cycles. It also calculates instrument cluster data such as fuel consumption for the previous trip, based on fuel levels at the time of ignition and shutdown, and the previous mileage. All calculated data that needs to be permanently stored is stored in the cockpit domain controller software system's database through database operations. Then, the instrument cluster software window is generated based on the calculated data and the interface layout template. The layout template can be quickly updated, enabling diverse instrument cluster displays.

[0054] Based on the above technical means, the data displayed by the instrument needs to be calculated based on the data collected by the acquisition component. This part belongs to the instrument business. In the traditional solution, the calculation is performed by the instrument control component. In the above technical means, it is realized by the cockpit control component, which eliminates the need to set up an instrument control component on the instrument side, thus saving costs.

[0055] In this embodiment of the application, the cockpit control component includes a processing unit, a random access memory unit, and a drive unit, wherein the processing unit is connected to the random access memory unit and the drive unit;

[0056] The driving unit includes two units, which are respectively connected to the first display component and the second display component, and are used to drive the first display component and the second display component to display content.

[0057] According to the above technical solution, different display components are connected to different driving units to display different content.

[0058] In this embodiment of the application, the processing unit processes the data into an instrument business software window and a vehicle business software window according to the interface display layout template.

[0059] like Figure 2 As shown, the software components on the processing unit include: hardware abstraction layer and driver software, operating system and other middleware, navigation, voice and other entertainment applications, and instrument application software. The cockpit control components are connected to the network through the vehicle network.

[0060] According to the above technical solution, the processing unit realizes data processing and generates the instrument business software window and the vehicle business software window.

[0061] In this embodiment, the random access storage unit includes a first frame buffer, a second frame buffer, a first storage area, and a second storage area. The first frame buffer and the second frame buffer are used to cache one of the vehicle infotainment system business software window data stream and the instrument cluster business software window data stream, respectively. The first storage area and the second storage area are used to temporarily store one of the vehicle infotainment system business software window data stream and the instrument cluster business software window data stream, respectively. The first frame buffer corresponds to the first display component and the first storage area, and the second frame buffer corresponds to the second display component and the second storage area.

[0062] In some embodiments, a first frame buffer is used to cache the data stream of the vehicle infotainment system (VMS) software window, and a second frame buffer is used to cache the data stream of the instrument cluster (ICS) software window. During system operation, after power-on, the cockpit control component first obtains the signal data required for the ICS services from various data acquisition components collected by different controllers in the vehicle. Then, it performs calculations and generates the ICS software window based on the calculated ICS display data and the ICS interface display layout template, and caches it in the second frame buffer. Similarly, it generates the VMS software window based on the in-vehicle entertainment system interface display layout template and caches it in the first frame buffer. The first and second storage areas are used for temporary storage. Then, a drive unit drives a first display component to display the VMS software window, and another drive unit drives a second display component to display the ICS software window, thus displaying different services on different screens. Simultaneously, the cockpit control component continuously acquires the signal data required for the ICS services and updates the content displayed in the ICS software window in real time.

[0063] According to the above technical solution, the random access storage unit is divided into different areas to store the data streams of different business software windows, so as to avoid data display errors caused by mixed storage of data streams.

[0064] In this embodiment, the cockpit control component is physically connected to the first display component and the second display component, such as an HDMI interface.

[0065] A method for implementing a human-machine interface based on an in-vehicle infotainment system, implemented based on the aforementioned system, such as... Figure 3 As shown, the method includes:

[0066] The cockpit control components generate the vehicle infotainment interface, and the instrument cluster interface is calculated and generated based on the data transmitted by the vehicle data acquisition components.

[0067] The first display component and the second display component respectively display one of the vehicle infotainment system interface and the instrument cluster interface.

[0068] According to the above technical solution, the cockpit control component is used to generate the vehicle infotainment software window and the instrument cluster software window. The original instrument cluster calculations are also completed through the cockpit control component, eliminating the need to set up an instrument cluster control component, thus reducing the overall vehicle weight and cost. The vehicle infotainment software window and the instrument cluster software window generated by the cockpit control component are displayed through different display components to facilitate user viewing and operation.

[0069] In this embodiment of the application, the method further includes:

[0070] By modifying the mapping relationship between the first and second frame buffers and the data streams of the vehicle infotainment software window and the instrument cluster software window through preset operations, the displayed content of the first and second display components can be exchanged. In this embodiment, the preset operation can be a button click, screen swipe, voice control, etc., to exchange the mapping relationship between the first and second frame buffers and the data streams of the vehicle infotainment software window and the instrument cluster software window. For example, initially, the first frame buffer corresponds to the data stream of the vehicle infotainment software window, and the second frame buffer corresponds to the data stream of the instrument cluster software window. After executing the preset operation, the mapping relationship can be changed so that the first frame buffer corresponds to the data stream of the instrument cluster software window, and the second frame buffer corresponds to the data stream of the vehicle infotainment software window. Executing the preset operation again can exchange the mapping relationship again, that is, return to the initial setting.

[0071] Specific examples Figure 4 As shown, when the user performs a preset operation, the screen buffer object control service receives a switching request, determines whether there are two frame buffer objects, and if so, swaps the mapping relationship between the window data stream and the frame buffer; otherwise, the operation ends.

[0072] The above technical solution enables the exchange of content displayed by different display components, thereby improving the user experience.

[0073] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method for implementing a human-machine interface based on a vehicle-mounted system.

[0074] A vehicle equipped with the system that enables human-machine interaction based on the vehicle-mounted infotainment system.

[0075] The above embodiments are merely preferred embodiments provided to fully illustrate the present invention, and the scope of protection of the present invention is not limited thereto. Equivalent substitutions or modifications made by those skilled in the art based on the present invention are all within the scope of protection of the present invention.

Claims

1. A system for implementing a human-machine interface based on an in-vehicle infotainment system, characterized in that, It includes a cockpit control assembly, a first display assembly, and a second display assembly, wherein the cockpit control assembly is connected to the first display assembly and the second display assembly, respectively; The cockpit control component is used to generate the vehicle infotainment software window and calculate and generate the instrument cluster software window based on the data transmitted by the vehicle data acquisition component. The first display component and the second display component are used to display the vehicle infotainment software window and the instrument cluster software window, respectively. The cockpit control assembly includes a processing unit and a random access storage unit, wherein the processing unit is connected to the random access storage unit; The cockpit control component obtains the signal data required for instrument business from various data acquisition components collected by different controllers in the vehicle through the processing unit or Ethernet-based data distribution service; The random access storage unit includes a first frame buffer, a second frame buffer, a first storage area, and a second storage area. The first frame buffer and the second frame buffer are used to cache the data stream of the vehicle infotainment software window and the data stream of the instrument cluster software window, respectively. The first storage area and the second storage area are used to temporarily store the data stream of the vehicle infotainment software window and the data stream of the instrument cluster software window, respectively. The first frame buffer corresponds to the first display component and the first storage area, and the second frame buffer corresponds to the second display component and the second storage area. By changing the mapping relationship between the first frame buffer, the second frame buffer and the data stream of the vehicle infotainment software window and the data stream of the instrument cluster software window through preset operations, the exchange of display content between the first display component and the second display component can be realized.

2. The system for realizing a human-machine interaction interface based on a vehicle-mounted system according to claim 1, characterized in that, The step of calculating and generating the instrument business software window based on the data transmitted by the vehicle data acquisition component includes: The data displayed on the instrument is calculated based on the data transmitted by the acquisition components; Generate the instrument business software window based on the instrument display data and interface layout template.

3. The system for realizing a human-machine interaction interface based on a vehicle-mounted system according to claim 1, characterized in that, The cockpit control assembly also includes a drive unit, and the processing unit is connected to the drive unit; The driving unit includes two units, which are respectively connected to the first display component and the second display component, and are used to drive the first display component or the second display component to display content.

4. The system for realizing a human-machine interaction interface based on a vehicle-mounted system according to claim 3, characterized in that, The processing unit is used to process data into instrument business software windows and vehicle business software windows according to the interface display layout template.

5. The system for realizing a human-machine interaction interface based on a vehicle-mounted system according to claim 1, characterized in that, The cockpit control assembly is physically connected to the first display assembly and the second display assembly.

6. A method for implementing a human-machine interface based on an in-vehicle infotainment system, implemented based on the system described in any one of claims 1-5, characterized in that, The method includes: The cockpit control components generate the vehicle infotainment interface, and the instrument cluster interface is calculated and generated based on the data transmitted by the vehicle data acquisition components. The vehicle infotainment system interface and the instrument cluster interface are displayed through the first display component and the second display component, respectively. By changing the mapping relationship between the first frame buffer, the second frame buffer and the data stream of the vehicle infotainment software window and the data stream of the instrument cluster software window through preset operations, the exchange of display content between the first display component and the second display component can be realized.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the method for implementing a human-machine interface based on a vehicle-mounted system as described in any one of claims 6.

8. A vehicle, characterized in that, The vehicle is equipped with a system based on the vehicle-mounted system to realize a human-machine interaction interface, as described in any one of claims 1-5.

Images