A reverse auxiliary image fusion method, system and vehicle

Abstract

This invention discloses a reversing auxiliary image fusion method for use in a dual-system in-vehicle central control unit. The method includes: the in-vehicle instrument cluster system receiving reversing auxiliary images acquired by a reversing auxiliary image system; determining whether the in-vehicle central control entertainment system has been fully started; if the in-vehicle central control entertainment system has been fully started, superimposing the reversing auxiliary image layer in the in-vehicle instrument cluster system with the function layer of the in-vehicle central control entertainment system across systems, so that the reversing auxiliary image and the control layer of the in-vehicle central control entertainment system are displayed separately; if the in-vehicle central control entertainment system has not been fully started, filling the in-vehicle central control display screen with the reversing auxiliary image layer and related settings. This invention does not provide a corresponding system or vehicle. Implementing this invention can meet users' needs for quick reversing and effectively solve the problems of screen overload and mismatch between auxiliary images and screen resolution, thus improving the user experience.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of car machine technology, in particular to a reverse auxiliary image fusion method and system and a vehicle. BACKGROUND

[0002] With the development of vehicle intelligent driving system and cockpit system, the reverse auxiliary image system becomes a standard configuration. The common reverse auxiliary image systems on the market today include: rear view camera (RVC), surround view monitor (SVM), full auto parking assist (FAPA), etc. At the same time, in order to pursue better driving safety, the above-mentioned reverse auxiliary image is gradually expanded into driving auxiliary image. For example, when the user turns on the turn signal or the vehicle body approaches an obstacle, the auxiliary image will be automatically displayed on the vehicle central control desktop, and through the corresponding camera image on the vehicle side, the user is informed whether there is an obstacle in the turning direction and the distance from the obstacle to the vehicle. The interface diagram of the full-screen auxiliary image display scheme in the audio host can be referred to as shown in Figure 1 . This approach does improve user driving safety, but since the traditional reverse auxiliary image system is designed for reverse gear conditions, the interaction with the audio host is full central control screen switching. Obviously, this design is not suitable for driving auxiliary conditions.

[0003] The existing such scheme often leads to poor user experience in the following scenarios:

[0004] Scenario one: the vehicle is driving on a highway, the central control display screen displays a navigation picture, the user is about to exit the highway, and the navigation picture is covered by the auxiliary image when the turn signal is turned on in advance;

[0005] Scenario two: the vehicle is driving on a narrow road, and when the radar detects that the surrounding obstacle is close to the vehicle, the auxiliary image frequently jumps out.

[0006] In addition to the above-mentioned screen domination problem, this auxiliary image display method also has a resolution matching problem. With the development of intelligent cockpit, the central control display screen is getting larger and larger, 14.6 and 15.6 inch screens are becoming more common, and even larger sizes are gradually appearing on the market. The increase in screen size is accompanied by an increase in resolution. The resolution of the auxiliary image is determined by the reverse camera, and the growth of its resolution is difficult to match the growth of the central control screen resolution. The original full central control screen switching display method easily exposes the shortcomings of insufficient camera resolution, and the user perceives that the reverse image picture quality is poor and the experience is not good. To solve the resolution matching problem, some domestic OEMs use a pseudo-split screen scheme, which shrinks the auxiliary picture and adds some auxiliary picture related settings in the blank area. The interface diagram of the full-screen auxiliary image display scheme in the audio host can be referred to as shown in Figure 2The shown. This scheme can optimize the resolution matching problem, but the screen problem still exists. Then some OEMs put forward the auxiliary image fusion into the split screen scheme of the audio entertainment system, that is, when designing each module of the audio entertainment system, considering the auxiliary image display, the interface diagram of the auxiliary image fusion scheme in the audio host can be referred to Figure 3 The experience is good, the overall feeling is strong, and this scheme will gradually replace other schemes and become the industry mainstream.

[0007] This scheme is mainly used in single-Android system audio hosts on the market today, because the single-Android system auxiliary image fusion scheme is simple to develop. But limited by the slow start of the single-Android system, it cannot meet the user's demand for fast reversing, that is, when starting the vehicle, the auxiliary image is displayed in reverse. In view of this, this scheme is mostly used in pure electric vehicles. Pure electric vehicles can achieve non-hibernation of the audio host due to large battery capacity, and can be in a semi-hibernation state after the customer locks the vehicle. In this way, the user can quickly reverse, and the Android system does not need to be restarted, and the auxiliary image can be quickly displayed. This causes the regret that the auxiliary image fusion scheme cannot be adapted to pure fuel vehicles.

[0008] In summary, in the prior art scheme, there are the following deficiencies:

[0009] The traditional auxiliary image display scheme has the problems of screen domination and resolution mismatch, which affects the user experience;

[0010] The single-Android system auxiliary image fusion scheme is limited by the slow start of the Android system. In order to meet the user's demand for fast reversing, it is only suitable for pure electric vehicles, but not for pure fuel vehicles;

[0011] There is a lack of mature auxiliary image fusion scheme designed for fuel vehicles on the market. SUMMARY

[0012] The technical problem to be solved by the present application is to provide a reversing auxiliary image split screen fusion method and system and a vehicle, which can be applied to a dual-system vehicle audio host of a fuel vehicle, that is, it can meet the user's demand for fast reversing, and effectively solve the problems of screen domination, resolution mismatch of auxiliary image and screen, and improve the user experience.

[0013] To solve the above technical problems, as one aspect of the present application, a reversing auxiliary image fusion method is provided for a dual-system vehicle central control host, which at least includes the following steps:

[0014] The vehicle-mounted instrument domain system receives the reversing auxiliary image collected from the reversing auxiliary image system;

[0015] Judge whether the vehicle-mounted central control entertainment system has been started;

[0016] Once the in-vehicle infotainment system has started, the reversing assist image layer in the in-vehicle instrument cluster domain system and the in-vehicle infotainment system function layer are overlaid across systems and displayed on the in-vehicle infotainment display screen in a first fusion mode, so that the reversing assist image and the in-vehicle infotainment system control area are displayed separately.

[0017] If the in-vehicle infotainment system has not been fully started, the reversing assist image layer in the in-vehicle instrument cluster system will be displayed on the in-vehicle infotainment display screen in a second fusion mode, so that the reversing assist image and its related settings in the reversing assist image layer fill the in-vehicle infotainment display screen.

[0018] The step of cross-system overlaying of the reversing auxiliary image layer in the vehicle instrument cluster system and the function layer of the vehicle infotainment system, and displaying them on the vehicle audio host display screen in a first fusion method, so that the reversing auxiliary image and the vehicle infotainment system control area are displayed separately, specifically includes:

[0019] Place the reversing auxiliary image layer in the vehicle instrument domain system on the top layer, and place the vehicle central control entertainment system function layer on the next layer;

[0020] The reversing assist image layer is set to include reversing assist images, related settings, and a transparent area; the in-vehicle infotainment system function layer is set to include the in-vehicle infotainment system control area, and the position of the in-vehicle infotainment system control area corresponds to the transparent area of ​​the reversing assist image layer.

[0021] The reversing assist image layer is superimposed on the in-vehicle central control entertainment system function layer and displayed on the in-vehicle audio host display screen, so that the reversing assist image and the in-vehicle central control entertainment system control area are displayed separately. The reversing assist image and related settings are displayed in the area inside the assist image, and the in-vehicle central control entertainment system control area is displayed in the area outside the assist image.

[0022] Specifically, the step of displaying the reversing auxiliary image layer from the vehicle instrument cluster system on the vehicle central control display screen using the second fusion method is as follows:

[0023] Place the reversing auxiliary image layer in the vehicle instrument domain system at the top layer;

[0024] Set the reversing assist image layer to include the reversing assist image and related settings;

[0025] The reversing auxiliary image layer is displayed on the in-vehicle central control display screen in its entirety.

[0026] This further includes:

[0027] It receives touch operations from users on the integrated in-vehicle central control interface;

[0028] Based on the coordinates corresponding to the touch operation, determine whether the touch area belongs to the area inside or outside the reversing assist image.

[0029] If it is determined that the touch area is located within the reversing assist image area, the control request signal corresponding to the touch area is parsed and sent to the reversing assist image system;

[0030] If it is determined that the touch area is located within or outside the reversing assist image area, the control request signal corresponding to the touch area is parsed and sent to the in-vehicle central control entertainment system.

[0031] The reversing auxiliary imaging system includes a rearview camera system (RVC), a rearview mirror system (SVM), and automatic parking assist (FAPA).

[0032] Accordingly, another aspect of the present invention also provides a reversing auxiliary image fusion system for use in a dual-system vehicle audio head unit, comprising at least:

[0033] The reversing auxiliary image receiving unit is used to receive reversing auxiliary images collected by the reversing auxiliary image system through the vehicle instrument domain system;

[0034] The vehicle infotainment system startup determination unit is used to determine whether the vehicle infotainment system in the vehicle central control unit has been started.

[0035] The first fusion processing unit is used to, when the judgment result of the vehicle central control entertainment system startup judgment unit is that the vehicle central control entertainment system has finished starting, overlay the reversing auxiliary image layer in the vehicle instrument domain system with the function layer of the vehicle central control entertainment system across systems, and display them on the vehicle central control display screen in the first fusion method, so that the reversing auxiliary image and the vehicle central control entertainment system control area are displayed separately.

[0036] The second fusion processing unit is used to display the vehicle central control screen in a second fusion mode when the judgment result of the vehicle central control entertainment system startup judgment unit is that the vehicle central control entertainment system has not been fully started, so that the reversing auxiliary image and its related settings in the reversing auxiliary image layer fill the vehicle central control screen.

[0037] The first fusion processing unit includes:

[0038] The layer position setting unit is used to place the reversing auxiliary image layer in the vehicle instrument domain system on the top layer and place the vehicle central control entertainment system function layer on the next layer.

[0039] The layer content display position setting unit is used to set the reversing auxiliary image layer to include reversing auxiliary images, related settings, and a transparent area; and to set the in-vehicle central control entertainment system function layer to include the in-vehicle central control entertainment system control area, wherein the position of the in-vehicle central control entertainment system control area corresponds to the transparent area of ​​the reversing auxiliary image layer.

[0040] The overlay display unit is used to overlay the reversing auxiliary image layer with the in-vehicle central control entertainment system function layer and display them on the in-vehicle audio host display screen, so that the reversing auxiliary image and the in-vehicle central control entertainment system control area are displayed separately. The reversing auxiliary image and related settings are displayed in the area within the auxiliary image, and the in-vehicle central control entertainment system control area is displayed in the area outside the auxiliary image.

[0041] The second fusion processing unit includes:

[0042] The layer content setting unit is used to place the reversing auxiliary image layer in the vehicle instrument domain system at the top layer, and set the reversing auxiliary image layer to include reversing auxiliary images and related settings.

[0043] The full-screen display unit is used to display the reversing auxiliary image layer on the in-vehicle central control display screen.

[0044] This further includes:

[0045] The touch operation receiving unit is used to receive the user's touch operation on the integrated vehicle central control interface;

[0046] The touch position determination unit is used to determine whether the touch area belongs to the area inside the reversing auxiliary image or the area outside the auxiliary image based on the coordinates corresponding to the touch operation.

[0047] The parsing and processing unit is configured to, when the touch position determination unit determines that the touch area is located within the reversing auxiliary image area, parse the control request signal corresponding to the touch area and send it to the reversing auxiliary image system; and when the touch position determination unit determines that the touch area is located within or outside the auxiliary image area, parse the control request signal corresponding to the touch area and send it to the in-vehicle central control entertainment system.

[0048] Accordingly, in another aspect, the present invention also provides a vehicle having an in-vehicle central control unit, further including the aforementioned reversing auxiliary image fusion system.

[0049] Implementing the embodiments of the present invention has the following beneficial effects:

[0050] This invention provides a reversing auxiliary image fusion method, system, and vehicle. This solution utilizes a dual-system software architecture of the in-vehicle instrument cluster system and the in-vehicle infotainment system. The auxiliary image-related functions are arranged on the in-vehicle instrument cluster system, and the auxiliary image from the in-vehicle instrument cluster system is displayed on the in-vehicle infotainment system interface. When a reversing image is required, it first determines whether the in-vehicle infotainment system has been successfully started. If it has, the reversing image layer and the in-vehicle infotainment system function layer are overlaid across systems, ensuring that the reversing image display does not affect the operation of the in-vehicle infotainment system. If the in-vehicle infotainment system has not been successfully started, the reversing image and settings items fill the screen, preventing a black background and improving user experience. Existing technologies, which do not disclose the reversing image operation, first determine whether the in-vehicle infotainment system has been successfully started, using different image overlay and layout display schemes for successful and unsuccessful starts.

[0051] The solution provided by this invention can bring customers a high-quality experience of auxiliary image fusion, which can not only meet the user's need for quick reversing, but also effectively solve the problems of screen domination and mismatch between auxiliary images and screen resolution, thus improving the user experience. Attached Figure Description

[0052] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, obtaining other drawings based on these drawings without creative effort still falls within the scope of the present invention.

[0053] Figure 1 This is a schematic diagram of an existing solution for displaying auxiliary images in full screen on a central control unit.

[0054] Figure 2 This is a schematic diagram of an existing scheme for displaying auxiliary images in a full-screen, scaled-down format on a central control unit.

[0055] Figure 3 This is a schematic diagram of an existing interface for displaying auxiliary image fusion solutions in a central control unit;

[0056] Figure 4 This is a schematic diagram of the main flow of an embodiment of the reversing auxiliary image fusion method provided by the present invention;

[0057] Figure 5 for Figure 4 The flowchart of the program involving the built-in panoramic auxiliary image fusion scheme in step S12;

[0058] Figure 6 for Figure 5The corresponding display layer diagram;

[0059] Figure 7 for Figure 4 The flowchart of the program using the built-in panoramic auxiliary image fusion scheme involved in step S13;

[0060] Figure 8 for Figure 7 A schematic diagram of the corresponding display layers;

[0061] Figure 9 for Figure 4 The flowchart of the external automatic parking assist image fusion scheme involved in step S14;

[0062] Figure 10 This is a schematic diagram of a structure of an embodiment of a reversing auxiliary image fusion system provided by the present invention;

[0063] Figure 11 for Figure 10 A schematic diagram of the structure of the first fusion processing unit;

[0064] Figure 12 for Figure 10 A schematic diagram of the structure of the second fusion processing unit;

[0065] Figure 13 A more detailed structural schematic diagram of an embodiment of a reversing auxiliary image fusion system provided by the present invention. Detailed Implementation

[0066] To make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings.

[0067] In this embodiment, the QNX system of the car audio head unit represents the car instrument cluster system, the Android system represents the car infotainment system, and the car audio head unit display screen represents the car infotainment screen. The above is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Equivalent variations or substitutions of names made in accordance with the present invention are still within the scope of the present invention.

[0068] like Figure 4 The diagram shows the main flow of an embodiment of a reversing auxiliary image fusion method provided by the present invention; combined with... Figures 5 to 9 As shown, in this embodiment, the reversing auxiliary image split-screen fusion method is used in a dual-system vehicle audio head unit, and it includes at least the following steps:

[0069] Step S10: The QNX system in the instrument cluster of the vehicle audio head unit receives the reversing auxiliary image collected by the reversing auxiliary image system: wherein the reversing auxiliary image system is one of the following: Rearview Camera (RVC), Surround View Monitor (SVM), and Automatic Parking (FAPA).

[0070] Step S11: Determine whether the Android system in the car audio head unit has finished booting up;

[0071] Step S12: If the Android system has finished starting, the reversing auxiliary image layer and the Android system function layer are superimposed across the system and displayed on the car audio host display screen in the first fusion mode, so that the reversing auxiliary image and the Android system control layer are displayed separately.

[0072] In a specific example, step S12 is as follows:

[0073] The control places the reversing assist image layer on the top layer and the Android system function layer on the next layer.

[0074] Set the reversing assist image layer to include the reversing assist image, related settings, and a transparent area; set the Android system function layer to include the Android system control area, with the Android system control area positioned corresponding to the transparent area of ​​the reversing assist image layer;

[0075] The reversing assist image layer is overlaid with the Android system function layer and displayed on the car audio host screen, so that the reversing assist image and the Android system control area are displayed separately. The reversing assist image and related settings are displayed in the area inside the assist image, and the Android system control area is displayed in the area outside the assist image.

[0076] Step S13: If the Android system has not finished starting, the reversing auxiliary image layer is displayed on the car audio host display screen in the second fusion mode, so that the reversing auxiliary image and related settings in the reversing auxiliary image layer fill the car audio host display screen.

[0077] In a specific example, step S13 is as follows:

[0078] Place the reversing assist image layer at the top;

[0079] Set the reversing assist image layer to include the reversing assist image and related settings;

[0080] The reversing auxiliary image layer is displayed on the entire screen of the car audio host.

[0081] Furthermore, the method further includes:

[0082] Step S14: Receive user touch operation on the integrated car audio host central control interface;

[0083] Step S15: Based on the coordinates corresponding to the touch operation, determine whether the touch area belongs to the area inside or outside the auxiliary image.

[0084] Step S16: If it is determined that the touch area is located within the auxiliary image area, the control request signal corresponding to the touch area is parsed and sent to the reversing auxiliary image system;

[0085] Step S17: If it is determined that the touch area is located in the inner or outer domain of the auxiliary image, the control request signal corresponding to the touch area is parsed and sent to the pre-corresponding APP.

[0086] To further understand the principles of this invention, the following will describe the implementation process of the method of this invention and more details with specific examples.

[0087] With the improvement of audio head unit performance, in some implementations, the Surround View Monitor (SVM) function can be integrated into the audio head unit. This involves inputting image data from four external SVM cameras into the audio head unit, integrating SVM-related algorithms within the head unit, and displaying the stitched images on the central control screen of the audio head unit. However, the Automatic Parking Module (FAPA) is still mostly an external ECU. Therefore, this patent will discuss the implementation of auxiliary image fusion schemes separately according to these two functional configurations. The following descriptions will focus on the audio head unit integrated SVM scheme and the external FAPA module scheme.

[0088] (I) SVM Solution Integrated into Audio Head Unit

[0089] Step 1: As Figure 5 As shown, the control panel (auxiliary image display screen), radar (automatically displays the corresponding auxiliary image on the side of the vehicle when an obstacle is detected approaching the vehicle), and turn signals (automatically display the corresponding auxiliary image on the side of the vehicle when the turn signal is activated) transmit relevant signals to the audio head unit via the vehicle's CAN bus. From there, the signals are transmitted through the AutoSar interface module within the audio head unit's MCU to the Vehicle Service module in the HAL layer of the QNX system. The signals are then transmitted via the high-speed distributed bus (FDBus) through path 2 to the inner SVM module. Upon receiving the signals, the SVM module displays the auxiliary image on the top-level auxiliary image layer. There are two possible scenarios here:

[0090] Firstly, if the Android system has already started up, the SVM module displays auxiliary image layers such as... Figure 6 As shown, at this point, the auxiliary image layer, except for the auxiliary image portion, is a transparent area. Within these transparent areas, the content of the Android system's related function layers can show through and be presented to the user. Figure 3 The effect is as follows: When the Android system has finished booting up, if the user triggers the reversing camera function through the soft button on the central control screen, the relevant signal is transmitted directly from the touch button (mTouch) module in QNX to the Inner SVM module through path 1 to complete the auxiliary image display work;

[0091] Secondly, it's understandable that, generally speaking, Android system startup takes about 16-20 seconds, QNX system startup takes about 2-3 seconds, and MCU startup is in the millisecond range. Therefore, there are situations where the QNX system starts but the Android system hasn't. If the Android system hasn't finished starting, the SVM module will display the auxiliary image layer as follows: Figure 8 As shown, if the auxiliary image fusion scheme is still used, the auxiliary image area will appear normal, while other areas will be black (upper right image). Therefore, the solution is to use a full-screen scaling-down auxiliary image scheme, where the entire auxiliary image layer displays the reversing image, but the reversing image settings are placed below the reversing image (lower right image). This avoids the resolution mismatch issue between the camera and the central control screen.

[0092] Its corresponding flowchart is as follows Figure 7 In this situation, the Android system has not fully booted up, and the user cannot trigger the reversing camera function via the soft buttons on the central control screen. In other words, the mTouch device at this time only has the function of controlling SVM settings. Figure 2 The “Settings 1”, “Settings 2”, “Settings 3”, etc., are transmitted from the mTouch module to the Inner SVM module through path 3, FDBus, and path 2.

[0093] Step 2: When the user touches the integrated central control interface, the relevant signals are transmitted from the QNX system to the Android system via FDB through channel 3, and then transmitted to the SVM service module (SVM Service) via channel 5 through the vehicle hardware abstraction layer (VHAL).

[0094] Step 3: The SVM Service module determines whether the touch area belongs to the area inside or outside the auxiliary image based on the coordinates of the user's touch event.

[0095] If it's within the auxiliary image area, the SVM Service recognizes the user's touch intent, for example... Figure 3The "Setting 1" function transmits information back to the VHAL layer via channel 5, then through path 4 via FDB back to the QNX system. It is then transmitted to the Inner SVM module via path 2, where it performs the corresponding operations to implement the "Setting 1" function.

[0096] If the area is outside the auxiliary image, the SVM Service module recognizes the user's touch intent, for example... Figure 3 In the "Other Functions 1" section, relevant information is sent to other apps through channel 6, and the other apps then implement the relevant functions.

[0097] In this scheme, the signal flow direction and signal content of each pathway in steps 1-3 are shown in Table 1 below:

[0098] Table 1. Comparison of signal flow direction for each channel

[0099]

[0100] Understandably, in this solution, the control panel, radar, and turn signals transmit relevant signals to the audio head unit via the CAN bus, or the user can activate the reversing auxiliary image via the soft button on the central control display. The above signals are transmitted to the SVM module integrated in QNX. The SVM module determines whether the Android system has finished booting and displays different reversing image screens.

[0101] For touch input, an SVM Service module is integrated into the Android system to determine whether the user's touch operation is for the reversing camera or other APP functions, and then sends the relevant signals to the SVM module or other APP.

[0102] (ii) External FAPA ECU solution

[0103] The FAPA (Automatic Parking Assistant) ECU solution differs somewhat in architecture from the integrated SVM (Side View Monitor) solution. As shown in the diagram, FAPA's auxiliary image is transmitted to the QNX audio head unit system via a low-voltage differential signal (LVDS) chip and cable. In this case, the QNX audio head unit no longer integrates an SVM module, but instead has an SVM wrapper module for managing the reversing auxiliary image display. Furthermore, FAPA's image transmission is continuous, with the SVM wrapper switching between displaying and not displaying the image on the central control screen.

[0104] Step 1 is basically the same as Step 1 in the "Speaker Host Integrated SVM" solution. The difference is that the two auxiliary screens displayed based on whether the Android system has started up are not generated by the SVM Wrapper module, but by FAPA.

[0105] To ensure that the two auxiliary images generated by FAPA match the condition of whether the Android system has finished booting, the Vehicle Service module needs to transmit the status information of whether the Android system has finished booting back to the MCU's AutoSar interface module through channel 9, and then back to FAPA through channel 8, CAN bus, and channel 7. FAPA then displays the corresponding screen based on the returned Android status.

[0106] If the Android system has not finished booting, then touch the function buttons inside the reversing camera. Figure 2 In the settings such as "Setting 1", "Setting 2", and "Setting 3", the mTouch module will transmit the touch events to FAPA via channel 10, Vehicle Service module, channel 9, AutoSar interface module, channel 8, CAN bus, and channel 7. FAPA will then perform the relevant functions.

[0107] After the Android system boots up, the mTouch module can also turn on the reversing camera. When the customer clicks the corresponding soft button, the mTouch module uses channel 1 to allow the SVM Wrapper to display the reversing camera image.

[0108] Step 2: Same as Step 2 in the "Speaker Head Unit Integrated SVM" solution;

[0109] Step 3: The SVM Service module determines that the user's touch is outside the reversing camera area, and the processing solution is the same as the relevant steps in Step 3 of the "Audio Head Unit Integrated SVM" solution; when the user's touch is determined to be inside the reversing camera area, the SVM Service module identifies the user's touch intent, for example... Figure 3 The "Setting 1" function transmits information back to the VHAL layer via channel 5, then through path 4 via FDB to the QNX system. It is then transmitted to FAPA via path 11, Vehicle Service module, path 9, AutoSar interface module, path 8, CAN bus, and path 7, where FAPA performs its functions.

[0110] In this scheme, the signal flow direction and signal content of each pathway in steps 1-3 are shown in Table 2 below:

[0111] Table 2. Comparison of signal flow direction for each channel

[0112]

[0113] Understandably, in this solution, the control panel, radar, and turn signals transmit relevant signals to the audio head unit via the CAN bus, or the user can activate the reversing camera via a soft button on the central control display. These signals are transmitted to the SVM Wrapper module integrated into the QNX. Compared to the Inner SVM module in the SVM solution integrated into the audio head unit, the SVM Wrapper module is essentially a switch that controls whether the FAPA signal transmitted to the LVDS of the audio head unit is displayed. The SVM Wrapper module determines whether the Android system has finished booting and displays different reversing camera images.

[0114] The touch controls related to the reversing camera are controlled by the FAPA ECU outside the main unit, so the relevant signals need to be sent to the FAPA ECU via the CAN bus through the AutoSar interface module inside the main unit MCU.

[0115] Accordingly, another aspect of the present invention also provides a reversing auxiliary image split-screen fusion system 1 for use in a dual-system vehicle audio head unit, which includes at least:

[0116] The reversing auxiliary image receiving unit 10 is used to receive reversing auxiliary images collected by the reversing auxiliary image system through the instrument cluster QNX system of the vehicle audio head unit:

[0117] Android system startup judgment unit 11 is used to determine whether the Android system in the car audio head unit has finished starting up.

[0118] The first fusion processing unit 12 is used to overlay the reversing auxiliary image layer and the Android system function layer across systems when the judgment result of the Android system startup judgment unit is that the Android system has finished starting, and display them on the car audio host display screen in the first fusion method, so that the reversing auxiliary image and the Android system control layer are displayed separately.

[0119] The second fusion processing unit 13 is used to display the reversing auxiliary image and related settings in the reversing auxiliary image layer on the vehicle audio host display screen in the second fusion mode when the Android system startup judgment unit determines that the Android system has not finished starting.

[0120] The first fusion processing unit 12 includes:

[0121] The layer position setting unit 120 is used to control whether the reversing auxiliary image layer is placed on the top layer and the Android system function layer is placed on the next layer.

[0122] The layer content display position setting unit 121 is used to set the reversing auxiliary image layer to include reversing auxiliary image, related settings and transparent area; and to set the Android system function layer to include Android system control area, wherein the position of the Android system control area corresponds to the transparent area of ​​the reversing auxiliary image layer.

[0123] The overlay display unit 122 is used to overlay the reversing auxiliary image layer with the Android system function layer and display them on the car audio host display screen, so that the reversing auxiliary image and the Android system control area are displayed separately. The reversing auxiliary image and related settings are displayed in the area inside the auxiliary image, and the Android system control area is displayed in the area outside the auxiliary image.

[0124] The second fusion processing unit 13 includes:

[0125] The layer content setting unit 130 is used to place the reversing auxiliary image layer at the top layer and set the reversing auxiliary image layer to include reversing auxiliary images and related settings.

[0126] The full-screen display unit 131 is used to display the reversing auxiliary image layer on the in-vehicle audio host display screen.

[0127] This further includes:

[0128] The touch operation receiving unit 14 is used to receive the user's touch operation on the integrated vehicle audio host central control interface;

[0129] The touch position determination unit 15 is used to determine whether the touch area belongs to the area inside the auxiliary image or the area outside the auxiliary image based on the coordinates corresponding to the touch operation.

[0130] The parsing processing unit 16 is used to parse the control request signal corresponding to the touch area and send it to the reversing auxiliary image system when the touch position determination unit determines that the touch area is located in the area within the auxiliary image; and when the touch position determination unit determines that the touch area is located in the inner or outer domain of the auxiliary image, it parses the control request signal corresponding to the touch area and sends it to the pre-corresponding APP.

[0131] The reversing auxiliary imaging system is one of the following: Reversing View System (RVC), Reversing Panoramic System (SVM), and Automatic Parking (FAPA).

[0132] Accordingly, in another aspect, the present invention also provides a vehicle equipped with a car audio host and a reversing auxiliary image system, wherein the car audio integrates an instrument cluster QNX system and an Android system, and further includes the aforementioned reversing auxiliary image split-screen fusion system 1.

[0133] For more details, please refer to and combine with the above. Figures 4 to 13 The description of that will not be repeated here.

[0134] Implementing the embodiments of the present invention has the following beneficial effects:

[0135] This invention provides a method, system, and vehicle for split-screen fusion of reversing auxiliary images. This solution utilizes a dual-system software architecture of the audio head unit's instrument cluster (QNX system) and the entertainment system (Android system). The auxiliary image-related functions are deployed on the QNX side, and the auxiliary image from the QNX side is displayed on the Android system interface. When the vehicle requires a reversing image, it first checks if the Android system has finished booting. If it has, the reversing image layer and the Android system function layer are overlaid across systems, ensuring that the reversing image display does not affect Android system operation. If Android has not finished booting, the reversing image and settings items fill the screen, preventing a black background and improving user experience. Existing technologies do not disclose how reversing image operation first checks if Android has successfully booted, using different display schemes for overlay and layout depending on whether booting is successful.

[0136] The solution provided by this invention can bring customers a high-quality experience of auxiliary image fusion, which can not only meet the user's need for quick reversing, but also effectively solve the problems of screen domination and mismatch between auxiliary images and screen resolution, thus improving the user experience.

[0137] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, apparatus, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0138] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0139] The above description is merely a preferred embodiment of the present invention and should not be construed as limiting the scope of the invention. Therefore, any equivalent variations made in accordance with the claims of the present invention are still within the scope of the present invention.

Claims

1. A reversing auxiliary image fusion method, used in a dual-system vehicle central control host, characterized in that, It should include at least the following steps: The in-vehicle instrument cluster system receives reversing assist images collected by the reversing assist imaging system; Determine if the in-vehicle infotainment system has finished starting up; Once the in-vehicle infotainment system has started, the reversing assist image layer in the in-vehicle instrument cluster system and the in-vehicle infotainment system function layer are displayed on the in-vehicle infotainment display screen in a first fusion mode, so that the reversing assist image and the in-vehicle infotainment system control layer are displayed separately. The reversing assist image layer in the in-vehicle instrument cluster system and the in-vehicle infotainment system function layer are set in layers, and a transparent area is set in the reversing image layer. If the in-vehicle infotainment system has not been fully started, the reversing assist image layer in the in-vehicle instrument cluster system will be displayed on the in-vehicle infotainment display screen in a second fusion mode, so that the reversing assist image and its related settings in the reversing assist image layer fill the in-vehicle infotainment display screen.

2. The method as described in claim 1, characterized in that, The step of displaying the reversing assist image layer in the vehicle instrument cluster domain system and the function layer of the vehicle infotainment system on the vehicle infotainment display screen in a first fusion method, so that the reversing assist image and the vehicle infotainment system control layer are displayed separately, specifically includes: Place the reversing auxiliary image layer in the vehicle instrument domain system on the top layer, and place the vehicle central control entertainment system function layer on the next layer; The reversing assist image layer is set to include reversing assist images, related settings, and a transparent area; the in-vehicle infotainment system function layer is set to include the in-vehicle infotainment system control area, and the position of the in-vehicle infotainment system control area corresponds to the transparent area of ​​the reversing assist image layer. The reversing assist image layer is superimposed on the in-vehicle central control entertainment system function layer and displayed on the in-vehicle audio host display screen, so that the reversing assist image and the in-vehicle central control entertainment system control area are displayed separately. The reversing assist image and related settings are displayed in the area inside the assist image, and the in-vehicle central control entertainment system control area is displayed in the area outside the assist image.

3. The method as described in claim 1, characterized in that, The specific steps for displaying the reversing auxiliary image layer from the vehicle instrument domain system on the vehicle central control display screen using the second fusion method are as follows: Place the reversing auxiliary image layer in the vehicle instrument domain system at the top layer; Set the reversing assist image layer to include the reversing assist image and related settings; The reversing auxiliary image layer is displayed on the in-vehicle central control display screen in its entirety.

4. The method according to any one of claims 1 to 3, characterized in that, Further includes: It receives touch operations from users on the integrated in-vehicle central control interface; Based on the coordinates corresponding to the touch operation, determine whether the touch area belongs to the area inside or outside the reversing assist image. If it is determined that the touch area is located within the reversing assist image area, the control request signal corresponding to the touch area is parsed and sent to the reversing assist image system; If it is determined that the touch area is located within or outside the reversing assist image area, the control request signal corresponding to the touch area is parsed and sent to the in-vehicle central control entertainment system.

5. The method as described in claim 4, characterized in that, The reversing assist imaging system includes a rearview camera system (RVC), a rearview mirror system (SVM), and automatic parking assist (FAPA).

6. A reversing auxiliary image fusion system for use in a dual-system vehicle audio head unit, characterized in that, At least including: The reversing auxiliary image receiving unit is used to receive reversing auxiliary images collected by the reversing auxiliary image system through the vehicle instrument domain system; The vehicle infotainment system startup determination unit is used to determine whether the vehicle infotainment system in the vehicle central control unit has been started. The first fusion processing unit is used to display the reversing auxiliary image layer in the vehicle instrument domain system and the function layer of the vehicle central control entertainment system on the vehicle central control display screen in a first fusion mode when the judgment result of the vehicle central control entertainment system startup judgment unit is that the vehicle central control entertainment system has been started. This makes the reversing auxiliary image and the vehicle central control entertainment system control layer displayed separately. The reversing auxiliary image layer in the vehicle instrument domain system and the function layer of the vehicle central control entertainment system are set in layers, and a transparent area is set in the reversing image layer. The second fusion processing unit is used to display the vehicle central control screen in a second fusion mode when the judgment result of the vehicle central control entertainment system startup judgment unit is that the vehicle central control entertainment system has not been fully started, so that the reversing auxiliary image and its related settings in the reversing auxiliary image layer fill the vehicle central control screen.

7. The system as described in claim 6, characterized in that, The first fusion processing unit includes: The layer position setting unit is used to place the reversing auxiliary image layer in the vehicle instrument domain system on the top layer and place the vehicle central control entertainment system function layer on the next layer. The layer content display position setting unit is used to set the reversing auxiliary image layer to include reversing auxiliary images, related settings, and a transparent area; and to set the in-vehicle central control entertainment system function layer to include the in-vehicle central control entertainment system control area, wherein the position of the in-vehicle central control entertainment system control area corresponds to the transparent area of ​​the reversing auxiliary image layer. The overlay display unit is used to overlay the reversing auxiliary image layer with the in-vehicle central control entertainment system function layer and display them on the in-vehicle audio host display screen, so that the reversing auxiliary image and the in-vehicle central control entertainment system control area are displayed separately. The reversing auxiliary image and related settings are displayed in the area within the auxiliary image, and the in-vehicle central control entertainment system control area is displayed in the area outside the auxiliary image.

8. The system as described in claim 6, characterized in that, The second fusion processing unit includes: The layer content setting unit is used to place the reversing auxiliary image layer in the vehicle instrument domain system at the top layer, and set the reversing auxiliary image layer to include reversing auxiliary images and related settings. The full-screen display unit is used to display the reversing auxiliary image layer on the in-vehicle central control display screen.

9. The system according to any one of claims 6 to 8, characterized in that, Further includes: The touch operation receiving unit is used to receive the user's touch operation on the integrated vehicle central control interface; The touch position determination unit is used to determine whether the touch area belongs to the area inside the reversing auxiliary image or the area outside the auxiliary image based on the coordinates corresponding to the touch operation. The parsing and processing unit is configured to, when the touch position determination unit determines that the touch area is located within the reversing auxiliary image area, parse the control request signal corresponding to the touch area and send it to the reversing auxiliary image system; and when the touch position determination unit determines that the touch area is located within or outside the auxiliary image area, parse the control request signal corresponding to the touch area and send it to the in-vehicle central control entertainment system.

10. A vehicle equipped with an on-board central control unit, characterized in that, Including the reversing assist image fusion system as described in any one of claims 6 to 9.

Images