Panoramic image floating window display method and device and vehicle machine system

Abstract

The embodiment of the invention relates to a panoramic image floating window display method, a panoramic image floating window display device and a vehicle-mounted infotainment system, parameter configuration and instruction configuration are carried out on a display layer, and a video stream is processed in a video display channel, so that cutting, display and control processing of a fillet floating window in a QNX system can be realized. According to the technical scheme, the video stream is prevented from being processed in the QNX system and the Android system, the link of the video stream is shortened, the host consumption is reduced, the QNX system directly processes the video, the display delay time can be shortened, and the use safety of a user and the user experience are improved.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of automotive electronics technology, and particularly to a panoramic image floating window display method, device, and vehicle-mounted system. Background Art

[0002] With the further development of panoramic image technology, in the scenario where the driver turns on the turn signal, a card-type panoramic floating window view will pop up on the center control screen of the vehicle-mounted system to assist the driver in making judgments. The window manager of the QNX system is a lightweight real-time operating system, which is mainly designed for embedded devices and is widely used in the automotive field. To achieve the quick startup function, the panoramic image algorithm is generally deployed on the QNX side. Since QNX does not provide native support for window-specific settings such as rounded corner display for windows, if you want to implement the rounded corner floating window function, it is usually transmitted to the Android side in the form of a video stream, and the cropping, display, and control of the rounded corner floating window are implemented on the Android side. The video stream is synthesized on the QNX side and then transmitted to Android, with a long link, which will increase the host consumption and high resource consumption; at the same time, control messages such as switching the panoramic image perspective need to be transmitted from the Android side to the QNX side for response, and then the video stream is synthesized and transmitted to the Android side, so there will be a problem of control delay, affecting the user experience. Summary of the Invention

[0003] In view of the above problems, the embodiments of the present invention provide a panoramic image floating window display method, device, and vehicle-mounted system, which are used to solve the problems in the prior art that the video stream is synthesized on the QNX side and then transmitted to Android, with a long link, which will increase the host consumption and high resource consumption; at the same time, control messages such as switching the panoramic image perspective need to be transmitted from the Android side to the QNX side for response, and then the video stream is synthesized and transmitted to the Android side, so there will be a problem of control delay, affecting the user experience.

[0004] According to one aspect of the embodiments of the present invention, a panoramic image floating window display method is provided, and the method includes: Obtain the display layer of the QNX system, and perform parameter configuration and instruction configuration on the display layer; Create an independent video display channel, obtain the input video stream through the video display channel, perform rounded corner processing on the video to generate a target video, and display the target video through the display layer; Listen for and process the input control events, and process the display layer according to the control events.

[0005] In some optional embodiments, performing parameter configuration on the display layer specifically includes: Set the display hierarchy of the display layer, and set the display hierarchy of the display layer to be displayed on top; Set the transparency of the display layer. By using the OpenWFD API, set the display layer to allow transparency settings and display it through the Android desktop. Set the content of the display layer to be allowed to be displayed transparently on top of other content on the Android desktop through the Screen API, and set the graphics blending mode through OpenGL ES.

[0006] In some alternative embodiments, create an independent video display channel, specifically including: Create a video display channel through the WFD module, configure the video display channel, and establish connections between the video display channel, the video acquisition interface, and the display layer.

[0007] In some alternative embodiments, obtain the input video stream through the video display channel and perform rounded corner processing on the video to generate a display video, specifically including: Obtain the input video stream from the video acquisition interface; Select the rounded corner area in the video stream, and perform transparency processing on the pixel points outside the rounded corner area to generate a target video.

[0008] In some alternative embodiments, the selection of the rounded corner area in the video stream specifically includes: Define the size and rounded corner radius of the target video window, and determine the rounded corner area through the rounded corner formula, where the rounded corner formula is , where x and y are the coordinates of the current pixel, cx and cy are the coordinates of the center of the rounded corner area of one corner of the target video window, and d is the distance from the current pixel to the center of the circle; Judge each pixel point of the target video window. If the pixel point is outside the rounded corner area, perform transparency processing on the pixel point.

[0009] In some alternative embodiments, the transparency processing of the pixel points outside the rounded corner area specifically includes: Perform interpolation calculation on the Alpha channel through the fragment shader, and define the transparency outside the rounded corner area to gradually change with the distance: , where r is the rounded corner radius, d is the distance from the current pixel to the center of the circle, and δr is the width of the gradient area; When d is less than r - , the transparency of the pixel point is opaque. When d is equal to r, the transparency is transparent. When d is in the range between r – and r, the transparency of the pixel point smoothly transitions according to a cubic interpolation curve.

[0010] In some alternative embodiments, set a close button at a preset position of the display layer and superimpose the close button on top of the target video.

[0011] In some optional embodiments, listening for and processing input control events, and processing the display layer according to the control events specifically includes: Listening for the input signal of the in-vehicle system, and judging whether it is a control event of the display layer according to the input signal. If so, processing the display layer according to the control event, otherwise not processing; wherein, the control event includes at least any one or more of touch, click, and drag.

[0012] According to another aspect of the embodiments of the present invention, a panoramic image floating window display device is provided, and the device includes: A display layer configuration module, configured to obtain the display layer of the QNX system, and perform parameter configuration and instruction configuration on the display layer; A video acquisition and processing module, configured to create an independent video display channel, acquire the input video stream through the video display channel, perform rounded corner processing on the video to generate a target video, and display the target video through the display layer; A listening and control module, configured to listen for and process input control events, and process the display layer according to the control events.

[0013] According to still another aspect of the embodiments of the present invention, an in-vehicle system is provided, which is characterized by including: a processor, a memory, a communication interface, and a communication bus, and the processor, the memory, and the communication interface complete mutual communication through the communication bus; The memory is used to store at least one executable instruction, and the executable instruction causes the processor to execute the operations of the panoramic image floating window display method as described above.

[0014] The present invention provides a panoramic image floating window display method, device, and in-vehicle system, and the beneficial effects thereof are as follows: By performing parameter configuration and instruction configuration on the display layer and processing the video stream in the video display channel, the present invention can achieve cropping, display, and control processing of the rounded corner floating window in the QNX system. Avoiding the transfer and processing of the video stream between the QNX system and the Android system not only shortens the link of the video stream, reduces the consumption of the host, but also directly processes the video by the QNX system, which can reduce the duration of display delay and improve user usage safety and user experience.

[0015] The above description is only an overview of the technical solutions of the embodiments of the present invention. In order to be able to understand the technical means of the embodiments of the present invention more clearly, it can be implemented according to the content of the description. And in order to make the above and other purposes, features, and advantages of the embodiments of the present invention more obvious and understandable, the specific embodiments of the present invention are specifically exemplified below. Description of the Drawings

[0016] The accompanying drawings are only used to illustrate the embodiments and are not considered as a limitation to the present invention. Moreover, throughout the drawings, the same reference numerals are used to represent the same components. In the drawings: Figure 1 It shows a schematic flow chart of the panoramic image floating window display method provided in Embodiment 1 of the present invention; Figure 2 It shows a schematic diagram of the QNX system architecture provided in Embodiment 4 of the present invention; Figure 3 It shows a schematic flow chart of parameter configuration for the display layer provided in Embodiment 1 of the present invention; Figure 4 It shows a schematic flow chart of obtaining an input video stream through a video display channel and performing rounded corner processing on the video to generate a display video provided in Embodiment 1 of the present invention; Figure 5 It shows a schematic diagram of the operation interface of the in-vehicle system provided in Embodiment 1 of the present invention; Figure 6 It shows a schematic flow chart of listening for and processing input control events and processing the display layer according to the control events provided in Embodiment 1 of the present invention; Figure 7 It shows a schematic flow chart of the panoramic image floating window display device provided in Embodiment 2 of the present invention; Figure 8 It shows a schematic diagram of the structure of the in-vehicle system provided in Embodiment 3 of the present invention. Detailed Embodiments

[0017] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein.

[0018] Embodiment 1: Figure 1 It shows an embodiment of a panoramic image floating window display method of the present invention. This method is applied to an in-vehicle system. In the panoramic image floating window, the QNX system can be started and the display layer of the QNX system can be displayed through passive methods such as turning on the turn signal, reversing, changing lanes, etc. and an active opening method. Specifically, this method includes: 110. Obtain the display layer of the QNX system, and perform parameter configuration and instruction configuration on the display layer. Specifically, for step 110, the parameter configuration of the display layer includes: setting the display hierarchy of the display layer to the top display; setting the transparency of the display layer, setting the display layer to allow transparency setting and display through the Android desktop by using the OpenWFD API, setting the content of the display layer to allow transparent display on top of other contents of the Android desktop through the Screen API, and setting the graphics blending mode through OpenGL ES.

[0019] 120. Create an independent video display channel, obtain the input video stream through the video display channel, perform rounded corner processing on the video to generate a target video, and display the target video through the display layer. Specifically, for step 120, creating an independent video display channel specifically includes creating a video display channel through the WFD module, configuring the video display channel, and establishing connections between the video display channel, the video acquisition interface, and the display layer. Obtaining the input video stream through the video display channel and performing rounded corner processing on the video to generate a display video specifically includes: obtaining the input video stream from the video acquisition interface; selecting the rounded corner area in the video stream, and performing transparency processing on the pixel points outside the rounded corner area to generate a target video.

[0020] 130. Listen for and process the input control events, and process the display layer according to the control events. Specifically, for step 130, listening for and processing the control events and processing the display layer according to the control events specifically includes: listening for the input signals of the in-vehicle system, and judging whether it is a control event of the display layer according to the input signals. If so, process the display layer according to the control event, otherwise do not process; among them, the control events include at least one or more of touch, click, and drag. Among them, the input control events can be the operation instructions of the touch screen of the screen interface.

[0021] Through parameter configuration and instruction configuration of the display layer and processing of the video stream in the video display channel, the present invention can realize the clipping, display, and control processing of the rounded corner floating window in the QNX system. Avoiding the transfer and processing of the video stream between the QNX system and the Android system not only shortens the video stream link, reduces the host consumption, but also directly processes the video by the QNX system, which can reduce the display delay time and improve the user's use safety and user experience.

[0022] The panoramic image floating window display method provided in the above steps 110 to 130 can be implemented based on each functional module of the QNX system. Among them, the QNX system can be divided into an application layer APP, a middleware layer Middleware, and a board support layer BSP according to the communication hierarchy. See Figure 2In the vehicle system, Android and QNX dual systems can be used. The QNX system is used for displaying and controlling panoramic images, and Android is used to process other vehicle function modules. This embodiment realizes independent processing of panoramic images in the QNX system and can define display areas and styles. The following is a more in-depth description of the application layer, middle layer, and board-level support layer in the QNX system. Figure 2 Display refers to the display and MCU refers to the controller.

[0023] The application layer APP includes a panoramic imaging application, which is used for the display and control of panoramic images. It is a window for user-oriented control event acquisition and content display.

[0024] The middle layer Middleware includes Vcapture AIS Client module, panoramic image service, OpenGL+Screen module, WFD module and SPI Service module. The Vcapture AIS Client module is used to connect to the AIS Server of the board support layer BSP and receive camera data from the AIS Server module. The panoramic image service is connected to the panoramic image application in communication, and the panoramic image service provides the operating environment and basic services for the panoramic image application in the QNX operating system; the panoramic image service is also connected to the Vcapture AIS Client module to obtain the image data collected by the camera. The OpenGL+Screen module is connected to the panoramic image application and the WFD module. The OpenGL+Screen module is used to implement floating windows, specifically to render and display rounded floating windows in the QNX system, use OpenGL for graphics processing, and implement the creation and control of floating windows through Screen. The WFD module is Wi-Fi Display, which is used for wireless connection between mobile phones / mobile PCs or other terminals and TVs / displays; the WFD module of the present invention is connected to the Display Driver module of the board support layer to transmit image data to the display device. The SPI Service module is connected to the panoramic imaging application and the SPI Driver module, and is used to transmit the user's vehicle body data, such as the vehicle body turn signal, to the panoramic imaging application through the SPI protocol.

[0025] The board support layer includes the AIS Servicer module, the Display Driver module, and the SPI Driver module. Among them, the AIS Servicer module is used to interact with the Vcapture AIS Client module to parse and transfer the raw video streams of four cameras; the Display Driver module is used to send image data to the display hardware to ensure that the images can be correctly displayed on the screen. The SPI Driver module is used to interact with the SPI Service module to process the control signals transmitted through the SPI bus.

[0026] Through the communication settings of each module in the application layer, the middle layer, and the board support layer, the present invention can implement panoramic image floating window adjustment and display when the controller executes the relevant control program to achieve the above steps 110 - 130. The present invention generates panoramic image content through the panoramic image application and the panoramic image service, and performs floating window display on the panoramic image content through the OpenGL+Screen module.

[0027] In step 110, parameter configuration is performed on the display layer. Based on Figure 2 the QNX system architecture shown, refer to Figure 3 , the parameter configuration can be performed through the following steps: 111, set the display hierarchy of the display layer. In step 111, set the display hierarchy of the display layer to be on top. Specifically in this embodiment, set the QNX layer on top: through the Screen module, set the z-order of the QNX layer to the highest to ensure that the QNX layer is above other layers.

[0028] 112, set the transparency of the display layer. In step 112, use the OpenWFD API to set the display layer to allow transparency setting and display through the Android desktop, use the Screen API to set the content of the display layer to allow transparent display on top of other content on the Android desktop, and use OpenGL ES to set the graphics blending mode. The specific steps of this embodiment are as follows: Use the OpenWFD API of the WFD module through the QNX system architecture to set WFD_TRANSPARENCY_SOURCE_ALPHA to allow transparency setting of the QNX layer and display through the Android desktop. The purpose of this step is to achieve cross-platform display effects.

[0029] Set the Screen transparency mode: You can set transparency=SCREEN_TRANSPARENCY_SOURCE_OVER through the Screen API of the OpenGL+Screen module, so that the screen content can be displayed transparently above other content.

[0030] Through the OpenGL ES blending mode of the OpenGL+Screen module: Call glBlendFuncSeparate(GL_SRC_ALPHA,GL_ONE_MINUS_SRC_ALPHA, GL_ONE, GL_ONE) to set the blending method of the graphics to achieve the transparency effect. The purpose of this step is to handle the transparency between different layers during the rendering process, especially the display effect of the panoramic image floating window.

[0031] In step 110, configure instructions for the display layer, which specifically includes: obtaining the control events of the QNX system and matching the control events with the input signals of the input devices of the in-vehicle system. For example, when dragging and touching the touch screen, the QNX system recognizes the control event of the drag and makes adaptive adjustments to the floating window of the QNX system according to the drag direction and distance.

[0032] In step 120, creating an independent video display channel specifically includes: creating a video display channel through the WFD module, configuring the video display channel, and establishing connections between the video display channel, the video acquisition interface, and the display layer. In this embodiment, in the panoramic image service, use the WFD module to configure an independent Pipeline, such as Pipeline 9, to provide a dedicated channel for the processing of panoramic images. Through this setting of an independent Pipeline, it is ensured that the video stream processing of panoramic images is completely isolated from other video streams, avoiding conflicts or resource competition. This configuration can optimize the processing efficiency of panoramic images and make full use of hardware acceleration resources to improve the overall performance.

[0033] In step 120, obtain the input video stream through the video display channel and perform rounded corner processing on the video to generate the display video. See Figure 4 Specifically, it includes: 121. Obtain the input video stream from the video acquisition interface; specifically in step 121, define the size and rounded corner radius of the target video window, and determine the rounded corner area through the rounded corner formula, where the rounded corner formula is , where x and y are the coordinates of the current pixel, cx and cy are the coordinates of the center of the rounded corner area of one corner of the target video window, and d is the distance from the current pixel to the center of the circle; judge each pixel point of the target video window, and if the pixel point is outside the rounded corner area, perform transparency processing on the pixel point.

[0034] Select the rounded corner area in the video stream and process the pixel points outside the rounded corner area for transparency to generate the target video. Specifically, it includes: The rounded corner video stream needs to be processed in the GPU to convert the right-angle video stream into rounded corners, and set the transparency of the rounded corner area to 0, so that rounded corner display can be performed. If gradient processing of the rounded corner area is required, it can be achieved through the following steps: 122. Interpolate and calculate the Alpha channel through the fragment shader to define the transparency outside the rounded corner area to gradually change with the distance. In step 122, the following gradient formula is used for gradient: , where r is the radius of the rounded corner, d is the distance from the current pixel to the center of the circle, and δr is the width of the gradient area; when d is less than r - , the transparency of the pixel point is opaque. When d is equal to r, the transparency is transparent. When d is between r – and r, the transparency of the pixel point smoothly transitions according to a cubic interpolation curve.

[0035] In the present invention, after the display layer of the QNX system is set through step 110, the holographic image content can be displayed through steps 121 - 122, so that the holographic image content is displayed on the main vehicle system interface through the display layer. At the same time, through steps 121 - 122, the cropping, display, and control processing of the video content with a rounded corner floating window are realized. Avoiding the transfer and processing of the video stream between the QNX system and the Android system not only shortens the video stream link and reduces the host consumption, but also the QNX system directly processes the video, which can reduce the duration of display delay and improve the user's usage safety and user experience.

[0036] After step 120 is set, it is also necessary to set a close button at a preset position on the display layer and overlay the close button on the target video. In this embodiment, load the close button material: OpenGL module, and on the GPU, load and overlay the graphic material of the close button at the specified position on the panoramic video stream. The preset position can be within the rounded corner at the upper left corner of the display layer.

[0037] After steps 110 - 120 are completed, when the QNX system triggers the display, the display layer pops up on the main vehicle system to display the holographic image content. See 5 specifically, Figure 5 For the operation interface of the vehicle system, the QNX system can be a dual system with the main vehicle system or parasitize in the main vehicle system, and the main vehicle system can be an Android system. Such as Figure 3As shown, the Android operating interface is the main interface. A display layer of the QNX system is set in the upper left corner of the Android operating interface for holographic image display. The display layer is placed on the top display layer, and the real layer can be set through the corresponding steps of step 130.

[0038] In step 130, the control event is monitored and processed, and the display layer is processed according to the control event. Figure 6 , including: 131, monitoring the input signal of the vehicle system, and judging whether it is a control event of the display layer according to the input signal; 132, if the display layer is processed according to the control event; 133, otherwise no processing is performed.

[0039] In the present invention, the QNX system can be a dual system with the vehicle host system or parasitic in the vehicle host system, and the vehicle host system can be an Android system; the QNX system and the Android system can share input devices, such as touch screens, mechanical buttons, etc.; the QNX system can also monitor the input signal in the Android system. If the input signal matches the built-in instruction of the QNX system, it is identified as the instruction of the QNX system, and the control event operation is performed through the input signal. If a drag signal is recognized when the QNX system is displayed, the floating window of the QNX system can be adjusted according to the specific drag direction and distance of the drag signal. In addition, the control event includes at least one or more of touch, click, and drag. In this embodiment, through steps 131-133, the present invention monitors the event of the screen window, rewrites the logic of event messages such as touch, move, and release, for example, clicks on the close button map area, and closes the screen window, thereby realizing the functions of closing the floating window, dragging the floating window, and enlarging the floating window to full screen. In a specific example, when it is detected that the user clicks the close button area, screen_destroy_window() is called to close the floating window; when a drag event is detected, the position coordinates of the window are updated; when a zoom event is detected, screen_fullscreen_window() is called to enlarge the floating window to full screen display.

[0040] Embodiment 2: Figure 7 An embodiment of a panoramic image floating window display device is shown. The panoramic image floating window display device can be used to perform steps 110 to 130 in embodiment 1, specifically including: The display layer configuration module 210 is used to execute step 110 of Embodiment 1, and specifically includes: performing parameter configuration on the display layer, including: setting the display hierarchy of the display layer to be top - most display; setting the transparency of the display layer. By using the OpenWFD API, the display layer is set to allow transparency setting and display through the Android desktop. Through the Screen API, the content of the display layer is set to allow transparent display on top of other content on the Android desktop, and the graphics blending mode is set through OpenGL ES; The video acquisition and processing module 220 is used to execute step 120 of Embodiment 1, and specifically includes: creating an independent video display channel, which specifically includes creating a video display channel through the WFD module, and configuring the video display channel to establish connections between the video display channel, the video acquisition interface, and the display layer. Obtaining the input video stream through the video display channel and performing rounded - corner processing on the video to generate a display video, which specifically includes: obtaining the input video stream from the video acquisition interface; selecting the rounded - corner area in the video stream, and performing transparency processing on the pixel points outside the rounded - corner area to generate a target video; The monitoring and control module 230 is used to execute step 130 of Embodiment 1, and specifically includes: monitoring and processing control events, and processing the display layer according to the control events, which specifically includes: monitoring the input signal of the in - vehicle system, and judging whether it is a control event of the display layer according to the input signal. If so, processing the display layer according to the control event, otherwise not processing; among them, the control events at least include any one or more of touch, click, and drag.

[0041] The panoramic image floating window display device may include an application layer, an intermediate layer, and a board support layer. Specifically, the application layer includes a panoramic image application for the display and control of panoramic images. The intermediate layer includes a Vcapture AIS Client module, a panoramic image service, an OpenGL+Screen module, a WFD module, and an SPI Service module. Among them, the Vcapture AIS Client module is used to receive camera data from the AIS Server and deliver the data to the panoramic image service for processing. The panoramic image service is used for functions such as the stitching and fusion algorithm of panoramic images; the OpenGL+Screen module implements the floating window. Specifically, in the QNX system, it renders and displays a rounded-corner floating window, uses OpenGL for graphics processing, and creates and controls the floating window through Screen. The WFD module is used to transmit image data to the display device. The SPI Service module is used to transfer vehicle body data, such as vehicle body steering signals, to the panoramic image application through the SPI protocol. The board support layer includes an AIS Servicer module, a DisplayDriver module, and an SPI Driver module. Among them, the AIS Servicer module is used to interact with the Vcapture AIS Client module, parse and transfer the raw video streams of four cameras; the Display Driver module is used to send image data to the display hardware to ensure that the image can be correctly displayed on the screen. The SPI Driver module is used to interact with the SPI Service module to process the control signals transmitted through the SPI bus.

[0042] By configuring parameters and instructions for the display layer and processing the video stream in the video display channel, the present invention can achieve the cropping, display, and control processing of the rounded-corner floating window in the QNX system. Avoiding the transfer and processing of the video stream between the QNX system and the Android system not only shortens the link of the video stream, reduces the host consumption, but also directly processes the video by the QNX system, which can reduce the duration of display delay and improve the user's usage safety and user experience.

[0043] Embodiment 3: Figure 8 The structural schematic diagram of the embodiment of the vehicle-mounted system of the present invention is shown. The specific implementation of the vehicle-mounted system in the specific embodiment of the present invention is not limited.

[0044] As Figure 8 shown, the vehicle-mounted system may include: a processor, a communications interface, a memory, and a communication bus.

[0045] Among them: The processor 310, the communication interface 340, and the memory 320 complete their mutual communication through the communication bus 330. The communication interface is used to communicate with network elements of other devices such as clients or other servers. The processor is used to execute the program 350, and specifically can execute the relevant steps in the above-mentioned embodiments of the vehicle-mounted key storage method.

[0046] Specifically, the program may include program code, and the program code includes computer-executable instructions.

[0047] The processor may be a central processing unit CPU, or a specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present invention. One or more processors included in the vehicle-mounted system may be of the same type of processor, such as one or more CPUs; or may be of different types of processors, such as one or more CPUs and one or more ASICs.

[0048] The memory is used to store the program. The memory may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.

[0049] The program can specifically be called by the processor to make the vehicle-mounted system execute Figure 1 Steps 110 - 130.

[0050] By performing parameter configuration and instruction configuration on the display layer and processing the video stream in the video display channel, the present invention can achieve the cropping, display, and control processing of the rounded floating window in the QNX system. Avoiding the transfer and processing of the video stream between the QNX system and the Android system not only shortens the link of the video stream, reduces the consumption of the host, but also directly processes the video by the QNX system, which can reduce the duration of display delay and improve the user's usage security and user experience.

[0051] The algorithms or displays provided herein are not inherently related to any specific computer, virtual system, or other device. In addition, the embodiments of the present invention are not directed to any specific programming language.

[0052] In the description provided herein, numerous specific details are set forth. It will be understood, however, that embodiments of the invention may be practiced without these specific details. Similarly, in order to streamline the present invention and assist in understanding one or more of the various inventive aspects, in the foregoing description of exemplary embodiments of the invention, various features of the embodiments of the invention are sometimes grouped together in a single embodiment, figure, or description thereof. In which case, the claims following the detailed description are hereby expressly incorporated into the detailed description, where each claim stands on its own as a separate embodiment of the invention.

[0053] Those skilled in the art will appreciate that the modules in the devices in the embodiments can be adaptively changed and disposed in one or more devices different from the embodiments. The modules or units or components in the embodiments can be combined into one module or unit or component, and in addition, they can be divided into multiple sub-modules or sub-units or sub-components. Except that at least some of such features and / or processes or units are mutually exclusive.

[0054] It should be noted that the above embodiments illustrate the present invention rather than limit the present invention, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in the claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention can be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim listing several devices, several of these devices may be embodied by the same item of hardware. The use of the words first, second, and third, etc. does not denote any order. These words can be interpreted as names. The steps in the above embodiments, unless otherwise specified, should not be construed as limiting the order of execution.

Claims

1. A method for displaying a panoramic image floating window, characterized in that: The method comprises: Obtaining a display layer of the QNX system, and performing parameter configuration and instruction configuration on the display layer; Creating an independent video display channel, obtaining an input video stream through the video display channel, performing rounding processing on the video to generate a target video, and displaying the target video through a display layer; Listen to and process input control events, and process the display layer according to the control events.

2. The method for displaying a panoramic image floating window according to claim 1, characterized in that: Parameter configuration is performed on the display layer, specifically including: Performing display hierarchy setting for the display layer, and setting the display hierarchy of the display layer to be top display; The transparency of the display layer is set by using the OpenWFD API to set the display layer to allow transparency setting and display through the Android desktop, setting the display layer content through the Screen API to allow it to be displayed transparently on other content of the Android desktop, and setting the graphics blending mode through OpenGL ES.

3. The method for displaying a panoramic image floating window according to claim 2, characterized in that: Create an independent video display channel, including: A video display channel is created through the WFD module, and the video display channel is configured, and the video display channel is connected to the video acquisition interface and the display layer.

4. The method for displaying a panoramic image floating window according to claim 3, characterized in that: The input video stream is obtained through the video display channel, and the video is rounded to generate a display video, specifically including: Acquire the input video stream from the video acquisition interface; A rounded corner area in the video stream is selected, and transparency processing is performed on pixel points outside the rounded corner area to generate a target video.

5. The method for displaying a panoramic image floating window according to claim 4, characterized in that: The selecting of the rounded corner area in the video stream specifically includes: Define the size and fillet radius of the target video window, and determine the fillet area using a fillet formula, where the fillet formula is: , where x, y are the coordinates of the current pixel, cx, cy are the coordinates of the center of the rounded area of ​​one corner of the video window, and d is the distance from the current pixel to the center of the circle; Each pixel point of the target video window is judged, and if the pixel point is outside the rounded corner area, transparency processing is performed on the pixel point.

6. The method for displaying a panoramic image floating window according to claim 5, characterized in that: The transparency processing of the pixels outside the rounded corner area specifically includes: The Alpha channel is interpolated through the fragment shader to define the transparency outside the rounded area to change with distance: , where r is the fillet radius, d is the distance from the current pixel to the center of the circle, and δr is the width of the gradient area; When d is less than r - When d is equal to r, the transparency of the pixel is opaque. When d is equal to r, the transparency is transparent. When d is within the r – To r, the transparency of the pixels is smoothly transitioned according to the cubic interpolation curve.

7. The method for displaying a panoramic image floating window according to claim 5, characterized in that: A close button is set at a preset position of the display layer, and the close button is superimposed on the target video.

8. The method for displaying a panoramic image floating window according to claim 1, characterized in that: The monitoring and processing of the input control event, and processing the display layer according to the control event, specifically includes: Monitor the input signal of the vehicle system, and determine whether it is a control event of the display layer according to the input signal. If so, process the display layer according to the control event, otherwise do not process it; wherein the control event includes at least one or more of touch, click, and drag.

9. A panoramic image floating window display device, characterized in that: The device comprises: A display layer configuration module is used to obtain the display layer of the QNX system and perform parameter configuration and instruction configuration on the display layer; The video acquisition and processing module is used to create an independent video display channel, acquire the input video stream through the video display channel, perform rounding on the video to generate a target video, and display the target video through a display layer; The monitoring control module is used to monitor and process input control events, and process the display layer according to the control events.

10. A vehicle computer system, characterized in that: include: A processor, a memory, a communication interface and a communication bus, wherein the processor, the memory and the communication interface communicate with each other via the communication bus; The memory is used to store at least one executable instruction, and the executable instruction enables the processor to perform the operation of the panoramic image floating window display method as described in any one of claims 1-8.

Images