Display method, display system, vehicle, electronic device, medium, and program product

Abstract

This disclosure relates to a display method, display system, vehicle, electronic device, medium, and program product. The display method includes: responding to a cutout command, performing a cutout process on at least one graphics layer in a first operating system to obtain first on-screen content, the first on-screen content including a cutout area; acquiring second on-screen content in a second operating system, the second operating system being different from the first operating system; and displaying a target image, the target image being determined based on the first on-screen content and the second on-screen content, in which the second on-screen content can be displayed through the cutout area. Thus, by performing a cutout process on at least one graphics layer, various layer interleaving requirements can be met on the same display screen, satisfying different display needs.

Description

Technical Field

[0001] This disclosure relates to the field of display technology, and more specifically, to a display method, display system, vehicle, electronic device, medium, and program product. Background Technology

[0002] With the continuous development of smart cockpit technology, the number of operating systems within vehicle cockpits is gradually increasing, and each operating system performs different functions. For example, the Android operating system is mainly responsible for running audio-visual entertainment applications, while the Linux operating system focuses on managing vehicle control applications. However, this parallel operation of multiple operating systems has led to screen resource allocation issues. Currently, in-vehicle display technology is constantly upgrading, with large screens or multi-screen displays gradually becoming the mainstream configuration. In this situation, applications managed by different operating systems may need to be displayed simultaneously on limited screen space, resulting in a dual-domain (i.e., different operating systems) competition for screen resources. This problem urgently needs to be solved to ensure the normal operation of various functional applications within the cockpit and to improve the user experience. Summary of the Invention

[0003] In order to overcome the problems existing in the related technologies, this disclosure provides a display method, display system, vehicle, electronic device, medium and program product.

[0004] To achieve the above objectives, a first aspect of this disclosure provides a display method, the method comprising: In response to a hole-punch command, in a first operating system, a hole-punch process is performed on at least one graphics layer to obtain first on-screen content, the first on-screen content including the hole-punch area. Obtain the second on-screen content from the second operating system, which is different from the first operating system; The target image is displayed, which is determined based on the first screen content and the second screen content, wherein the second screen content can be displayed through the cutout area in the target image.

[0005] Optionally, in response to the hole-punch command, in the first operating system, hole-punch processing is performed on at least one graphics layer to obtain the first on-screen content, including: In response to the hole-drilling command, the target graphics layer is determined in the first operating system; Holes are punched into the target graphic layer and the graphic layer below the target graphic layer to obtain the first on-screen content.

[0006] Optionally, determining the target graphics layer in the first operating system in response to the hole-drilling command includes: In response to the hole-drilling command, the target graphics layer is determined from the pre-marked graphics layers in the first operating system.

[0007] Optionally, there are multiple pre-marked graphic layers, and determining the target graphic layer from the pre-marked graphic layers includes: Based on the priority of the second on-screen content, a target graphic layer that matches the second on-screen content is determined from a plurality of pre-marked graphic layers.

[0008] Optionally, determining the target graphics layer in the first operating system in response to the hole-drilling command includes: In response to the digging command, determine the current target digging type; The target graphics layer is determined in the first operating system based on the target hole type.

[0009] Optionally, the step of performing hole-punching on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content includes: Determine the target excavation strategy that matches the target excavation type; According to the target hole-cutting strategy, hole-cutting processing is performed on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content.

[0010] Optionally, the target excavation type includes any of the following: Global hole-punching refers to setting both the first graphic layer and the graphic layer below the first graphic layer to be transparent. The first graphic layer is a pre-marked graphic layer corresponding to the global hole-punching. Control hole-cutting refers to setting both the second graphic layer and the graphic layer located below the second graphic layer to be transparent. The second graphic layer is a pre-marked graphic layer corresponding to the control hole-cutting and has a host graphic layer. Partial hole-cutting refers to setting a specific area of ​​the third graphic layer and the graphic layer below the third graphic layer to transparent. The third graphic layer is a pre-marked graphic layer corresponding to the partial hole-cutting.

[0011] Optionally, the target hole type is a global hole, and the target graphic layer is a first graphic layer; the first on-screen content does not include the content of the first graphic layer and the graphic layer located below the first graphic layer.

[0012] Optionally, the target hole-punch type is a global hole-punch, and the target graphic layer is a first graphic layer; the step of performing hole-punch processing on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content includes: Holes are drilled in the entire area of ​​the first graphic layer and the graphic layer located below the first graphic layer; If there is a graphic layer above the first graphic layer, the first on-screen content is obtained based on the graphic layer located above the first graphic layer.

[0013] Optionally, when there is no graphic layer above the first graphic layer, the entire area of ​​the first on-screen content is the cutout area.

[0014] Optionally, the target hole type is a control hole, and the target graphic layer is a second graphic layer; the first on-screen content does not include the content of the second graphic layer and the graphic layer located below the second graphic layer, but includes at least the content of the host graphic layer of the second graphic layer.

[0015] Optionally, the target cutout type is a control cutout, and the target graphic layer is a second graphic layer; the step of performing cutout processing on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content includes: Holes are created in the entire area of ​​the second graphic layer and the graphic layer located below the second graphic layer; The first on-screen content is obtained based on the graphics layer located above the second graphics layer, wherein the graphics layer located above the second graphics layer includes at least the host graphics layer of the second graphics layer.

[0016] Optionally, obtaining the first on-screen content based on the graphics layer located above the second graphics layer includes: If a graphics layer exists above the host graphics layer, the first on-screen content is obtained based on the host graphics layer and the graphics layer located above the host graphics layer; or If there is no graphics layer above the host graphics layer, the first on-screen content is obtained based on the host graphics layer.

[0017] Optionally, the second graphics layer is a graphics layer used to display Surface View controls.

[0018] Optionally, the target hole type is a partial hole, and the target graphic layer is a third graphic layer; the first screen content includes the content of the third graphic layer and the other areas of the graphic layer located below the third graphic layer, excluding the hole area.

[0019] Optionally, the target hole-punch type is a partial hole-punch, and the target graphic layer is a third graphic layer; the step of performing hole-punch processing on the target graphic layer and the graphic layer located below the target graphic layer according to the target hole-punch strategy to obtain the first on-screen content includes: The graphic layer located below the third graphic layer is synthesized to obtain the first synthesized graphic layer; The location and size of the excavation area are determined based on the third graphic layer; According to the location and size of the hole-cutting area, the first composite graphic layer is processed to cut holes to obtain the second composite graphic layer; The first on-screen content is obtained based at least on the second composite graphics layer.

[0020] Optionally, obtaining the first on-screen content based at least on the second composite graphics layer includes: If there is a graphic layer above the third graphic layer, the first on-screen content is obtained based on the second composite graphic layer and the graphic layer located above the third graphic layer.

[0021] Optionally, the step of performing hole-cutting processing on the first composite graphic layer according to the position and size of the hole-cutting area to obtain the second composite graphic layer includes: The first composite graphic layer is blended with the transparent rectangle to obtain a second composite graphic layer, wherein the position of the transparent rectangle in the first composite graphic layer is the position of the cutout area, and the size of the transparent rectangle is the size of the cutout area.

[0022] Optionally, determining the location and size of the excavation area based on the third graphic layer includes: The location of the third graphic layer within the graphic layer below the third graphic layer is defined as the location of the hole-digging area; The size of the third graphic layer is determined as the size of the hole-cutting area.

[0023] Optionally, determining the location and size of the excavation area based on the third graphic layer includes: Obtain pre-configured hole-drilling area information, wherein the hole-drilling area information represents the position and size of the hole-drilling area in the third graphics layer; Based on the information about the excavated area, the location and size of the excavated area are determined in the third graphic layer.

[0024] Optionally, the display screen for displaying the target image includes a first screen layer and a second screen layer, with the first screen layer located above the second screen layer; the display method further includes: Display the content of the first upper screen in the first screen layer; Display the content of the second upper screen in the second screen layer; The first screen layer and the second screen layer are overlaid to obtain the target image.

[0025] Optionally, the first operating system and the second operating system are deployed inside the vehicle, and the step of determining the current target digging type in response to a digging command includes: In response to the digging command, determine the current driving status of the vehicle; Based on the driving status, determine the current target excavation type.

[0026] Optionally, determining the current target excavation type based on the driving state includes at least one of the following: If the driving state is a parked state or a reverse state, then the current target digging type is determined to be a global digging. If the driving state is a parking state, then the current target excavation type is determined to be a partial excavation. If the driving state is a turning state and the driving speed is less than or equal to a preset threshold, then the current target hole-digging type is determined to be control hole-digging.

[0027] A second aspect of this disclosure provides a display system on which a first operating system and a second operating system are running, and the display system includes a display screen; The display screen is used to display a target image, which is determined based on a first on-screen content and a second on-screen content in the second operating system. The first on-screen content is obtained by punching holes in at least one graphics layer in the first operating system, and the first on-screen content includes a punched-hole area. The second on-screen content can be displayed in the target image through the punched-hole area.

[0028] A third aspect of this disclosure provides a vehicle that includes the display system provided in the second aspect of this disclosure.

[0029] A fourth aspect of this disclosure provides an electronic device, the electronic device comprising: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the steps of the display method described in the first aspect of this disclosure.

[0030] The fifth aspect of this disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the display method described in the first aspect of this disclosure.

[0031] A sixth aspect of this disclosure provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the display method described in the first aspect of this disclosure.

[0032] Through the above technical solution, at least one graphics layer in the first operating system is punched out to obtain first on-screen content, which includes the punched-out area. Simultaneously, second on-screen content from the second operating system is acquired. Finally, a target image determined based on the first and second on-screen contents is displayed, and the second on-screen content is visible through the punched-out area within the target image. Thus, by punching out at least one graphics layer, various layer interleaving requirements can be met on the same display screen, satisfying different display needs.

[0033] Other features and advantages of this disclosure will be described in detail in the following detailed description section. Attached Figure Description

[0034] The accompanying drawings are provided to further illustrate the present disclosure and form part of the specification. They are used together with the following detailed description to explain the present disclosure, but do not constitute a limitation thereof. In the drawings: Figure 1 This is a schematic diagram illustrating a virtualization framework according to an exemplary embodiment.

[0035] Figure 2 This is a schematic diagram illustrating a QNX virtualization framework according to an exemplary embodiment.

[0036] Figure 3 This is a schematic diagram illustrating a display scenario according to an exemplary embodiment.

[0037] Figure 4 This is a flowchart illustrating a display method according to an exemplary embodiment.

[0038] Figure 5 This is a flowchart illustrating the determination of the first content to be displayed in a global hole-punching scenario according to an exemplary embodiment.

[0039] Figure 6 This is a schematic diagram illustrating a global hole-digging method according to an exemplary embodiment.

[0040] Figure 7 This is a flowchart illustrating the determination of the first content to be displayed in a control cutout scenario, according to an exemplary embodiment.

[0041] Figure 8 This is a schematic diagram illustrating a control with a hole cut out according to an exemplary embodiment.

[0042] Figure 9 This is a flowchart illustrating the determination of the first on-screen content in a partial hole-cutting scenario according to an exemplary embodiment.

[0043] Figure 10This is a schematic diagram illustrating a partial excavation according to an exemplary embodiment.

[0044] Figure 11 This is a rendering illustrating a partial excavation according to an exemplary embodiment.

[0045] Figure 12 This is a block diagram illustrating a display device according to an exemplary embodiment.

[0046] Figure 13 This is a block diagram illustrating a vehicle according to an exemplary embodiment. Detailed Implementation

[0047] The specific embodiments of this disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are for illustration and explanation only and are not intended to limit this disclosure. The embodiments of this disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0048] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0049] The term "comprising" and its variations as used herein are open-ended inclusions, meaning "including but not limited to." The term "based on" means "at least partially based on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments." Definitions of other terms will be given in the description below.

[0050] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0051] Figure 1 This is a schematic diagram illustrating a virtualization framework according to an exemplary embodiment. For example... Figure 1As shown, a hypervisor runs on the hardware, and a Linux operating system and an Android operating system run on the hypervisor. The Linux operating system hosts applications such as vehicle control and panoramic imaging; the Android operating system hosts applications such as music, video, and navigation. Since the Linux operating system hosts vehicle control-related applications, therefore, as... Figure 1 As shown, the Linux operating system is the host operating system, and the Android operating system is the guest operating system.

[0052] It should be understood that, such as Figure 1 As shown, Virtio GPU runs on the Hypervisor, the Android operating system, and the Linux operating system. Virtio GPU is a virtualization technology used to achieve efficient graphics processing and display functions in virtual machines (VMs).

[0053] In the current automotive industry, some automakers have widely adopted the QNX virtualization solution in terms of virtualization technology application. Figure 2 This is a schematic diagram illustrating a QNX virtualization framework according to an exemplary embodiment. Figure 2 As shown, the cockpit runs three operating systems: Linux, Android, and QNX. QNX is the host operating system, while Linux and Android are the guest operating systems.

[0054] Reference Figure 2 In the Android operating system, each Virtual Display corresponds to one QNX Window. For example, Virtual Display 1 in Android corresponds to Screen window 1, and Virtual Display 2 corresponds to Screen window 2. Similarly, each Virtual Display in the Linux operating system also corresponds to one QNX Window; for example, Virtual Display 1 in Linux corresponds to Screen window 3. In this scheme, the display of graphics requires two overlays: the first in the Android operating system and the second in the QNX operating system. This results in high graphics display overhead and poor performance.

[0055] In the QNX operating system, the content displayed in the Screen window is shown on the Physical Display. During this process, layers from the Android operating system and layers from the Linux operating system can be overlaid. Specifically, during the overlay, the Linux operating system layer is placed on top of the Android operating system layer. For example... Figure 2 As shown, the Linux operating system's layer corresponding to Screen window 3 is located above the Android operating system's layer corresponding to Screen window 2. In other words, the content displayed by Linux's Virtual Display 1 is above the content displayed by Android's Virtual Display 2. Here, Virtual Display refers to a virtual screen. Figure 2 In this process, the graphical content of the Android operating system is passed to the QNX operating system through a virtual screen, and the latter performs secondary overlay.

[0056] This approach cannot satisfy diverse layering requirements. For example, it cannot accommodate the need for an Android operating system layer to be nested within a Linux operating system layer, nor can it display a panoramic image layer from the Linux operating system on top of the navigation bar layer from the Android operating system, while simultaneously displaying the Android operating system's phone layer on top of the panoramic image layer from the Linux operating system.

[0057] In view of this, the present disclosure provides a display method, electronic device, vehicle, storage medium, and program product. In a first operating system, at least one graphics layer is subjected to a punch-hole processing to obtain first on-screen content, and the first on-screen content includes a punch-hole area. A second on-screen result is obtained from a second operating system. In the final displayed target image, the second on-screen content can be displayed through the punch-hole area. Thus, by punching holes in at least one graphics layer, various layer interleaving requirements can be met on the same display screen, satisfying different display needs.

[0058] Before describing the display method provided in this disclosure in detail, the terminology related to the embodiments of this application will first be introduced.

[0059] Hole-cutting: Using certain methods, at least one graphics layer of the first operating system is made fully or partially transparent, revealing the content of the second operating system located below.

[0060] Layer: Graphics layer.

[0061] Wayland is a modern display server protocol primarily used to handle graphics display tasks within the operating system, offering advantages such as high efficiency, simplicity, and security.

[0062] DRM (Direct Rendering Manager) is a kernel framework used to manage graphics hardware and display devices.

[0063] HWC (Hardware Composer): is a key component in the Android operating system used for graphics compositing. Its core purpose is to optimize graphics rendering performance and reduce power consumption through hardware acceleration.

[0064] Surface Flinger: The module in the Android operating system responsible for layer compositing.

[0065] Composite: The visible layers are stacked on the screen in Z-order order using certain methods and then displayed.

[0066] GPU (Graphics Processing Unit) compositing: The GPU draws the content of the layer into the FBT, and the FBT then overlays it with other non-GPU-composited layers before displaying it on the screen.

[0067] FBT (Frame Buffer Target): The output result synthesized by the GPU.

[0068] Surface View: A control in the Android operating system that has its own Layer.

[0069] Screen Plane: A screen can be divided into different screen layers in terms of hardware. After the software sends the content to different planes, the hardware overlays the images, and the result of the overlay is the final content displayed on the screen.

[0070] Figure 3 This is a schematic diagram illustrating a display scenario according to an exemplary embodiment. The display scenario includes a first operating system and second operation information. Figure 3 As shown, the first operating system can be the Android operating system, and the second operating system can be the Linux operating system.

[0071] Operating system architecture includes the application (APP) layer, framework layer, hardware abstraction layer (HAL), and driver layer.

[0072] Optionally, the APP layer may include, for example, music applications, video applications, navigation applications, camera applications, e-shopping applications, etc. The framework layer is the logical scheduling layer of the operating system architecture; it is capable of resource scheduling and strategy allocation for the video processing process. For example, the framework layer includes: The Graphics Framework is responsible for the layout of the graphics window and the rendering of graphics data. It stores the rendered graphics data in the Graphics Buffer and sends the graphics layer data from the Graphics Buffer to the Surface Flinger. The Graphics Buffer stores graphics data or graphics layer data. Graphics layer data can include, for example, bullet screen data, subtitle data, navigation bar, status bar, icon layers, floating windows, application display interface or logo information, and other data that is generated after the application starts. The graphics data in the Graphics Buffer can come from multiple applications.

[0073] The Multimedia Framework is responsible for decoding the video stream and sending the decoded data to Surface Flinger.

[0074] Surface Flinger manages the various layers, receiving the Graphic Buffer and Video Buffer from each layer, and overlaying graphics layers using a Graphics Processing Unit (GPU) or hardware compositor. The graphics layer data overlaid by Surface Flinger is stored in a Frame buffer (a buffer used to store composite graphics layer data, which is synthesized from multiple graphics layer data), and the data in the Frame buffer can be read and displayed on the screen.

[0075] HAL (Hardware Interface) is the interface layer between the operating system software and audio / video hardware devices. HAL provides an interface for interaction between upper-layer software and lower-layer hardware. The HAL layer abstracts the underlying hardware into software containing corresponding hardware interfaces. By accessing the HAL layer, settings for the underlying hardware devices can be configured, such as enabling or disabling related hardware devices. The driver layer is used to directly control the underlying hardware devices based on the control information input from the HAL. For example, HAL includes a Hardware Composer (HWC) abstraction and a Media Hardware (Media HW) abstraction; correspondingly, the driver layer includes a hardware compositing driver and a media hardware driver. HWC is used for hardware compositing of multiple graphics layers, providing support for hardware compositing in SurfaceFlinger, and storing the composited graphics layers in a frame buffer before sending them to the display driver. Media HW is responsible for processing video layer data and informing the display driver of the processed video layers and their position information. Media HW is a dedicated hardware circuit used to improve video display quality. It should be understood that different manufacturers may use different names for media hardware. It should be understood that the HWC abstraction in the HAL layer corresponds to the hardware composition driver in the driver layer, and the media hardware abstraction corresponds to the media hardware driver. By accessing the HWC abstraction in the HAL layer, control of the underlying HWC hardware can be achieved through the hardware composition driver. Similarly, control of the underlying Media HW can be achieved by accessing the media hardware abstraction and media hardware driver in the HAL layer.

[0076] The driver layer also includes GPU driver and display driver. GPU driver is responsible for rendering and overlaying graphics, while display driver is responsible for compositing video and graphics layers and sending the composited result to the display.

[0077] Reference Figure 3The Android operating system hosts two applications. The graphics layers of the first and second applications are processed sequentially by Surface Flinger, HWC, and DRM to obtain the Android operating system's on-screen content. This content is then sent to the corresponding screen layer on the display screen, i.e., the Android Planes. The Linux operating system hosts two applications. The graphics layers of the third and fourth applications are processed sequentially by Wayland and DRM to obtain the Linux operating system's on-screen content. This content is then sent to the corresponding screen layer on the display screen, i.e., the Linux Planes. In this way, the Android and Linux operating systems do not map to different windows of the host system (such as the QNX operating system) through separate Virtual Displays, avoiding secondary overlay of images by the host system. (See reference...) Figure 3 The Android and Linux operating systems can directly send their respective on-screen content to their respective screen layers for hardware overlay, effectively avoiding the problems of high graphics display overhead and poor performance.

[0078] In this display scenario, the Android and Linux operating systems correspond to different screen layers on the display screen, with Android serving as the UI entry point for the entire cockpit, and the Android Planes situated above the Linux Planes. In this scenario, an increasing number of Linux operating system applications also need to be displayed. Especially considering the overlapping layers of the Android and Linux operating systems, various "holes" need to be created in the Android operating system.

[0079] Figure 4 This is a flowchart illustrating a display method according to an exemplary embodiment. For example... Figure 4 As shown, the display method may include the following steps.

[0080] In step S41, in response to the hole-punch command, at least one graphics layer is punched in the first operating system to obtain first on-screen content, which includes the punched area.

[0081] In this disclosure, at least two different operating systems are deployed on the vehicle or other electronic device performing the display method. These operating systems may be, for example, Android, iOS, or Linux.

[0082] In this disclosure, a hole-punch instruction is used to characterize a user's expectation that display content from different operating systems be interleaved across the same display screen via a graphics layer. For example, a hole-punch instruction can be generated when an application requiring the simultaneous operation of different operating systems is detected. For instance, if an image of a first application in a first operating system is currently being displayed, and a second application in a second operating system is detected to have been launched, a hole-punch instruction is generated. It should be understood that the second application is the one that requires the image to be displayed.

[0083] For example, the "drill a hole" command can be generated based on the user's drilling action. The action can take various forms, including but not limited to: the user triggering the drill control with their finger or a touch device (such as a stylus). For instance, the user can perform the triggering action using finger gestures, such as single-click, swipe, drag, pressure-sensitive, long-press, short-press, area-change gestures, double-press, double-tap, or combinations thereof. Similarly, the user can perform the triggering action using a touch device, such as single-click, double-click, or any number of clicks, or a long press or short press. Furthermore, the drill command can also be input via voice.

[0084] It should be understood that different digging buttons or keywords can be set for different types of digging. For example, a global digging button, a local digging button, or a control digging button can be set separately. As another example, the keyword for global digging can be set to "global digging," the keyword for local digging to "local digging," and the keyword for control digging to "control digging." This allows the type of digging to be determined based on the keywords included in the user's voice input. Furthermore, it is also possible to automatically generate digging commands based on the vehicle's driving status without setting digging buttons or keywords, and to automatically determine the digging type based on the driving status.

[0085] In this disclosure, a vehicle or electronic device executing the display method, upon receiving a cutout instruction, performs a cutout process on at least one graphics layer in a first operating system to obtain first on-screen content. The first on-screen content includes a cutout area, which is typically set to transparent so that when the second display content of the second operating system and the first display content are combined, the second display content can be displayed through the cutout area.

[0086] In step S42, the second screen content in the second operating system is obtained. The second operating system is different from the first operating system.

[0087] For example, the first operating system can be Android, and the second operating system can be Linux. In the Android operating system, at least one graphics layer is punched to obtain the first on-screen content of the Android operating system, and the second on-screen content of the Linux operating system is obtained.

[0088] For example, the second screen content in a Linux operating system can be environmental images captured by an AVM (Around View Monitor).

[0089] The second content displayed on the screen can be content to be displayed from the second operating system. For example, the second content displayed on the screen can also be content obtained by compositing multiple graphics layers in the second operating system, or it can be content processed from a single graphics layer.

[0090] In step S43, a target image is displayed. The target image is determined based on the first screen content and the second screen content. In the target image, the second screen content can be displayed through the cutout area.

[0091] The cutout area can be understood as a transparent area, allowing the content of the second upper screen located below to be displayed through the transparent area of ​​the first upper screen content. The size of the graphic layer included in the second upper screen content can be the same as or different from the size of the cutout area included in the first upper screen content. This disclosure does not limit either aspect. When the sizes are different, part of the content in the second upper screen content can be displayed through the cutout area of ​​the first upper screen content.

[0092] In one embodiment, the display screen for displaying the target image may include a first screen layer and a second screen layer, with the first screen layer positioned above the second screen layer. The display method may further include: Display the first content displayed on the first screen layer; Display the content of the second upper screen in the second screen layer; The first screen layer and the second screen layer are overlaid to obtain the target image.

[0093] For example, the first screen content is sent to the first screen layer, the second screen content is sent to the second screen layer, then the first screen layer and the second screen layer are overlaid to obtain the target image, and finally, the target image is displayed on the display screen.

[0094] In this way, there is no need for secondary overlay in the software (i.e., no need for secondary overlay in the operating system). The first screen content is sent directly to the first screen layer, and the second screen content is sent to the second screen layer. Then, the target image can be obtained by hardware overlay of the first screen layer and the second screen layer, which effectively reduces the graphics display overhead and improves the graphics display performance.

[0095] Using the above technical solution, at least one graphics layer in the first operating system is punched out to obtain first on-screen content, which includes the punched-out area. Simultaneously, second on-screen content from the second operating system is acquired. Finally, a target image determined based on the first and second on-screen contents is displayed, and the second on-screen content is visible through the punched-out area within the target image. Thus, by punching out at least one graphics layer, various layer interleaving requirements can be met on the same display screen, satisfying different display needs.

[0096] In this disclosure, in response to a punch-hole command, punch-hole processing is performed on at least one graphics layer in a first operating system to obtain first on-screen content, which may include: In response to the hole-drilling command, the target graphics layer is determined in the first operating system; Holes are punched into the target graphic layer and the graphic layer below the target graphic layer to obtain the first on-screen content.

[0097] In this process, multiple graphic layers are composited sequentially from bottom to top according to their Z-order. The Z-axis, perpendicular to the screen, represents depth or the stacking order of layers. The order of the graphic layers along the Z-axis determines their display order on the screen. Graphic layers with higher Z-order values ​​are placed on top of those with lower Z-order values. To ensure that the second-screen content located below the first-screen content is displayed, this disclosure not only performs hole-punching on the target graphic layer but also on the graphic layers located below it. Graphic layers located below the target graphic layer are those with Z-order values ​​lower than those of the target graphic layer.

[0098] In addition to the cutout area, the first displayed content also includes pixel data of the target graphic layer and the non-cutout areas in the graphic layer below the target graphic layer. Furthermore, if there is another graphic layer above the target graphic layer, the first displayed result also includes pixel data contained in the graphic layer above the target graphic layer.

[0099] Using the above technical solution, a hole-punch effect is applied to the target graphic layer and the graphic layer below it to obtain the first on-screen content. In this way, both the target graphic layer and the graphic layer below it have hole-punch areas, ensuring that the second on-screen content located below the first on-screen content can be displayed through these hole-punch areas.

[0100] In one implementation, determining the target graphics layer in a first operating system in response to a hole-drilling command includes: determining the target graphics layer from pre-marked graphics layers in the first operating system in response to the hole-drilling command.

[0101] The desired placement of the second on-screen content within the first on-screen content varies depending on the user's display requirements. Therefore, the target graphic layer to be "hole-cut" and the corresponding hole-cutting strategy differ. The target graphic layer is pre-marked. That is, for each display requirement, a target graphic layer is pre-marked, and under that requirement, holes are cut into the target graphic layer and the graphic layers below it according to a pre-defined hole-cutting strategy.

[0102] By adopting the above technical solution, the target graphic layer can be marked in advance. This ensures that the second content on the screen is interspersed in the appropriate graphic layer of the first content on the screen, thereby effectively meeting the user's graphic layer interspersing needs.

[0103] In one possible implementation, if there is one pre-marked graphic layer, then the marked graphic layer can be determined as the target graphic layer.

[0104] It should be understood that when there are multiple hole types in the design, the pre-marked graphic layer is one, meaning that one graphic layer is marked for each hole type. Thus, after determining the target hole type, the marked graphic layer corresponding to that target hole type is determined as the target graphic layer.

[0105] In another possible embodiment, multiple pre-marked graphics layers are used. Accordingly, determining the target graphics layer in the first operating system in response to a hole-drilling command includes: In response to the hole-drilling command, the target graphics layer is determined from the pre-marked graphics layers in the first operating system.

[0106] For example, when multiple graphic layers are pre-marked, the target graphic layer can be determined from among the marked graphic layers based on the priority of the second screen content. For instance, a pre-defined correspondence between marked graphic layers and priorities can be established, where priority is positively correlated with the Z-Order value; that is, the higher the priority of the second screen content, the higher the Z-Order value among the marked graphic layers. For example, if the second screen content has the highest priority in the second operating system, the graphic layer with the largest Z-Order value among the marked graphic layers is determined as the target graphic layer.

[0107] It should be understood that the above refers to a single cutout type. If multiple cutout types are designed, multiple graphic layers can be pre-marked for each cutout type, and the target graphic layer can be determined from the multiple graphic layers according to the priority of the second on-screen content under that cutout type.

[0108] In this way, multiple pre-marked graphic layers are selected. Based on the priority of the content displayed on the second screen, the target graphic layer that matches the content on the second screen is determined from among the pre-marked graphic layers. This further enhances the diversity of layer interleaving and improves the user experience.

[0109] In one embodiment, in response to a hole-drilling command, determining the target graphics layer to be drilled in a first operating system includes: In response to the dig command, determine the current target dig type; The target graphics layer is determined in the first operating system based on the target hole type.

[0110] To meet the different requirements of overlapping graphic layers, various hole types can be designed, with different hole types corresponding to different target graphic layers.

[0111] For example, a target graphic layer is pre-labeled for each type of hole. This way, after determining the current target hole type, the target graphic layer is determined based on that type. The target graphic layers for different hole types can be the same or different.

[0112] By adopting the above technical solution, the target graphic layer to be excavated is determined according to the type of target excavation, thus improving the reliability and convenience of determining the target graphic layer.

[0113] Optionally, a hole-punch process is performed on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content, including: Determine the target excavation strategy that matches the target excavation type; According to the target hole-cutting strategy, hole-cutting processing is performed on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content.

[0114] Different hole-cutting strategies may be preset for different hole-cutting types. Therefore, in order to improve the accuracy of hole-cutting processing, after determining the current target hole-cutting type, a target hole-cutting strategy that matches the target hole-cutting type can be further determined. Then, according to the target hole-cutting strategy, hole-cutting processing is performed on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content.

[0115] Thus, after determining the target hole-punch type and the target graphic layer that matches it, a target hole-punch strategy matching the target hole-punch type can be further determined. Finally, according to the target hole-punch strategy, hole-punch processing is performed on the target graphic layer and the graphic layer below it to obtain the first on-screen content. This further improves the accuracy of hole-punch processing, ensuring that the first on-screen content matching the target hole-punch type can be obtained.

[0116] In this disclosure, considering the requirements for graphics layer interleaving, the designed target hole types include any of the following: global hole; control hole; local hole.

[0117] The "global hole-punch" refers to setting both the first graphic layer and the graphic layer below it to be transparent. The first graphic layer is a pre-marked graphic layer corresponding to the global hole-punch. The "control hole-punch" refers to setting both the second graphic layer and the graphic layer below it to be transparent. The second graphic layer is a pre-marked graphic layer corresponding to the control hole-punch and has a host graphic layer. The "local hole-punch" refers to setting a specific area of ​​the third graphic layer and the graphic layer below it to be transparent. The third graphic layer is a pre-marked graphic layer corresponding to the local hole-punch. It should be understood that the specific area refers to any area specified by the user, also known as the user-specified target area.

[0118] In one embodiment, the user can actively input the desired hole type. For example, assuming a first operating system and a second operating system are deployed within a vehicle, different entry points or buttons for different hole types can be pre-set within the vehicle. The user can input the desired hole type to the vehicle by clicking different entry points or buttons. For instance, the user can click the "Global Hole" button to input "Global Hole," click the "Control Hole" button to input "Control Hole," or click the "Local Hole" button to input "Local Hole."

[0119] In another embodiment, the current target hole-digging type can be automatically determined based on the vehicle's driving status. In this embodiment, a first operating system and a second operating system are deployed within the vehicle, and in response to a hole-digging command, determine the current target hole-digging type, including: In response to the digging command, determine the vehicle's current driving status; Determine the current target excavation type based on the driving status.

[0120] Considering different driving states, users have different display needs. For example, in parked or reversing mode, users expect a full-screen panoramic view of the vehicle. When parked, users expect lower layers to be partially cut out, while surrounding content remains intact; for example, they might want a floating window to be cut out while its surrounding content is still included, or they might want the HOME window to be cut out. The HOME window is typically configured with the FLAG_SHOW_WALLPAPER flag, meaning the wallpaper is used as the background. The status bar and navigation bar also use the wallpaper as the background and apply Gaussian blur. When the HOME window is cut out, the wallpaper around the HOME window needs to be preserved to ensure the Gaussian blur effect of the status bar and navigation bar is not affected. For another example, when the vehicle is turning at low speed, users expect the panoramic view to be displayed in a Surface View. Therefore, the type of cutout desired by users differs depending on the driving state.

[0121] For example, determining the current target digging type based on the driving state includes at least one of the following: If the driving state is a parked state or a reverse state, then the current target digging type is determined to be a global digging. If the driving state is a parking state, then the current target excavation type is determined to be a partial excavation. If the driving state is a turning state and the driving speed is less than or equal to a preset threshold, then the current target hole-digging type is determined to be control hole-digging.

[0122] In this way, when the vehicle is in a parked or reverse driving state, a global hole can be used to display the second-screen content in full screen. When the vehicle is in a parked driving state, a local hole can be used to display the second-screen content in a floating window. When the vehicle is turning and the driving speed is less than or equal to a preset threshold, i.e., low-speed turning, a hole can be used to display the second-screen content in a Surface View graphics layer. This improves the flexibility of the display, meets the different display needs of users, and enhances the user experience.

[0123] For ease of description, the following description will use Android as the first operating system and Linux as the second operating system as an example.

[0124] In one implementation, the target hole type is a global hole, and correspondingly, the target graphic layer is a first graphic layer. Accordingly, the first on-screen content does not include the content of the first graphic layer and the graphic layers located below it. That is, the first on-screen content represents both the first graphic layer and the graphic layers located below it as hole-punch or transparent areas.

[0125] Furthermore, whether the content displayed on the first screen includes the content of the graphics layer depends on whether there is another graphics layer above the first graphics layer. If there is, the content displayed on the first screen includes not only the cutout area but also the content of the graphics layer located above the first graphics layer. If there is no cutout area, the content displayed on the first screen only includes the cutout area.

[0126] For example, during the program development phase, assuming that graphic layer A is marked as the target graphic layer corresponding to the global hole-punch type, then when it is determined that the current hole-punch type is a global hole-punch, graphic layer A is determined as the target graphic layer to be punched. The first screen content does not include the content of graphic layer A and the graphic layers located below graphic layer A.

[0127] Using the above technical solution, under the global hole-punch type, the first screen content does not include the content of the first graphic layer and the graphic layer located below the first graphic layer. Therefore, the first graphic layer and the graphic layer located below the first graphic layer do not affect the display of the second screen content.

[0128] Optionally, the target hole type is a global hole, and the target graphic layer is the first graphic layer. Accordingly, hole-punching is performed on the target graphic layer and the graphic layers below it to obtain the first on-screen content, which may include: Holes are created in the entire area of ​​the first graphic layer and the graphic layer located below the first graphic layer; If there is a graphic layer above the first graphic layer, the first on-screen content is obtained based on the graphic layer located above the first graphic layer.

[0129] In other words, the target hole-digging strategy that matches the global hole-digging type is to dig holes in the entire area of ​​the first graphics layer and the graphics layer below the first graphics layer.

[0130] When creating a global hole, the first graphics layer in the first operating system and the graphics layer below the first graphics layer are removed from the content on the upper screen. That is, when compositing the graphics layer of the first operating system, the first graphics layer and the graphics layer below the first graphics layer are not composited, which is equivalent to setting the first target graphics layer and the graphics layer below the first target graphics layer to transparent.

[0131] At this point, if there is a graphic layer above the first graphic layer, the first content to be displayed is obtained based on the existing graphic layer.

[0132] It should be understood that if there is a graphic layer above the first graphic layer, at least some areas of the graphic layer above the first graphic layer must be transparent in order to ensure that the content on the second screen can be displayed through the transparent areas.

[0133] Figure 5 This is a flowchart illustrating the determination of the first content to be displayed in a global hole-punch scenario, according to an exemplary embodiment. For example... Figure 5 As shown, the steps may include the following.

[0134] In step S51, the marked graphic layer is designated as the first graphic layer that matches the global hole-drilling type.

[0135] The first graphics layer is the graphics layer that needs to be removed from the first operating system. If the first graphics layer is the graphics layer with the highest current Z-Order value in the first operating system, then all graphics layers in the first operating system will be removed.

[0136] In step S52, during the Surfrace Flinger compositing process, the first graphics layer and the graphics layer located below the first graphics layer are skipped.

[0137] In this way, the first graphics layer and the graphics layers located below the first graphics layer will not participate in the final composition and display.

[0138] In step S53, if there is a graphic layer above the first graphic layer, the first on-screen content is obtained based on the graphic layer above the first graphic layer.

[0139] For example, there is a graphics layer above the first graphics layer, such as a Bluetooth phone interface. In this way, the Bluetooth phone interface is sent to the hardware layer corresponding to the first operating system for display.

[0140] In a full-screen hole-punch scenario, there are two types of content displayed on the screen: 1. If there is no graphic layer above the first graphic layer, only the content of the second upper screen will be displayed on the screen; 2. If there is a graphic layer above the first graphic layer, the content of the graphic layer above the first graphic layer and the content of the second upper screen will be displayed on the screen.

[0141] Figure 6 This is a schematic diagram illustrating a global hole-digging method according to an exemplary embodiment. For example... Figure 6As shown, the Z-Order direction of the Z-axis sorting is from bottom to top, and the Z-Order values ​​of the graphics layers increase sequentially. During graphics layer compositing, the compositing order is also from bottom to top. In the global hole-punch scenario, during the compositing process, the first graphics layer and all graphics layers below it do not participate in the compositing. That is, the first on-screen content does not contain the pixel data contained in the first graphics layer and all graphics layers below it.

[0142] First, it should be understood that when creating a global hole, there may or may not be a graphics layer above the first graphics layer. (Refer to...) Figure 6 Assuming there is an Up Layer above the first graphics layer, the Up Layer can be used as the first on-screen content; that is, the first on-screen content includes the pixel data contained in the Up Layer. Assuming the second on-screen content of the second operating system is a panoramic image (AVM), the on-screen content obtained by the display screen includes the first on-screen content of the Up Layer and the second on-screen content of the panoramic image (AVM). At the hardware layer, overlaying the first on-screen content (including the Up Layer) and the second on-screen content (including the panoramic image (AVM)) yields the final target image. In other words, the on-screen result includes the pixel data contained in the Up Layer and the AVM.

[0143] Secondly, it should be understood that there may be multiple graphics layers above the first graphics layer. When there are multiple graphics layers, the composition strategy of the multiple graphics layers above the first graphics layer can be determined based on the number of graphics layers above the first graphics layer and the number of screen layers on the display screen corresponding to the first operating system.

[0144] For example, assuming there are 3 graphic layers above the first graphic layer, and the number of screen layers corresponding to the first operating system on the display screen is 1, then the 3 graphic layers above the first graphic layer need to be combined to obtain a combined graphic layer. This combined graphic layer is the first on-screen content, and the first on-screen content is displayed in the screen layer corresponding to the first operating system.

[0145] For example, assuming there are three graphics layers above the first graphics layer, and the number of screen layers corresponding to the first operating system on the display screen is three, then the three graphics layers above the first graphics layer do not need to be composited. That is, the first screen content includes each graphics layer above the first graphics layer. In this way, the pixel data included in each graphics layer can be sent to the corresponding screen layer according to the Z-Order value of these three graphics layers. For example, if the Z-Order values ​​of the three graphics layers above the first graphics layer are 5, 6, and 7, and the screen layers from bottom to top in the Z-axis direction are screen layer 2, screen layer 3, and screen layer 4, then the pixel data included in the graphics layer with a Z-Order value of 5 can be sent to screen layer 2, the pixel data included in the graphics layer with a Z-Order value of 6 can be sent to screen layer 3, and the pixel data included in the graphics layer with a Z-Order value of 7 can be sent to screen layer 4.

[0146] Furthermore, if the number of screen layers corresponding to the first operating system is greater than the number of graphics layers existing above the first graphics layer, the extra screen layers may not display any content.

[0147] Optionally, when there is no graphic layer above the first graphic layer, the entire area of ​​the first on-screen content is a cutout area.

[0148] If there is no graphics layer above the first graphics layer, it is determined that there is no pixel data for the screen in the first operating system, that is, the entire area represented by the first screen content is a hole-punch area.

[0149] By adopting the above technical solution, in the global hole-punch scenario, the first graphic layer and the graphic layer located below the first graphic layer are not composited, so that the first graphic layer and the graphic layer located below the first graphic layer do not affect the display of the second on-screen content.

[0150] In another implementation, the target cutout type is a control cutout, and correspondingly, the target graphics layer is a second graphics layer. Similarly, the first on-screen content does not include the content of the second graphics layer and the graphics layer located below the second graphics layer, but at least includes the content of the host graphics layer of the second graphics layer.

[0151] In other words, the first on-screen content represents both the first graphic layer and the graphic layer below the first graphic layer as either cutout areas or transparent areas.

[0152] Furthermore, since the second graphic layer marked under the control hole contains a host graphic layer, in this embodiment, the first on-screen content includes at least the content of the host graphic layer of the second graphic layer.

[0153] For example, during the program development phase, assuming that graphics layer B is marked as the target graphics layer corresponding to the control cutout type, then when it is determined that the current cutout type is a control cutout, graphics layer B is determined as the target graphics layer to be cut out. Graphics layer B has a host graphics layer. Furthermore, the host graphics layer is located one layer above graphics layer B.

[0154] Using the above technical solution, under the control hole type, the first screen content does not include the content of the second graphic layer and the graphic layer located below the second graphic layer. Therefore, the second graphic layer and the graphic layer located below the second graphic layer do not affect the display of the second screen content.

[0155] Optionally, the target cutout type is a control cutout, and the target graphic layer is a second graphic layer. Accordingly, the cutout process is applied to the target graphic layer and the graphic layer below it to obtain the first on-screen content, which may include: Holes are created in the entire area of ​​the second graphic layer and the graphic layer located below the second graphic layer; The first on-screen content is obtained based on the graphics layer located above the second graphics layer, wherein the graphics layer located above the second graphics layer includes at least the host graphics layer of the second graphics layer.

[0156] When the control is cut out, the second graphics layer and the graphics layer below the second graphics layer in the first operating system are removed from the content on the upper screen. That is, when the graphics layer of the first operating system is composited, the second graphics layer and the graphics layer below the second graphics layer are not composited. This is equivalent to setting the second target graphics layer and the graphics layer below the second target graphics layer to transparent.

[0157] At this point, the first on-screen content is obtained based on the graphics layer located above the second graphics layer. The graphics layer above the second graphics layer includes at least the host graphics layer of the second graphics layer.

[0158] In one possible approach, the second graphics layer is a graphics layer used to display Surface View controls.

[0159] For example, assuming the first operating system is Android, typically one Activity corresponds to one graphics layer. To control the content displayed on the second screen, a Surface View control is needed. The Surface View control has its own separate graphics layer, and the Activity is the host layer of the Surface View control. Therefore, the second graphics layer is the graphics layer used to display the Surface View control.

[0160] Figure 7This is a flowchart illustrating the determination of the first content to be displayed in a control cutout scenario, according to an exemplary embodiment. For example... Figure 7 As shown, the steps may include the following.

[0161] In step S71, the graphics layer of the Surface View control is marked as a second graphics layer that matches the cutout type of the control.

[0162] The Surface View control has a separate graphics layer, which is marked as a second graphics layer that matches the control's cutout type.

[0163] In step S72, during the Surface Flinger compositing process, the second graphics layer and the graphics layer located below the second graphics layer are skipped.

[0164] In this way, the first graphics layer and the graphics layers located below the first graphics layer will not participate in the final compositing.

[0165] In step S73, the graphic layer located above the second graphic layer is composited to obtain the first on-screen content.

[0166] In other words, the first content displayed on the screen includes the host graphics layer of the Surface View control and the graphics layer above the host graphics layer (if any).

[0167] In one possible approach, obtaining the first on-screen content based on the graphics layer located above the second graphics layer may include: If a graphics layer exists above the host graphics layer, the first content to be displayed is obtained based on the host graphics layer and the graphics layer located above it; or If there is no graphics layer above the host graphics layer, the first content to be displayed is obtained based on the host graphics layer.

[0168] It should be understood that at least some areas of the host graphics layer and the graphics layer above the host graphics layer are transparent in order to ensure that the content on the second screen can be displayed through the transparent areas.

[0169] Figure 8 This is a schematic diagram illustrating a cutout in a control according to an exemplary embodiment. For example... Figure 8 As shown, when compositing the graphic layers, the second graphic layer and the graphic layer located below the second graphic layer are not composited. That is to say, the first on-screen content does not include the pixel data contained in the second graphic layer and the graphic layer located below the second graphic layer.

[0170] There must be at least one host graphics layer above the second graphics layer. (See reference...) Figure 8Assuming there is no graphics layer above the host graphics layer, the host graphics layer is used as the first on-screen content; that is, the first on-screen content includes the pixel data contained in the host graphics layer. Assuming the second on-screen content to be displayed in the second operating system is the panoramic image AVM, the on-screen content obtained by the display screen includes the first on-screen content of the host graphics layer and the second on-screen content of the panoramic image AVM. At the hardware layer, overlaying the first on-screen content including the host graphics layer and the second on-screen content including the panoramic image AVM yields the final target image for display.

[0171] In addition, if there is a graphics layer above the host graphics layer, the first screen display result is obtained based on the host graphics layer and the graphics layer above the graphics layer.

[0172] In the scenario of a control having a hole, the final result displayed on the screen is the superposition of the first and second content on the screen.

[0173] By using the above technical solution, a second set of content can be inserted into the graphic layer where the control is located by creating a hole in the control, thereby allowing the control to control the second set of content.

[0174] In another embodiment, the target hole type is a partial hole, and the target graphic layer is a third graphic layer. Accordingly, since it is a partial hole, the first upper screen content includes the content of the third graphic layer and the other areas of the graphic layer located below the third graphic layer, excluding the hole area.

[0175] For example, during the program development phase, assuming that graphic layer C is marked as the target graphic layer corresponding to the local hole-drilling type, then when it is determined that the current hole-drilling type is local hole-drilling, graphic layer C is determined as the target graphic layer to be drilled.

[0176] In this way, the content of the second screen can be displayed through the cutout area in the content of the first screen.

[0177] Optionally, the target hole-punch type is a partial hole-punch, and the target graphic layer is a third graphic layer. Accordingly, hole-punch processing is performed on the target graphic layer and the graphic layer below it to obtain the first on-screen content, which may include: The graphic layer located below the third graphic layer is composited to obtain the first composite graphic layer; The location and size of the excavation area are determined based on the third graphic layer; According to the location and size of the hole area, the first composite graphic layer is processed to create a hole, resulting in the second composite graphic layer; The first on-screen content is obtained based on at least the second composite graphics layer.

[0178] In both global and control-based cutout scenarios, this is achieved by skipping the target graphics layer and lower graphics layers during graphics layer compositing. This ensures that the content of lower graphics layers along the Z-axis will not appear on the display screen. However, in some cases, users may want only a portion of the lower graphics layer to be cut out, while the surrounding content remains intact.

[0179] For example, you can cut through a floating window, but the content around the window will still be visible. Another example is cutting through the HOME window. The HOME window is usually configured with the FLAG_SHOW_WALLPAPER flag, meaning the wallpaper is used as the background. The status bar and navigation bar are also Gaussian blurred with the wallpaper as the background. When cutting through the HOME window, to ensure the Gaussian blur effect of the status bar and navigation bar is not affected, the wallpaper around the HOME window needs to be preserved.

[0180] Therefore, during local hole-cutting, in the first operating system, when compositing from bottom to top along the Z-axis, the graphic layer located below the third graphic layer is composited to obtain the first composite graphic layer. Simultaneously, the position and size of the hole-cutting area are determined based on the marked third graphic layer. Then, according to the position and size of the hole-cutting area, the first composite graphic layer is processed to cut holes, resulting in the second composite graphic layer.

[0181] It should be understood that, in order to achieve secondary modifications to the first composite graphics layer, the GPU can be used to composite the graphics layer located below the third graphics layer to obtain the first composite graphics layer.

[0182] Optionally, according to the location and size of the cut-out area, the first composite graphic layer is processed to create a cut-out, resulting in a second composite graphic layer, including: The first composite graphic layer is blended with the transparent rectangle to obtain the second composite graphic layer. The transparent rectangle is positioned in the first composite graphic layer as the location of the cutout area, and its size is the size of the cutout area.

[0183] For example, a transparent rectangle with the same location and size as the determined cutout area is constructed. Then, a graphics layer blending process is performed on the first composite graphics layer and the transparent rectangle. For instance, the first composite graphics layer is used as the destination, and a blending operation is performed on the first composite graphics layer and the transparent rectangle (as the source) to obtain the second composite graphics layer.

[0184] It should be understood that in the second composite graphics layer, specific areas of each graphics layer are transparent.

[0185] Using the above technical solution, a second composite graphic layer is obtained by performing graphic blending processing on the first composite graphic layer and the transparent rectangle, such that the second composite graphic layer includes a cutout area consistent with the transparent rectangle.

[0186] After obtaining the second composite graphic layer according to the above scheme, the first on-screen content is obtained based on the second composite graphic layer.

[0187] Optionally, obtaining the first on-screen content based at least on the second composite graphics layer may include: If there is a graphic layer above the third graphic layer, the first on-screen content is obtained based on the second composite graphic layer and the graphic layer located above the third graphic layer.

[0188] In a scenario with a partial cutout, if there is a graphic layer above the third graphic layer, the first on-screen content is obtained based on the second composite graphic layer and the existing graphic layer.

[0189] Figure 9 This is a flowchart illustrating the determination of the first on-screen content in a partial hole-punch scenario according to an exemplary embodiment. For example... Figure 9 As shown, the steps may include the following.

[0190] In step S91, the marked graphic layer is designated as the third graphic layer that matches the local hole type.

[0191] In the scenario of partial cutouts, the third graphics layer can be full-screen or not. For example, the third graphics layer can be a floating window or a non-full-screen application.

[0192] In one approach, the third graphics layer is not full-screen. Accordingly, determining the location and size of the cutout area based on the third graphics layer includes: determining the location of the cutout area as the position of the third graphics layer within the graphics layer located below it; and determining the size of the cutout area as the size of the third graphics layer.

[0193] The location here refers to the position of the third graphic layer within the graphic layer below it. For example, the location could be the coordinates of the four vertices of the third graphic layer on the plane containing the graphic layer below it. Alternatively, given the shape of the third graphic layer, the location could be the coordinates of the center point of the third graphic layer within the graphic layer below it.

[0194] Additionally, the size of the third graphic layer can be determined as the size of the hole area.

[0195] Thus, when the position and size of the third graphic layer are preset to be the position and size of the hole area, the position and size of the hole area can be determined according to the third graphic layer after the third graphic layer is determined, which improves the convenience of determining the position and size of the hole area.

[0196] In another approach, the size of the third graphic layer may differ from the size of the cutout; accordingly, determining the location and size of the cutout area based on the third graphic layer may include: obtaining pre-configured cutout area information, which characterizes the location and size of the cutout area in the third graphic layer; and determining the location and size of the cutout area in the third graphic layer based on the cutout area information.

[0197] In this method, the marked third graphic layer has the same size as other graphic layers. However, since local hole-punching is to punch holes in a partial area of ​​the features in the graphic layer, after marking the third graphic layer, it is necessary to further configure the hole-punching area information. In this way, the position and size of the hole-punching area in the third graphic layer can be determined based on the hole-punching area information.

[0198] For example, suppose the information about the hole-drilling area includes the position coordinates of each vertex of the hole-drilling area in the third graphics layer. In this way, the area enclosed by each vertex of the hole-drilling area in the third graphics layer can be defined as the hole-drilling area, and then the position and size of the hole-drilling area can be determined.

[0199] Thus, when the size of the pre-marked third graphic layer is consistent with the size of other graphic layers, the location and size of the cut area can be determined in the third graphic layer through the pre-configured cut area information, which increases the flexibility in determining the location and size of the cut area.

[0200] In step S92, GPU compositing is performed on the graphics layer located below the third graphics layer to obtain the first composite graphics layer.

[0201] In step S93, when compositing to the third graphic layer, the first composite graphic layer and the transparent rectangle are blended to obtain the second composite graphic layer.

[0202] During GPU compositing, the graphics layer below the third graphics layer is drawn into a buffer called Frame Buffer Target (FBT). When GPU compositing reaches the third graphics layer, the content of the graphics layer below it has already entered the FBT. At this point, the FBT is used as the destination, and a blending operation is performed with a transparent rectangle (as the source). The position and size of the transparent rectangle are the position and size of the third graphics layer. This effectively creates a "hole" in the GPU compositing result (the first composite graphics layer), resulting in the second composite graphics layer.

[0203] In step S94, if there is a graphic layer above the third graphic layer, the first on-screen content is obtained based on the second composite graphic layer and the graphic layer located above the third graphic layer.

[0204] It should be understood that if there are graphic layers above the third graphic layer, these graphic layers are at least transparent in the punch-hole area, thus ensuring that the content on the second screen can be displayed through the punch-hole area.

[0205] If there is no graphic layer above the third graphic layer, then the second composite graphic layer will be determined as the first content to be displayed.

[0206] In a partial cutout scenario, the content ultimately displayed on the screen includes: if there is a graphics layer above the third graphics layer, all graphics layers above the third graphics layer, the second composite graphics layer, and the content exposed through the cutout area in the second on-screen content.

[0207] Figure 10 This is a schematic diagram illustrating a partial hole-punch design according to an exemplary embodiment. In this embodiment, during the graphics layer compositing, a first composite graphics layer is obtained by compositing the graphics layer located below the third graphics layer. When compositing to the third graphics layer, a transparent rectangle is generated based on the position and size of the third graphics layer, wherein the position and size of the transparent rectangle are consistent with the position and size of the third graphics layer. The first composite graphics layer and the transparent rectangle are then graphicly blended to obtain a second composite graphics layer. Subsequently, the Up Layer above the second composite graphics layer and the third graphics layer is used as the first on-screen content. Thus, the on-screen content obtained by the display screen includes the second composite graphics layer, the first on-screen content of the Up Layer, and the second on-screen content including the panoramic image AVM. In the hardware layer, the final target image can be obtained by overlaying the first on-screen content and the second on-screen content including the panoramic image AVM.

[0208] Similarly, there may be multiple graphics layers above the third graphics layer. When multiple graphics layers exist, the composition strategy of multiple graphics layers is related to the number of screen layers corresponding to the first operating system on the display screen. For details, please refer to the composition strategy of multiple graphics layers above the first graphics layer in the global hole-punch scenario, which will not be elaborated here.

[0209] Figure 11 This is a rendering illustrating a partial excavation according to an exemplary embodiment. For example... Figure 11 As shown, punching holes in the middle area of ​​the first composite graphics layer does not affect the normal display of the status bar and navigation bar, and the second on-screen content can be displayed in the transparent area in the middle.

[0210] Using the above technical solution, in the scenario of partial hole-punch, the graphic layer located below the third graphic layer is synthesized to obtain the first composite graphic layer, and a specific area in the first composite graphic layer is punched out, so that the content on the second screen can be displayed through the punched area.

[0211] It should be understood that the size of the cutout area in the first display content can be the same as or different from the size of the second display content to be displayed. In different cases, the display effect can be further improved by scaling the second display content up or down to fit the cutout area.

[0212] In this way, different hole types can be used to achieve different screen display results, thereby meeting various graphic layer interleaving requirements and improving display performance.

[0213] Based on the same inventive concept, this disclosure also provides a display device. Figure 12 This is a block diagram illustrating a display device according to an exemplary embodiment. Figure 12 As shown, the display device 1200 may include: Processing module 1201 is configured to respond to a hole-punch command, and in a first operating system, perform hole-punch processing on at least one graphics layer to obtain first on-screen content, wherein the first on-screen content includes the hole-punch area. The acquisition module 1202 is configured to acquire second on-screen content in a second operating system, which is different from the first operating system. The first display module 1203 is configured to display a target image, which is determined based on the first upper screen content and the second upper screen content, wherein the second upper screen content can be displayed through the cutout area in the target image.

[0214] Optionally, the processing module 1201 is configured to: In response to the hole-drilling command, the target graphics layer is determined in the first operating system; Holes are punched into the target graphic layer and the graphic layer below the target graphic layer to obtain the first on-screen content.

[0215] Optionally, the processing module 1201 is configured to: In response to the hole-drilling command, the target graphics layer is determined from the pre-marked graphics layers in the first operating system.

[0216] Optionally, there are multiple pre-marked graphics layers, and the processing module 1201 is configured to: Based on the priority of the second on-screen content, a target graphic layer that matches the second on-screen content is determined from a plurality of pre-marked graphic layers.

[0217] Optionally, the processing module 1201 is configured to: In response to the dig command, determine the current target dig type; The target graphics layer is determined in the first operating system based on the target hole type.

[0218] Optionally, the processing module 1201 is configured to: Determine the target excavation strategy that matches the target excavation type; According to the target hole-cutting strategy, hole-cutting processing is performed on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content.

[0219] Optionally, the target excavation type includes any of the following: Global hole-punching refers to setting both the first graphic layer and the graphic layer below the first graphic layer to be transparent. The first graphic layer is a pre-marked graphic layer corresponding to the global hole-punching. Control hole-cutting refers to setting both the second graphic layer and the graphic layer located below the second graphic layer to be transparent. The second graphic layer is a pre-marked graphic layer corresponding to the control hole-cutting and has a host graphic layer. Partial hole-cutting refers to setting a specific area of ​​the third graphic layer and the graphic layer below the third graphic layer to transparent. The third graphic layer is a pre-marked graphic layer corresponding to the partial hole-cutting.

[0220] Optionally, the target hole type is a global hole, and the target graphic layer is a first graphic layer; the first on-screen content does not include the content of the first graphic layer and the graphic layer located below the first graphic layer.

[0221] Optionally, the target hole-drilling type is global hole-drilling, and the target graphics layer is the first graphics layer; the processing module 1201 is configured to: Holes are drilled in the entire area of ​​the first graphic layer and the graphic layer located below the first graphic layer; If there is a graphic layer above the first graphic layer, the first on-screen content is obtained based on the graphic layer located above the first graphic layer.

[0222] Optionally, when there is no graphic layer above the first graphic layer, the entire area of ​​the first on-screen content is the cutout area.

[0223] Optionally, the target hole type is a control hole, and the target graphic layer is a second graphic layer; the first on-screen content does not include the content of the second graphic layer and the graphic layer located below the second graphic layer, but includes at least the content of the host graphic layer of the second graphic layer.

[0224] Optionally, the target hole type is a control hole, and the target graphic layer is a second graphic layer; the processing module 1201 is configured to: Holes are created in the entire area of ​​the second graphic layer and the graphic layer located below the second graphic layer; The first on-screen content is obtained based on the graphics layer located above the second graphics layer, wherein the graphics layer located above the second graphics layer includes at least the host graphics layer of the second graphics layer.

[0225] The processing module 1201 is configured as follows: If a graphics layer exists above the host graphics layer, the first on-screen content is obtained based on the host graphics layer and the graphics layer located above the host graphics layer; or If there is no graphics layer above the host graphics layer, the first on-screen content is obtained based on the host graphics layer.

[0226] Optionally, the second graphics layer is a graphics layer used to display Surface View controls.

[0227] Optionally, the target hole type is a partial hole, and the target graphic layer is a third graphic layer; the first screen content includes the content of the third graphic layer and the other areas of the graphic layer located below the third graphic layer, excluding the hole area.

[0228] Optionally, the target hole type is a partial hole, and the target graphic layer is a third graphic layer; the processing module 1201 is configured to: The graphic layer located below the third graphic layer is synthesized to obtain the first synthesized graphic layer; The location and size of the excavation area are determined based on the third graphic layer; According to the location and size of the hole-cutting area, the first composite graphic layer is processed to cut holes to obtain the second composite graphic layer; The first on-screen content is obtained based at least on the second composite graphics layer.

[0229] The processing module 1201 is configured as follows: If there is a graphic layer above the third graphic layer, the first on-screen content is obtained based on the second composite graphic layer and the graphic layer located above the third graphic layer.

[0230] Optionally, the processing module 1201 is configured to: The first composite graphic layer is blended with the transparent rectangle to obtain a second composite graphic layer, wherein the position of the transparent rectangle in the first composite graphic layer is the position of the cutout area, and the size of the transparent rectangle is the size of the cutout area.

[0231] Optionally, the processing module 1201 is configured to: The location of the third graphic layer within the graphic layer below the third graphic layer is defined as the location of the hole-digging area; The size of the third graphic layer is determined as the size of the hole-cutting area.

[0232] Optionally, the processing module 1201 is configured to: Obtain pre-configured hole-drilling area information, wherein the hole-drilling area information represents the position and size of the hole-drilling area in the third graphics layer; Based on the information about the excavated area, the location and size of the excavated area are determined in the third graphic layer.

[0233] Optionally, the display screen for displaying the target image includes a first screen layer and a second screen layer, with the first screen layer located above the second screen layer; the display device further includes: The second display module is configured to display the content of the first upper screen in the first screen layer; The third display module is configured to display the content of the second upper screen in the second screen layer; The overlay module is configured to overlay the first screen layer and the second screen layer to obtain the target image.

[0234] Optionally, the first operating system and the second operating system are deployed inside the vehicle, and the processing module 1201 is configured to: In response to the digging command, determine the current driving status of the vehicle; Based on the driving status, determine the current target excavation type.

[0235] Optionally, the processing module 1201 is configured to perform at least one of the following: If the driving state is a parked state or a reverse state, then the current target digging type is determined to be a global digging. If the driving state is a parking state, then the current target excavation type is determined to be a partial excavation. If the driving state is a turning state and the driving speed is less than or equal to a preset threshold, then the current target hole-digging type is determined to be control hole-digging.

[0236] Using the above technical solution, in the first operating system, at least one graphics layer is subjected to a hole-punch process to obtain the first on-screen content, which includes the hole-punch area. The second on-screen result of the second operating system is then obtained. In the final displayed target image, the second on-screen content can be displayed through the hole-punch area. Thus, by punching holes in at least one graphics layer, various layer interleaving requirements can be met on the same display screen, satisfying different display needs.

[0237] Based on the same inventive concept, this disclosure also provides a display system, on which a first operating system and a second operating system run, and the display system includes a display screen; The display screen is used to display a target image, which is determined based on a first on-screen content and a second on-screen content in the second operating system. The first on-screen content is obtained by punching holes in at least one graphics layer in the first operating system, and the first on-screen content includes a punched-hole area. The second on-screen content can be displayed in the target image through the punched-hole area.

[0238] The display system is used to execute the display method provided in this disclosure.

[0239] For example, the display system may include one or more display screens. When multiple display screens are included, the first screen content and the second screen content are content that needs to be displayed simultaneously on the same display screen.

[0240] The display system may be a system deployed on electronic devices or vehicles. This disclosure does not limit it in this respect.

[0241] This disclosure also provides a vehicle that includes the display system provided in this disclosure. For example, the display system may be an in-vehicle infotainment system.

[0242] Figure 13 This is a block diagram illustrating a vehicle according to an exemplary embodiment. Figure 13 As shown, the vehicle 800 may include a processor 801 and a memory 802. The vehicle 800 may also include one or more of a multimedia component 803, an input / output (I / O) interface 804, and a communication component 805.

[0243] The processor 801 controls the overall operation of the vehicle 800 to complete all or part of the steps in the aforementioned display method. The memory 802 stores various types of data to support the operation of the vehicle 800. This data may include, for example, instructions for any application or method operating on the vehicle 800, and application-related data such as contact data, sent and received messages, images, audio, video, etc. The memory 802 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read-Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The multimedia component 803 may include a screen and audio components. The screen may be, for example, a touchscreen, and the audio component is used to output and / or input audio signals. For example, the audio component may include a microphone for receiving external audio signals. The received audio signals may be further stored in memory 802 or transmitted via communication component 805. The audio component also includes at least one speaker for outputting audio signals. I / O interface 804 provides an interface between processor 801 and other interface modules, such as a keyboard, mouse, buttons, etc. These buttons may be virtual or physical buttons. Communication component 805 is used for wired or wireless communication between the vehicle 800 and other devices. Wireless communication, such as Wi-Fi, Bluetooth, Near Field Communication (NFC), 2G, 3G, 4G, NB-IoT, eMTC, or other 5G technologies, or combinations thereof, is not limited here. Therefore, the corresponding communication component 805 may include: a Wi-Fi module, a Bluetooth module, an NFC module, etc.

[0244] In an exemplary embodiment, the vehicle 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described display method.

[0245] In another exemplary embodiment, an electronic device is also provided, which may include a memory storing a computer program thereon; and a processor for executing the computer program in the memory to implement the display method described above. Here, the electronic device may be installed in a vehicle or independently of a vehicle. Furthermore, the electronic device deploys at least a first operating system and a second operating system, and the first operating system and the second operating system are different.

[0246] In another exemplary embodiment, a computer-readable storage medium including program instructions is also provided, which, when executed by a processor, implement the steps of the display method described above. For example, the computer-readable storage medium may be the memory 802 including the program instructions described above, which may be executed by the processor 801 of the vehicle 800 to complete the display method described above.

[0247] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the above-described display method when executed by the programmable device.

[0248] The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings. However, the present disclosure is not limited to the specific details of the above embodiments. Within the scope of the technical concept of the present disclosure, various simple modifications can be made to the technical solutions of the present disclosure, and these simple modifications all fall within the protection scope of the present disclosure.

[0249] It should also be noted that the various specific technical features described in the above embodiments can be combined in any suitable manner without contradiction. To avoid unnecessary repetition, this disclosure will not describe the various possible combinations separately.

[0250] Furthermore, various different embodiments of this disclosure can be combined in any way, as long as they do not violate the spirit of this disclosure, they should also be regarded as the content disclosed in this disclosure.

Claims

1. A display method, characterized in that, The method includes: In response to a hole-punch command, in a first operating system, a hole-punch process is performed on at least one graphics layer to obtain first on-screen content, the first on-screen content including the hole-punch area. Obtain the second on-screen content from the second operating system, which is different from the first operating system; The target image is displayed, which is determined based on the first screen content and the second screen content, wherein the second screen content can be displayed through the cutout area in the target image.

2. The display method according to claim 1, characterized in that, In response to the hole-punch command, in the first operating system, hole-punch processing is performed on at least one graphics layer to obtain the first on-screen content, including: In response to the hole-drilling command, the target graphics layer is determined in the first operating system; Holes are punched into the target graphic layer and the graphic layer below the target graphic layer to obtain the first on-screen content.

3. The display method according to claim 2, characterized in that, The step of determining the target graphics layer in the first operating system in response to the hole-digging command includes: In response to the hole-drilling command, the target graphics layer is determined from the pre-marked graphics layers in the first operating system.

4. The display method according to claim 3, characterized in that, The pre-labeled graphic layers are multiple, and the step of determining the target graphic layer from the pre-labeled graphic layers includes: Based on the priority of the second on-screen content, a target graphic layer that matches the second on-screen content is determined from a plurality of pre-marked graphic layers.

5. The display method according to claim 2, characterized in that, The step of determining the target graphics layer in the first operating system in response to the hole-digging command includes: In response to the dig command, determine the current target dig type; The target graphics layer is determined in the first operating system based on the target hole type.

6. The display method according to claim 5, characterized in that, The step of punching holes in the target graphic layer and the graphic layer below the target graphic layer to obtain the first on-screen content includes: Determine the target excavation strategy that matches the target excavation type; According to the target hole-cutting strategy, hole-cutting processing is performed on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content.

7. The display method according to claim 5 or 6, characterized in that, The target excavation type includes any of the following: Global hole-punching refers to setting both the first graphic layer and the graphic layer below the first graphic layer to be transparent. The first graphic layer is a pre-marked graphic layer corresponding to the global hole-punching. Control hole-cutting refers to setting both the second graphic layer and the graphic layer located below the second graphic layer to be transparent. The second graphic layer is a pre-marked graphic layer corresponding to the control hole-cutting and has a host graphic layer. Partial hole-cutting refers to setting a specific area of ​​the third graphic layer and the graphic layer below the third graphic layer to transparent. The third graphic layer is a pre-marked graphic layer corresponding to the partial hole-cutting.

8. The display method according to claim 5, characterized in that, The target hole type is a global hole, and the target graphic layer is a first graphic layer; the first on-screen content does not include the content of the first graphic layer and the graphic layer located below the first graphic layer.

9. The display method according to claim 5, characterized in that, The target hole-punching type is global hole-punching, and the target graphic layer is the first graphic layer; the process of punching holes in the target graphic layer and the graphic layer below the target graphic layer to obtain the first on-screen content includes: Holes are drilled in the entire area of ​​the first graphic layer and the graphic layer located below the first graphic layer; If there is a graphic layer above the first graphic layer, the first on-screen content is obtained based on the graphic layer located above the first graphic layer.

10. The display method according to claim 9, characterized in that, When there is no graphic layer above the first graphic layer, the entire area of ​​the first on-screen content is the cutout area.

11. The display method according to claim 5, characterized in that, The target hole type is a control hole, and the target graphic layer is a second graphic layer; the first on-screen content does not include the content of the second graphic layer and the graphic layer located below the second graphic layer, but includes at least the content of the host graphic layer of the second graphic layer.

12. The display method according to claim 5, characterized in that, The target cutout type is control cutout, and the target graphic layer is a second graphic layer; the process of performing cutout processing on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content includes: Holes are created in the entire area of ​​the second graphic layer and the graphic layer located below the second graphic layer; The first on-screen content is obtained based on the graphics layer located above the second graphics layer, wherein the graphics layer located above the second graphics layer includes at least the host graphics layer of the second graphics layer.

13. The display method according to claim 12, characterized in that, The step of obtaining the first on-screen content based on the graphic layer located above the second graphic layer includes: If a graphics layer exists above the host graphics layer, the first on-screen content is obtained based on the host graphics layer and the graphics layer located above the host graphics layer; or If there is no graphics layer above the host graphics layer, the first on-screen content is obtained based on the host graphics layer.

14. The display method according to claim 11, characterized in that, The second graphics layer is used to display Surface View controls.

15. The display method according to claim 5, characterized in that, The target hole type is a partial hole, and the target graphic layer is a third graphic layer; the first screen content includes the content of the third graphic layer and the other areas of the graphic layer located below the third graphic layer, excluding the hole area.

16. The display method according to claim 5, characterized in that, The target hole-cutting type is partial hole-cutting, and the target graphic layer is a third graphic layer; the process of performing hole-cutting on the target graphic layer and the graphic layer located below the target graphic layer to obtain the first on-screen content includes: The graphic layer located below the third graphic layer is synthesized to obtain the first synthesized graphic layer; The location and size of the excavation area are determined based on the third graphic layer; According to the location and size of the hole-cutting area, the first composite graphic layer is processed to cut holes to obtain the second composite graphic layer; The first on-screen content is obtained based at least on the second composite graphics layer.

17. The display method according to claim 16, characterized in that, The step of obtaining the first on-screen content based at least on the second composite graphics layer includes: If there is a graphic layer above the third graphic layer, the first on-screen content is obtained based on the second composite graphic layer and the graphic layer located above the third graphic layer.

18. The display method according to claim 16, characterized in that, The step of processing the first composite graphic layer by drilling holes according to the location and size of the hole-drilling area to obtain the second composite graphic layer includes: The first composite graphic layer is blended with the transparent rectangle to obtain a second composite graphic layer, wherein the position of the transparent rectangle in the first composite graphic layer is the position of the cutout area, and the size of the transparent rectangle is the size of the cutout area.

19. The display method according to claim 16, characterized in that, Determining the location and size of the excavation area based on the third graphic layer includes: The location of the third graphic layer within the graphic layer below the third graphic layer is defined as the location of the hole-digging area; The size of the third graphic layer is determined as the size of the hole-cutting area.

20. The display method according to claim 16, characterized in that, Determining the location and size of the excavation area based on the third graphic layer includes: Obtain pre-configured hole-drilling area information, wherein the hole-drilling area information represents the position and size of the hole-drilling area in the third graphics layer; Based on the information about the excavated area, the location and size of the excavated area are determined in the third graphic layer.

21. The display method according to any one of claims 1-6 or 8-20, characterized in that, The display screen for displaying the target image includes a first screen layer and a second screen layer, with the first screen layer located above the second screen layer. The display method further includes: Display the content of the first upper screen in the first screen layer; Display the content of the second upper screen in the second screen layer; The first screen layer and the second screen layer are overlaid to obtain the target image.

22. The display method according to any one of claims 5-6 or 8-20, characterized in that, The first operating system and the second operating system are deployed inside the vehicle. The step of determining the current target digging type in response to a digging command includes: In response to the digging command, determine the current driving status of the vehicle; Based on the driving status, determine the current target excavation type.

23. The display method according to claim 22, characterized in that, The determination of the current target excavation type based on the driving status includes at least one of the following: If the driving state is a parked state or a reverse state, then the current target digging type is determined to be a global digging. If the driving state is a parking state, then the current target excavation type is determined to be a partial excavation. If the driving state is a turning state and the driving speed is less than or equal to a preset threshold, then the current target hole-digging type is determined to be control hole-digging.

24. A display system, characterized in that, The display system runs on a first operating system and a second operating system, and the display system includes a display screen; The display screen is used to display a target image, which is determined based on a first on-screen content and a second on-screen content in the second operating system. The first on-screen content is obtained by punching holes in at least one graphics layer in the first operating system, and the first on-screen content includes a punched-hole area. The second on-screen content can be displayed in the target image through the punched-hole area.

25. A vehicle, characterized in that, The vehicle includes the display system as described in claim 24.

26. An electronic device, characterized in that, The electronic device includes: A memory on which computer programs are stored; A processor for executing the computer program in the memory to implement the steps of the display method according to any one of claims 1-23.

27. A computer-readable storage medium having a computer program stored thereon, characterized in that, When executed by a processor, the computer program implements the steps of the display method according to any one of claims 1-23.

28. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the steps of the display method according to any one of claims 1-23.

Images