Split-screen display method and device of display screen and storage medium

Abstract

The invention relates to a split-screen display method and device of a display screen and a storage medium. The method comprises the steps that in response to starting of a split-screen function, a plurality of virtual display devices are determined, and each virtual display device is associated with a display layer; the display layers corresponding to the multiple virtual display devices are subjected to superposition processing, and the display layers after superposition processing are obtained; and sending the superposed display layer to a single physical display device through a physical interface, so that the physical display device displays a plurality of pictures of the full-screen exclusive application associated with each virtual display device. According to the embodiment of the invention, a plurality of full-screen exclusive applications can be operated under the condition of a single display screen and a single physical interface without depending on the support of the display equipment on the functions of multi-path input screen splitting, picture-in-picture and the like, the effects of screen splitting and picture-in-picture can be achieved under the condition of single-path output, and meanwhile, the operation efficiency is improved. The application program has better rendering performance in the full-screen exclusive mode, so that the display effect is better.

Description

Technical Field

[0001] The present disclosure relates to the field of graphics card technology, and in particular to a display screen split-screen display method, device and storage medium. Background Art

[0002] In the current split-screen display solution, a single monitor cannot display two independent computer desktop contents when connected to a computer host through a physical interface. Applications can only be displayed in the form of windows or full-screen exclusive screens. If the application must be in full-screen exclusive mode, the monitor cannot be used to display other content. If you want to run a full-screen application and display other images, you must connect multiple monitors, or the monitor must support PBP (picture by picture) or PIP (picture in picture) functions, and connect to the computer host through two HDMI / DP (High-Definition Multimedia Interface / Display Port) cables, and use the monitor function to display two different computer desktop contents on the same monitor.

[0003] That is to say, the current split-screen display solution depends on the functional support of the monitor. If the connected monitor does not support PBP or PIP function, there is no way to achieve the split-screen display effect (i.e., the effect of simultaneously displaying multiple application screens that could only be displayed in full screen on the same monitor). In addition, the graphics card needs to actually output multiple channels of data, and the monitor needs to receive two channels of data at the same time, which increases the load on the graphics card and the monitor. Summary of the invention

[0004] In view of this, the present disclosure proposes a split-screen display method, device and storage medium.

[0005] According to one aspect of the present disclosure, a method for split-screen display of a display screen is provided. The method comprises:

[0006] In response to the split screen function being turned on, determining a plurality of virtual display devices, each virtual display device being associated with a display layer;

[0007] Performing a superposition process on the display layers corresponding to the multiple virtual display devices to obtain a display layer after the superposition process;

[0008] The display layer after the overlay processing is sent to a single physical display device through a physical interface, so that the pictures of multiple full-screen exclusive applications respectively associated with each virtual display device are displayed on the physical display device.

[0009] In a possible implementation, in response to the split screen function being enabled, determining a plurality of virtual display devices includes:

[0010] In response to the split screen function being turned on, determining configuration information of a plurality of virtual display devices, the configuration information including a resolution corresponding to each virtual display device;

[0011] Performing overlay processing on display layers corresponding to the multiple virtual display devices to obtain overlay processed display layers includes:

[0012] Based on the configuration information of the multiple virtual display devices, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers; the resolution of the overlaid display layers is obtained based on the resolution corresponding to the virtual display devices.

[0013] In a possible implementation, the configuration information includes split-screen layout information, and each display layer corresponding to the multiple virtual display devices is overlaid to obtain the overlaid display layer, including:

[0014] Based on the split-screen layout information, the hardware layer overlay function of the graphics card is used to set multiple virtual display layers at corresponding positions in a single display layer according to preset sizes, and the single display layer is used as the display layer after overlay processing.

[0015] In a possible implementation, the split-screen layout information includes the number, position, size, and superposition method of the virtual display devices, and the resolution corresponding to each virtual display device is determined based on the size.

[0016] In a possible implementation, the method further includes:

[0017] Obtaining content information to be displayed on each virtual display device;

[0018] The content information to be displayed by each virtual display device is respectively configured to the display layer associated with the virtual display device;

[0019] Performing overlay processing on display layers corresponding to the multiple virtual display devices to obtain overlay processed display layers includes:

[0020] Based on the configuration information of the multiple virtual display devices and the content information of the associated display layers, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0021] In a possible implementation, the method further includes:

[0022] Determine display timing information of each virtual display device according to the resolution of the plurality of virtual display devices, wherein the display timing information includes a refresh rate;

[0023] Performing overlay processing on display layers corresponding to the multiple virtual display devices to obtain overlay processed display layers includes:

[0024] Obtaining a vertical synchronization interrupt signal sent by each virtual display device based on a refresh rate;

[0025] In response to the vertical synchronization interrupt signal, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0026] In a possible implementation, the refresh rates of the virtual display devices are the same.

[0027] In a possible implementation, the method further includes:

[0028] A preset number of virtual interfaces are added in the operating system through a driver interface, and the virtual interfaces are associated with each virtual display device.

[0029] In a possible implementation, the method further includes:

[0030] In response to the split screen function being turned on, setting the virtual interface corresponding to each virtual display device to a connected state and setting the physical interface to a disconnected state;

[0031] In response to the split screen function being turned off, the virtual interface corresponding to each virtual display device is set to a disconnected state, and the physical interface is set to a connected state.

[0032] According to another aspect of the present disclosure, a display screen split display device is provided. The device comprises:

[0033] A first determining module, configured to determine a plurality of virtual display devices in response to the split screen function being enabled, each virtual display device being associated with a display layer;

[0034] An overlay processing module, used to perform overlay processing on each display layer corresponding to a plurality of virtual display devices to obtain a display layer after overlay processing;

[0035] The sending module is used to send the display layer after the superposition processing to a single physical display device through a physical interface, so that the physical display device displays pictures of multiple full-screen exclusive applications respectively associated with each virtual display device.

[0036] In a possible implementation manner, the first determining module is configured to:

[0037] In response to the split screen function being turned on, determining configuration information of a plurality of virtual display devices, the configuration information including a resolution corresponding to each virtual display device;

[0038] Overlay processing module for:

[0039] Based on the configuration information of the multiple virtual display devices, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers; the resolution of the overlaid display layers is obtained based on the resolution corresponding to the virtual display devices.

[0040] In a possible implementation, the configuration information includes split-screen layout information and an overlay processing module, which is used to:

[0041] Based on the split-screen layout information, the hardware layer overlay function of the graphics card is used to set multiple virtual display layers at corresponding positions in a single display layer according to preset sizes, and the single display layer is used as the display layer after overlay processing.

[0042] In a possible implementation, the split-screen layout information includes the number, position, size, and superposition method of the virtual display devices, and the resolution corresponding to each virtual display device is determined based on the size.

[0043] In a possible implementation, the device further includes:

[0044] An acquisition module, used to acquire content information to be displayed by each virtual display device;

[0045] A configuration module, used to configure the content information to be displayed by each virtual display device to the display layer associated with the virtual display device;

[0046] Overlay processing module for:

[0047] Based on the configuration information of the multiple virtual display devices and the content information of the associated display layers, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0048] In a possible implementation, the device further includes:

[0049] A second determination module is used to determine display timing information of each virtual display device according to the resolution of the plurality of virtual display devices, where the display timing information includes a refresh rate;

[0050] Overlay processing module for:

[0051] Obtaining a vertical synchronization interrupt signal sent by each virtual display device based on a refresh rate;

[0052] In response to the vertical synchronization interrupt signal, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0053] In a possible implementation, the refresh rates of the virtual display devices are the same.

[0054] In a possible implementation, the device further includes:

[0055] The interface adding module is used to add a preset number of virtual interfaces in the operating system through a driver interface, and the virtual interfaces are associated with each virtual display device.

[0056] In a possible implementation, the device further includes:

[0057] A first state setting module, configured to, in response to the split screen function being enabled, set the virtual interface corresponding to each virtual display device to a connected state and set the physical interface to a disconnected state;

[0058] The second state setting module is used for setting the virtual interface corresponding to each virtual display device to a disconnected state and the physical interface to a connected state in response to the split screen function being turned off.

[0059] According to another aspect of the present disclosure, a split-screen display device is provided, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0060] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.

[0061] According to another aspect of the present disclosure, a computer program product is provided, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0062] According to the embodiments of the present application, by determining multiple virtual display devices when the split-screen function is turned on, the number of split screens is not limited to the number of physical interfaces. By associating each virtual display device with a display layer, each display layer can be simulated as an independent display device. By superimposing each display layer to obtain a superimposed display layer, multiple display layers can be combined into a complete single screen. By sending the superimposed display layer to a single physical display device through a physical interface, multiple full-screen exclusive application screens respectively associated with each virtual display device are displayed on the physical display device. It is possible to run multiple full-screen exclusive applications under the conditions of a single display screen and a single physical interface without relying on the display device's support for multi-input split-screen, picture-in-picture and other functions. The split-screen and picture-in-picture effects can also be achieved under the condition of a single output. At the same time, the application has better rendering performance in full-screen exclusive mode, so that the display effect is better and the display method is more diverse.

[0063] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0065] Figure 1 A schematic diagram showing an application scenario according to an embodiment of the present application.

[0066] Figure 2 A flow chart of a display screen split-screen display method according to an embodiment of the present application is shown.

[0067] Figure 3 A schematic diagram showing the effect of performing split-screen display according to an embodiment of the present application is shown.

[0068] Figure 4 A schematic diagram showing the effect of performing split-screen display according to an embodiment of the present application is shown.

[0069] Figure 5 A schematic diagram showing the effect of performing split-screen display according to an embodiment of the present application is shown.

[0070] Figure 6 A schematic diagram showing the effect of performing split-screen display according to an embodiment of the present application is shown.

[0071] Figure 7 A schematic diagram showing the effect of performing split-screen display according to an embodiment of the present application is shown.

[0072] Figure 8A structural diagram of a display screen split-screen display device according to an embodiment of the present application is shown.

[0073] Fig. 9 It is a block diagram of a device 1900 for split-screen display on a display screen according to an exemplary embodiment. DETAILED DESCRIPTION

[0074] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0075] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0076] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0077] In the current split-screen display solution, a single monitor cannot display two independent computer desktop contents when connected to a computer host through a physical interface. Applications can only be displayed in the form of windows or full-screen exclusive screens. If the application must be in full-screen exclusive mode, the monitor cannot be used to display other content. If you want to run a full-screen application and display other images, you must connect multiple monitors, or the monitor must support PBP (picture by picture) or PIP (picture in picture) functions, and connect to the computer host through two HDMI / DP (High-Definition Multimedia Interface / Display Port) cables, and use the monitor function to display two different computer desktop contents on the same monitor.

[0078] That is to say, the current split-screen display solution depends on the functional support of the monitor. If the connected monitor does not support PBP or PIP function, there is no way to achieve the split-screen display effect (i.e., the effect of simultaneously displaying multiple application screens that could only be displayed in full screen on the same monitor). In addition, the graphics card needs to actually output multiple channels of data, and the monitor needs to receive two channels of data at the same time, which increases the load on the graphics card and the monitor.

[0079] In view of this, the present application provides a display screen split-screen display method, device and storage medium. The method of the present application can make the number of split screens not limited to the number of physical interfaces by determining multiple virtual display devices when the split-screen function is turned on, and each virtual display device can be associated with a display layer, so that each display layer can be simulated as an independent display device, and each display layer can be superimposed to obtain a display layer after superimposition processing, and multiple display layers can be combined into a complete single screen, and the display layer after superposition processing is sent to a single physical display device through a physical interface, so that the physical display device displays multiple full-screen exclusive application screens associated with each virtual display device, respectively, and can realize running multiple full-screen exclusive applications under the conditions of a single display screen and a single physical interface, so that multiple application screens that can only be displayed in full screen alone are displayed on one screen at the same time, without relying on the display device's support for multi-input split screen, picture-in-picture and other functions, and can also achieve split screen and picture-in-picture effects under single-channel output conditions. At the same time, the application has better rendering performance in full-screen exclusive mode, so that the display effect is better and the display mode is more diverse.

[0080] Figure 1 A schematic diagram of an application scenario according to an embodiment of the present application is shown. The display screen split-screen display system of the present application can be applied to a scenario where multiple full-screen exclusive applications are run on a single display screen, such as Figure 1 As shown, the split-screen display system may include a central processing unit (CPU) and a graphics card, and the graphics card is connected to the display device through one or more physical interfaces (such as interface 1 and interface 2 in the figure). The display device in this application may be an LCD (Liquid Crystal Display) display, an LED (Light Emitting Diode) display, an OLED (Organic Light Emitting Diode) display, or any other type of display device.

[0081] Among them, the graphics card can be used to render graphic content from the application. The graphics content can be sent to the graphics card by the operating system running on the CPU through the driver interface. The graphics card can convert it into image data that can be displayed on the display device and send it to the display screen through the physical interface for display.

[0082] The display screen split-screen display system can be used for terminal devices or servers. The terminal device can be any one or more of a mobile phone, a foldable electronic device, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), and a vehicle-mounted device. The embodiments of the present disclosure do not impose any special restrictions on the specific type of the terminal device, and the terminal device can have a wired or wireless communication function.

[0083] The server can be located locally or in the cloud, and can be a physical device or a virtual device, such as a virtual machine, a container, etc., and has a wireless communication function, wherein the wireless communication function can be set in the chip (system) or other parts or components of the server. The wireless communication function can be realized, for example, through mobile communication technologies such as 2G / 3G / 4G / 5G, as well as Wi-Fi, Bluetooth, frequency modulation (FM), digital radio, satellite communication, etc. Communication can also be carried out through wired connection to achieve interaction with other devices.

[0084] Figure 2 A flow chart of a display screen split-screen display method according to an embodiment of the present application is shown. The method can be used in the above-mentioned display screen split-screen display system, such as Figure 2 As shown, the method may include:

[0085] Step S201, in response to the split screen function being enabled, determining a plurality of virtual display devices.

[0086] The split screen function can be enabled through software settings in the graphics card driver. The graphics card driver can run in the operating system on the CPU and connect to the graphics card through the driver interface.

[0087] Before enabling the split-screen function, the graphics card driver can determine the number of split-screens that can be supported based on the number of display layers that can be supported on each display output of the graphics card (i.e., one physical interface). Each display layer can be used as an independent output device (virtual display device), and each virtual display device is associated with a display layer.

[0088] One or more physical interfaces, such as an HDMI / DP interface, have been declared in the operating system. The graphics driver can add a preset number of virtual interfaces in the operating system through a driver interface, and the virtual interface can be associated with each virtual display device.

[0089] Among them, the graphics card driver can modify the corresponding parameters in the operating system through the driver interface to declare a new preset number of virtual interfaces in the operating system. The parameters modified on different operating systems may be different. For example, the number of supported signal sources (source) and display targets (target) can be increased on a Windows system, and the number of display controllers (crtc), layers (planes) of actual display images, and interfaces (connectors) can be increased on a Linux system. The increased number does not exceed the number of split screens that can be supported as determined above.

[0090] The default initialization state is that the split-screen function is turned off. In response to the split-screen function being turned off, the graphics card driver can inform the operating system through the driver interface to set the virtual interface corresponding to each virtual display device to a disconnected state and the physical interface to a connected state.

[0091] At this time, normal non-split-screen display is performed on the connected physical display device, that is, one output interface corresponds to one full-screen display content to the corresponding one connected physical display device.

[0092] In response to the split screen function being enabled, the graphics card driver may inform the operating system through the driver interface to set the virtual interface corresponding to each virtual display device to a connected state and the physical interface to a disconnected state. All virtual interfaces may be set to a connected state, or only some virtual interfaces may be set to a connected state as needed.

[0093] In step S201, you can:

[0094] In response to the split screen function being enabled, configuration information of a plurality of virtual display devices is determined.

[0095] The configuration information may be pre-set and may include the resolution corresponding to each virtual display device. The configuration information may also include split-screen layout information. The split-screen layout information may be set by a graphics card driver, and the graphics card driver saves the set split-screen layout information to a configuration file for subsequent reading.

[0096] The split-screen layout information may include the number, position, size, and superposition mode of virtual display devices. The number of virtual display devices may be determined based on the number of virtual interfaces set to a connected state; the position of a virtual display device may refer to the display position of a virtual display device on a physical display device (e.g., the pixel coordinates of the upper left corner of a virtual display device on a physical display device); the size of a virtual display device may indicate the pixel width and height occupied by the virtual display device; the superposition mode may be used to indicate whether virtual display devices can be displayed in overlapping fashion, such as whether they can be displayed in layers or can only be displayed side by side or top by top.

[0097] When the split-screen function is turned on, the graphics card driver can be loaded to read the saved split-screen layout information. The graphics card driver can also inform the operating system through the driver interface that the corresponding virtual display device is connected and set the resolution for the virtual display device through the driver interface.

[0098] The resolution corresponding to each virtual display device can be determined based on the size, and the resolution can represent the maximum supported resolution of the virtual display device. For example, if the size of a virtual display device indicates a width of 720 pixels and a height of 1080 pixels, the resolution of the virtual display device can be set to 720×1080 pixels.

[0099] After the operating system receives the information sent by the graphics card driver that the corresponding virtual display device is in a connected state, the application program on the operating system (such as the desktop management program) can set the resolution of each virtual display device (not exceeding the maximum resolution supported by the virtual display device in the configuration information), and set the display timing according to the set resolution of each virtual display device to ensure that the image content of each virtual display device can be accurately displayed on the physical display device. Among them, it can:

[0100] The display timing information of each virtual display device is determined according to the resolutions of the plurality of virtual display devices.

[0101] Among them, a complete resolution corresponding to the physical display device can be obtained according to the resolutions set by multiple virtual display devices. For example, if the resolutions of two virtual display devices are 720 (width) × 1080 (height) pixels, and the two virtual display devices are displayed side by side up and down, then the complete resolution corresponding to the physical display device can be 1440 (720+720) × 1080 pixels.

[0102] The display timing information may include a refresh rate, which may indicate the number of times a display device refreshes an image per second, for example, a refresh rate of 60 Hz indicates that the image is refreshed 60 times per second. In the embodiment of the present application, the refresh rates of the virtual display devices may be the same.

[0103] Since in an embodiment of the present application, multiple display devices are virtual display devices after splitting the screen, it is only necessary to perform actual timing parameter setting for multiple split screens (i.e., virtual display screens) only once (i.e., setting the display timing information of each virtual display device to the same parameter value), so that the display timing parameter value finally used is the same value, and the graphics card driver can be set according to the optimal resolution of the connected physical display device (e.g., a complete resolution corresponding to the physical display device determined as above). For example, some display devices support a maximum refresh rate of 144Hz at a resolution of 1080p, but may only support a refresh rate of 60Hz at a resolution of 4K. The refresh rate can be set by selecting a value that does not exceed the maximum refresh rate supported by the resolution.

[0104] The display timing information may also include a horizontal scanning period, a vertical scanning period, etc., which is not limited in the present application.

[0105] In the embodiment of the present application, each virtual display device is regarded as a display layer. When each virtual display device is in a connected state and obtains the above configuration information, the application on the operating system can draw the content of the display screen of the corresponding virtual display device, and submit it to the graphics driver through the driver interface. The graphics driver can:

[0106] Acquire content information to be displayed by each virtual display device; and configure the content information to be displayed by each virtual display device to a display layer associated with the virtual display device.

[0107] The content information to be displayed may be a picture drawn by a corresponding application to be displayed on a virtual display device. The graphics card driver may set the content to be displayed to the layer hardware control register of the graphics card according to the position information (such as position, size, etc.) of each virtual display device to be configured to the display layer associated with the virtual display device.

[0108] Step S202 , performing superposition processing on the display layers corresponding to the multiple virtual display devices to obtain the display layers after superposition processing.

[0109] Among them, you can:

[0110] A vertical synchronization interrupt signal sent by each virtual display device based on a refresh rate is obtained; in response to the vertical synchronization interrupt signal, each display layer corresponding to a plurality of virtual display devices is overlaid to obtain a display layer after overlay processing.

[0111] The vertical synchronization interrupt signal can be used to instruct the corresponding display device to perform vertical refresh to maintain the smoothness of the picture and ensure that the update of the picture does not cause tearing. For example, when the refresh rate is 60Hz, the virtual display device can send 60 vertical synchronization interrupt signals per second.

[0112] The graphics card driver can process synchronization interrupts for these virtual display devices based on the vertical synchronization interrupt signals reported by each virtual display device, that is, it can prepare to perform display layer overlay processing for the next frame. During the display layer overlay processing, you can:

[0113] Based on the configuration information of the multiple virtual display devices, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0114] The resolution of the display layer after the overlay processing can be obtained based on the resolution of each virtual display device, for example, the resolution of a complete physical display device determined above.

[0115] The hardware layer overlay function of the graphics card can be used to perform overlay processing on each display layer, merging multiple display layers into a single display image (ie, a single display layer) so as to be transmitted to the physical display device through the physical display interface.

[0116] The starting position and size of the display layer can be determined based on the position, size and other information of the virtual display device, and the display layer arrangement and merging strategy can be determined based on the superposition method of the virtual display device to superimpose different display layers in one screen for display.

[0117] When displaying layer overlays, you can:

[0118] Based on the split-screen layout information, the hardware layer overlay function of the graphics card is used to set multiple virtual display layers at corresponding positions in a single display layer according to preset sizes, and the single display layer is used as the display layer after overlay processing.

[0119] During the overlay process, you can also:

[0120] Based on the configuration information of the multiple virtual display devices and the content information of the associated display layers, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0121] For example, the screen contents rendered by each application program and to be displayed on each virtual display device may be obtained from the video memory as the content information of each display layer.

[0122] Thus, the graphics card performs a layer overlay operation to combine the various display layers into a final display layer (ie, the display layer after the overlay process).

[0123] Step S203 : sending the overlaid display layer to a single physical display device through a physical interface, so that the physical display device displays pictures of multiple full-screen exclusive applications respectively associated with the virtual display devices.

[0124] The full-screen exclusive application can be an application that obtains exclusive access rights when running in the operating system and runs exclusively on the entire screen, such as a desktop management program. That is, in the corresponding virtual display device, other content except the displayed full-screen exclusive application cannot be displayed. The full-screen exclusive applications associated with each virtual display device can be the same application or different applications.

[0125] The multiple images displayed in the final split screen can be divided horizontally, vertically, or mixed, or one image can be superimposed on another image. The configuration information such as the layout and size of the image can also be changed and adjusted at any time.

[0126] The following is an example of the effect of split-screen display on a physical display device. Figure 3 , Figure 4 , Figure 5 , Figure 6 and Figure 7 , respectively showing schematic diagrams of the effects of performing split-screen display according to an embodiment of the present application. Figure 3 to Figure 7 As shown, the graphics card can send the overlay processed display layer to the physical display device through one physical interface (interface 1) to achieve split-screen and picture-in-picture display effects on the physical display device.

[0127] in, Figure 3 It shows a split-screen display effect of two pictures (picture 1, picture 2) divided vertically, and the two pictures do not overlap each other.

[0128] Figure 4 The split-screen display effect of two pictures (picture 1 and picture 2) PIP is shown, and picture 2 is displayed as a small sub-picture superimposed on picture 1 (picture 2 is located in the lower right corner of picture 1).

[0129] Figure 5 It shows a split-screen display effect of three pictures (picture 1 to picture 3) divided vertically, and the three pictures do not overlap each other.

[0130] Figure 6 It shows a split-screen display effect of three pictures (picture 1 to picture 3) mixed and divided, wherein picture 1 and pictures 2 and 3 are divided vertically, picture 2 and picture 3 are divided horizontally, and the three pictures do not overlap each other.

[0131] Figure 7The split-screen display effect of two pictures (picture 1 and picture 2) PIP is shown, and picture 2 is displayed as a small sub-picture superimposed on picture 1 (picture 2 is located at any position in picture 1).

[0132] According to the embodiments of the present application, by determining multiple virtual display devices when the split-screen function is turned on, the number of split screens is not limited to the number of physical interfaces. By associating each virtual display device with a display layer, each display layer can be simulated as an independent display device. By superimposing each display layer to obtain a superimposed display layer, multiple display layers can be combined into a complete single screen. By sending the superimposed display layer to a single physical display device through a physical interface, multiple full-screen exclusive application screens respectively associated with each virtual display device are displayed on the physical display device. It is possible to run multiple full-screen exclusive applications under the conditions of a single display screen and a single physical interface without relying on the display device's support for multi-input split-screen, picture-in-picture and other functions. The split-screen and picture-in-picture effects can also be achieved under the condition of a single output. At the same time, the application has better rendering performance in full-screen exclusive mode, so that the display effect is better and the display method is more diverse.

[0133] Figure 8 FIG. 2 shows a structural diagram of a display screen split-screen display device according to an embodiment of the present application. Figure 8 As shown, the device comprises:

[0134] A first determining module 801 is used to determine a plurality of virtual display devices in response to the split screen function being enabled, each virtual display device being associated with a display layer;

[0135] The overlay processing module 802 is used to perform overlay processing on the display layers corresponding to the multiple virtual display devices to obtain the display layers after overlay processing;

[0136] The sending module 803 is used to send the display layer after the overlay processing to a single physical display device through a physical interface, so that the physical display device displays pictures of multiple full-screen exclusive applications respectively associated with each virtual display device.

[0137] In a possible implementation manner, the first determining module 801 is configured to:

[0138] In response to the split screen function being turned on, determining configuration information of a plurality of virtual display devices, the configuration information including a resolution corresponding to each virtual display device;

[0139] The overlay processing module 802 is used to:

[0140] Based on the configuration information of the multiple virtual display devices, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers; the resolution of the overlaid display layers is obtained based on the resolution corresponding to the virtual display devices.

[0141] In a possible implementation, the configuration information includes split-screen layout information, and the overlay processing module 802 is used to:

[0142] Based on the split-screen layout information, the hardware layer overlay function of the graphics card is used to set multiple virtual display layers at corresponding positions in a single display layer according to preset sizes, and the single display layer is used as the display layer after overlay processing.

[0143] In a possible implementation, the split-screen layout information includes the number, position, size, and superposition method of the virtual display devices, and the resolution corresponding to each virtual display device is determined based on the size.

[0144] In a possible implementation, the device further includes:

[0145] An acquisition module, used to acquire content information to be displayed by each virtual display device;

[0146] A configuration module, used to configure the content information to be displayed by each virtual display device to the display layer associated with the virtual display device;

[0147] The overlay processing module 802 is used to:

[0148] Based on the configuration information of the multiple virtual display devices and the content information of the associated display layers, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0149] In a possible implementation, the device further includes:

[0150] A second determination module is used to determine display timing information of each virtual display device according to the resolution of the plurality of virtual display devices, where the display timing information includes a refresh rate;

[0151] The overlay processing module 802 is used to:

[0152] Obtaining a vertical synchronization interrupt signal sent by each virtual display device based on a refresh rate;

[0153] In response to the vertical synchronization interrupt signal, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

[0154] In a possible implementation, the refresh rates of the virtual display devices are the same.

[0155] In a possible implementation, the device further includes:

[0156] The interface adding module is used to add a preset number of virtual interfaces in the operating system through a driver interface, and the virtual interfaces are associated with each virtual display device.

[0157] In a possible implementation, the device further includes:

[0158] A first state setting module, configured to, in response to the split screen function being enabled, set the virtual interface corresponding to each virtual display device to a connected state and set the physical interface to a disconnected state;

[0159] The second state setting module is used for setting the virtual interface corresponding to each virtual display device to a disconnected state and the physical interface to a connected state in response to the split screen function being turned off.

[0160] According to the embodiments of the present application, by determining multiple virtual display devices when the split-screen function is turned on, the number of split screens is not limited to the number of physical interfaces. By associating each virtual display device with a display layer, each display layer can be simulated as an independent display device. By superimposing each display layer to obtain a superimposed display layer, multiple display layers can be combined into a complete single screen. By sending the superimposed display layer to a single physical display device through a physical interface, multiple full-screen exclusive application screens respectively associated with each virtual display device are displayed on the physical display device. It is possible to run multiple full-screen exclusive applications under the conditions of a single display screen and a single physical interface without relying on the display device's support for multi-input split-screen, picture-in-picture and other functions. The split-screen and picture-in-picture effects can also be achieved under the condition of a single output. At the same time, the application has better rendering performance in full-screen exclusive mode, so that the display effect is better and the display method is more diverse.

[0161] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0162] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0163] The embodiment of the present disclosure also proposes a split-screen display device, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0164] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0165] Fig. 9 1 is a block diagram of an apparatus 1900 for split-screen display on a display screen according to an exemplary embodiment. For example, the apparatus 1900 may be provided as a server or a terminal device. Fig. 9 , the apparatus 1900 includes a processing component 1922, which further includes one or more processors, and a memory resource represented by a memory 1932 for storing instructions, such as an application, that can be executed by the processing component 1922. The application stored in the memory 1932 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0166] The device 1900 may also include a power supply component 1926 configured to perform power management of the device 1900, a wired or wireless network interface 1950 configured to connect the device 1900 to a network, and an input / output interface 1958 (I / O interface). The device 1900 may operate based on an operating system stored in the memory 1932, such as Windows Server 2000. TM , MacOS X TM , Unix TM ,Linux TM , FreeBSD TM or similar.

[0167] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the device 1900 to perform the above method.

[0168] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0169] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0170] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0171] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0172] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0173] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0174] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0175] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0176] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. A split-screen display method, characterized in that: The method comprises: In response to the split screen function being turned on, determining a plurality of virtual display devices, each virtual display device being associated with a display layer; Performing a superposition process on the display layers corresponding to the multiple virtual display devices to obtain a display layer after the superposition process; The display layer after the overlay processing is sent to a single physical display device through a physical interface, so that the pictures of multiple full-screen exclusive applications respectively associated with each virtual display device are displayed on the physical display device.

2. The method according to claim 1, characterized in that In response to the split screen function being enabled, determining a plurality of virtual display devices includes: In response to the split screen function being turned on, determining configuration information of a plurality of virtual display devices, the configuration information including a resolution corresponding to each virtual display device; The method of performing superposition processing on the display layers corresponding to the multiple virtual display devices to obtain the display layers after superposition processing includes: Based on the configuration information of the multiple virtual display devices, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers; the resolution of the overlaid display layers is obtained based on the resolution of each virtual display device.

3. The method according to claim 2, characterized in that The configuration information includes split-screen layout information, and the superimposing processing is performed on each display layer corresponding to the plurality of virtual display devices to obtain the display layer after the superimposition processing, including: Based on the split-screen layout information, the hardware layer overlay function of the graphics card is used to set multiple virtual display layers at corresponding positions in a single display layer according to preset sizes, and the single display layer is used as the display layer after overlay processing.

4. The method according to claim 3, characterized in that: The split-screen layout information includes the number, position, size and superposition method of virtual display devices, and the resolution corresponding to each virtual display device is determined based on the size.

5. The method according to claim 2, characterized in that: The method further comprises: Obtaining content information to be displayed on each virtual display device; The content information to be displayed by each virtual display device is respectively configured to the display layer associated with the virtual display device; The method of performing superposition processing on the display layers corresponding to the multiple virtual display devices to obtain the display layers after superposition processing includes: Based on the configuration information of the multiple virtual display devices and the content information of the associated display layers, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

6. The method according to claim 2, characterized in that The method further comprises: Determining display timing information of each virtual display device according to the resolutions of the plurality of virtual display devices, wherein the display timing information includes a refresh rate; The method of performing superposition processing on the display layers corresponding to the multiple virtual display devices to obtain the display layers after superposition processing includes: Obtaining a vertical synchronization interrupt signal sent by each virtual display device based on a refresh rate; In response to the vertical synchronization interrupt signal, the display layers corresponding to the multiple virtual display devices are overlaid to obtain the overlaid display layers.

7. The method according to claim 6, characterized in that The refresh rate of each virtual display device is the same.

8. The method according to claim 1, characterized in that: The method further comprises: A preset number of virtual interfaces are added in the operating system through a driver interface, and the virtual interfaces are associated with each virtual display device.

9. The method according to claim 8, characterized in that The method further comprises: In response to the split screen function being turned on, setting the virtual interface corresponding to each virtual display device to a connected state, and setting the physical interface to a disconnected state; In response to the split screen function being turned off, the virtual interface corresponding to each virtual display device is set to a disconnected state, and the physical interface is set to a connected state.

10. A split-screen display device, characterized in that: The device comprises: A first determining module, configured to determine a plurality of virtual display devices in response to the split screen function being enabled, each virtual display device being associated with a display layer; An overlay processing module, used to perform overlay processing on each display layer corresponding to a plurality of virtual display devices to obtain a display layer after overlay processing; The sending module is used to send the display layer after the overlay processing to a single physical display device through a physical interface, so that the physical display device displays pictures of multiple full-screen exclusive applications respectively associated with each virtual display device.

11. A split-screen display device, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to implement the method described in any one of claims 1 to 9 when executing the instructions stored in the memory.

12. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 9 is implemented.

Images