Multi-window display method and device and storage medium

Abstract

The invention provides a multi-window display method and device and a storage medium, and the method comprises the steps: obtaining display information of a current screen in response to a received display operation, the display information comprising display images of a plurality of operation windows and a first height of a display picture center of the current screen, and the current screen being a screen on a display device corresponding to a user; determining a target virtual display screen corresponding to the current screen based on the first height; based on the target virtual display screen, determining a target window layout corresponding to the display images of the multiple operation windows; and displaying the display images of the plurality of operation windows on the target virtual display screen based on the target window layout. According to the method, the multiple running windows are displayed on the target virtual display screen at the same time, so that a user can see the content in the multiple running windows at the same time, the multiple running windows do not need to be repeatedly opened or a new display screen does not need to be additionally added, and the task processing efficiency of the multiple running windows and the user experience are improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of Virtual Reality (VR), and particularly relates to a multi-window display method and device and a storage medium. BACKGROUND

[0002] At present, Augmented Reality (AR) technology has developed rapidly, and the traditional screen interaction mode has significant defects in multi-task processing scenarios.

[0003] For example, when a user is performing a multi-window (such as multi-document reading) operation, due to the physical screen size of a notebook computer or a tablet computer and other mobile devices, all windows cannot be displayed on the display area of the device, at this time, the user needs to repeatedly open additional windows to cover the current window, thereby reducing the efficiency of task processing and the user experience. Meanwhile, the display area can be expanded by an external display to increase the number of display windows, but an additional space is required and it is inconvenient for the user to carry. SUMMARY

[0004] The multi-window display method, device and storage medium provided by the present disclosure aim to solve the technical problems that all windows cannot be displayed on the display area of the device, the task processing efficiency is low, and the user experience is poor in the prior art.

[0005] According to a first aspect of an embodiment of the present disclosure, a multi-window display method is provided, and the method comprises: In response to receiving a display operation, obtaining display information of a current screen, wherein the display information comprises display images of a plurality of running windows and a first height of a center of a current screen display picture, and the current screen is a screen on a display device corresponding to a user; Based on the first height, determining a target virtual display screen corresponding to the current screen; Based on the target virtual display screen, determining a target window layout corresponding to the display images of the plurality of running windows; Displaying the display images of the plurality of running windows on the target virtual display screen based on the target window layout.

[0006] Optionally, in the embodiment of the present disclosure, the determining, based on the first height, of the target virtual display screen corresponding to the current screen comprises: Determining a second height of a center of a virtual device shooting picture in a heads-up state of a user; Determining a height difference between the first height and the second height; determine a first height threshold and a second height threshold based on the first height, wherein the first height threshold and the second height threshold are used to determine a display condition corresponding to the height difference; determine a target virtual display screen corresponding to the current screen based on the height difference, the first height threshold and the second height threshold.

[0007] Optionally, in the embodiments of the present disclosure, the determining the target virtual display screen corresponding to the current screen based on the height difference, the first height threshold and the second height threshold comprises: if the height difference, the first height threshold and the second height threshold satisfy a first display condition, determining a virtual display screen corresponding to the first display condition as the target virtual display screen corresponding to the current screen; wherein the first display condition is that the height difference is greater than the first height threshold and less than the first height threshold, the target virtual display screen comprises a center virtual display screen, a first virtual display screen located on the left side of the center virtual display screen, a second virtual display screen located on the right side of the center virtual display screen, a third virtual display screen located above the center virtual display screen, and a fourth virtual display screen located below the center virtual display screen, the center virtual display screen is located at a preset distance in front of the current screen, and the first virtual display screen, the second virtual display screen, the third virtual display screen and the fourth virtual display screen have a preset inclination angle with the center virtual display screen.

[0008] Optionally, in the embodiments of the present disclosure, the determining the target virtual display screen corresponding to the current screen based on the height difference, the first height threshold and the second height threshold comprises: if the height difference, the first height threshold and the second height threshold satisfy a second display condition, determining a virtual display screen corresponding to the second display condition as the target virtual display screen corresponding to the current screen; wherein the second display condition is that the height difference is greater than the first height threshold and less than the second height threshold, the target virtual display screen comprises a center virtual display screen, a fifth virtual display screen located on the left side of the center virtual display screen, and a sixth virtual display screen located on the right side of the center virtual display screen, the center virtual display screen is located above the current screen and is aligned with the current screen or is located at a preset distance in front of the current screen, and the fifth virtual display screen and the sixth virtual display screen have a preset inclination angle with the center virtual display screen.

[0009] Optionally, in the embodiments of the present disclosure, the determining the target virtual display screen corresponding to the current screen based on the height difference, the first height threshold and the second height threshold comprises: if the height difference, the first height threshold and the second height threshold satisfy a third display condition, determining a virtual display screen corresponding to the third display condition as the target virtual display screen corresponding to the current screen; wherein the third display condition is that the height difference is greater than -the second height threshold and less than -the first height threshold, the target virtual display screen comprises a center virtual display screen, a seventh virtual display screen located on the left side of the center virtual display screen, and an eighth virtual display screen located on the right side of the center virtual display screen, the center virtual display screen is located below the current screen and is aligned with the current screen or at a preset distance in front of the current screen, and the seventh virtual display screen and the eighth virtual display screen have a preset inclination angle with the center virtual display screen.

[0010] Optionally, the determining the target window layout corresponding to the display images of the plurality of running windows based on the target virtual display screen comprises: obtaining an initial window layout corresponding to the target virtual display screen, the initial window layout comprising a preset placement area of a running window on the target virtual display screen; determining a coincidence area rate of the running window and the preset placement area; if the coincidence area rate is greater than or equal to a preset threshold, determining the preset placement area as a target placement area of the running window; otherwise, triggering a user manual adjustment prompt to determine the target placement area of the running window; determining the target placement area corresponding to the plurality of running windows as the target window layout corresponding to the display images of the plurality of running windows.

[0011] Optionally, in the embodiments of the present disclosure, before the display images of the plurality of running windows are displayed on the target virtual display screen based on the target window layout, the method further comprises: performing magnification processing on the display images of the running windows to obtain magnified display images; determining a real-time distance between a user and the current screen; if the real-time distance exceeds a distance threshold, performing image enhancement processing on the magnified display images to obtain target display images; displaying the target display images on the target virtual display screen based on the target window layout.

[0012] Optionally, in the embodiments of the present disclosure, the method further comprises: generate an auxiliary virtual display screen connected with the center virtual display screen; acquire a display picture of the current screen in real time, and identify a mouse position coordinate in the display picture; generate an enhanced display picture in the auxiliary virtual display screen based on the mouse position coordinate.

[0013] Optionally, in the embodiments of the present disclosure, the generating the enhanced display picture in the auxiliary virtual display screen based on the mouse position coordinate comprises: render a mouse pointer in the display picture through a highlight effect; determine a corresponding zoom-in area centered on the mouse position coordinate, and perform local zoom-in display on a picture in the zoom-in area.

[0014] Optionally, in the embodiments of the present disclosure, the method further comprises: automatically close the enhanced display picture when it is detected that the mouse moves into a window picture of the target virtual display screen.

[0015] According to a second aspect of the embodiments of the present disclosure, a multi-window display device is provided, and the device comprises: an acquisition module configured to acquire display information of a current screen in response to receiving a display operation, wherein the display information comprises display images of a plurality of running windows and a first height of a display picture of the current screen, and the current screen is a screen on a display device corresponding to a user; a first determination module configured to determine a target virtual display screen corresponding to the current screen based on the first height; a second determination module configured to determine a target window layout corresponding to the display images of the plurality of running windows based on the target virtual display screen; a display module configured to display the display images of the plurality of running windows on the target virtual display screen based on the target window layout.

[0016] According to a third aspect of the embodiments of the present disclosure, an electronic device is provided, and the device comprises: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the method in the first aspect.

[0017] According to a fourth aspect of the embodiments of the present disclosure, a virtual device is provided, and the device comprises the electronic device in the third aspect or is connected with the electronic device in the third aspect.

[0018] According to a fifth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, and the computer-readable storage medium stores computer executable instructions; the computer executable instructions, when executed by a processor, enable the method in the first aspect to be implemented.

[0019] According to a sixth aspect of the embodiments of the present disclosure, a computer program product is provided, and the computer program product comprises a computer program, and the computer program, when executed by a processor, implements the method in the first aspect.

[0020] The technical solutions provided by the embodiments of the present disclosure can include the following beneficial effects: The method comprises the following steps: in response to receiving a display operation, obtaining display information of a current screen, wherein the display information comprises display images of a plurality of running windows and a first height of a center of a current screen display picture, and the current screen is a screen on a display device corresponding to a user; determining a target virtual display screen corresponding to the current screen based on the first height; determining a target window layout corresponding to the display images of the plurality of running windows based on the target virtual display screen; and displaying the display images of the plurality of running windows on the target virtual display screen based on the target window layout. Thus, the present disclosure can display the plurality of running windows on the target virtual display screen at the same time, so that the user can see the corresponding content of the plurality of running windows at the same time, without the need to repeatedly open the plurality of running windows or additionally increase a new display screen, thereby improving the task processing efficiency of the plurality of running windows, facilitating the user to use, and improving the user experience.

[0021] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS The accompanying drawings, which are incorporated into and form part of the specification, illustrate embodiments consistent with the present disclosure and, together with the specification, serve to explain the principles of the present disclosure.

[0022] Figure 1 is a flowchart of a multi-window display method according to some embodiments of the present disclosure; Figure 2 is a flowchart of a multi-window display method according to some embodiments of the present disclosure; Figure 3 is a schematic diagram of a target virtual display screen according to some embodiments of the present disclosure; Figure 4 is a schematic diagram of a target virtual display screen according to some embodiments of the present disclosure; Figure 5 is a schematic diagram of a target virtual display screen according to some embodiments of the present disclosure; Figure 6 FIG. 1 is a flow diagram of a multi-window display method according to some embodiments of the present disclosure; Figure 7 and Figure 8 FIG. 2 is a schematic diagram of an initial window layout according to some embodiments of the present disclosure; Figure 9 and Figure 10 FIG. 3 is a schematic diagram of an initial window layout according to some embodiments of the present disclosure; Figure 11 and Figure 12 FIG. 4 is a schematic diagram of an initial window layout according to some embodiments of the present disclosure; Figure 13 FIG. 5 is a flow diagram of a multi-window display method according to some embodiments of the present disclosure; Figure 14 FIG. 6 is a schematic diagram of an auxiliary virtual display screen according to some embodiments of the present disclosure; Figure 15 FIG. 7 is a structural diagram of a multi-window display device according to some embodiments of the present disclosure; Figure 16 FIG. 8 is a block diagram of an electronic device suitable for performing a multi-window display method according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0023] Some embodiments of the present disclosure will be described in detail herein with reference to the attached drawings. The following description is made with reference to the accompanying drawings in which like reference numerals refer to like elements in which the various elements are not necessarily drawn to scale. Various changes, modifications, and equivalents will become apparent to those skilled in the art once the present disclosure is made. For instance, the order in which operations are described is merely exemplary and not restrictive, and the operations can be rearranged, except in such cases where the order of certain operations is essential, as will be appreciated by those skilled in the art upon a study of the present disclosure. Moreover, descriptions of features in terms of being positioned above, below, or adjacent to other features are made by way of example only, and can be altered as desired.

[0024] The implementations described below in some embodiments of the present disclosure are not meant to represent all implementations consistent with the present disclosure. Rather, they are examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0025] Augmented reality is a technology that fuses digital information with the real world. Among them, through the camera, sensor, display screen (such as smart phone screen, smart glasses or head-mounted display) and other devices, AR technology can identify and track the real environment, and superimpose computer-generated images, sounds, 3D models, videos or other types of virtual content on the real scene in the user's field of view in real time, so that the user can see the real world entities and virtual information at the same time when using AR, combining the two elements, enhancing the user's understanding of the surrounding environment and interactive experience.

[0026] Figure 1 is a flowchart of a multi-window display method according to some embodiments of the present disclosure, as shown in Figure 1 The method can include the following steps: Step 101, in response to receiving a display operation, obtaining display information of the current screen, wherein the display information includes display images of a plurality of running windows and a first height of the center of the current screen display picture.

[0027] It should be noted that the execution subject of the above multi-window display method is a multi-window display device, which can be realized by software and / or hardware. The multi-window display device in this embodiment can be configured in an electronic device.

[0028] In the present example embodiment, the electronic device can include terminal equipment and server equipment, and the terminal equipment can be virtual equipment such as VR equipment, AR equipment or robots, etc. The server can be a traditional server or a cloud server, etc. In the present embodiment, it is not limited.

[0029] In the present embodiment of the present disclosure, the above-mentioned current screen can be the screen on the display device corresponding to the user.

[0030] In the present embodiment of the present disclosure, when the number of windows opened on the current screen is a preset number or more, the user can trigger a display operation to display a plurality of running windows on a virtual screen. The above-mentioned preset number can be set as needed, such as 2.

[0031] In the present embodiment of the present disclosure, in response to receiving the display operation, the display information of the current screen can be obtained through the camera on the virtual equipment, so that the plurality of running windows can be displayed on the virtual screen based on the display information in the subsequent. Among them, the display information includes the display images of the plurality of running windows and the first height of the center of the current screen display picture.

[0032] Step 102, determining a target virtual display screen corresponding to the current screen based on the first height.

[0033] In the embodiments of the present disclosure, after the first height is obtained through the above steps, the height difference between the center point of the shooting picture of the virtual device and the first height can be determined based on the first height, so as to determine the target virtual display screen in line with the user's head-up state based on the height difference, so that the user can read the content in the multi-window without lifting or lowering the head, thereby facilitating the user to use and improving the user experience.

[0034] In the embodiments of the present disclosure, the target virtual display screen corresponding to different height differences is also different.

[0035] Specifically, in the embodiments of the present disclosure, if the height difference meets the first display condition, the virtual display screen corresponding to the first display condition is determined as the target virtual display screen corresponding to the current screen; if the height difference meets the second display condition, the virtual display screen corresponding to the second display condition is determined as the target virtual display screen corresponding to the current screen; and if the height difference meets the third display condition, the virtual display screen corresponding to the third display condition is determined as the target virtual display screen corresponding to the current screen.

[0036] In step 103, a target window layout corresponding to the display images of the multiple running windows is determined based on the target virtual display screen.

[0037] In the embodiments of the present disclosure, after the target virtual display screen is obtained through the above steps, the target window layout corresponding to the display images of the multiple running windows can be determined based on the target virtual display screen, so that the display images of the multiple running windows can be displayed on the target virtual display screen based on the target window layout subsequently.

[0038] In the embodiments of the present disclosure, the method for determining the target window layout corresponding to the display images of the multiple running windows based on the target virtual display screen can include: obtaining an initial window layout corresponding to the target virtual display screen, the initial window layout including a preset placement area of the running window on the target virtual display screen, and determining an overlapping area rate of the running window and the preset placement area; if the overlapping area rate is greater than or equal to a preset threshold, the preset placement area is determined as the target placement area of the running window; otherwise, a user manual adjustment prompt is triggered, and the target placement area of the running window is determined; and the target placement areas corresponding to the multiple running windows are determined as the target window layout corresponding to the display images of the multiple running windows.

[0039] In step 104, the display images of the multiple running windows are displayed on the target virtual display screen based on the target window layout.

[0040] In the embodiments of the present disclosure, after the target window layout of the multiple running windows is determined through the above steps, the display images of the multiple running windows can be displayed on the target virtual display screen based on the target window layout.

[0041] In the embodiments of the present disclosure, the window edges in the display images of the multiple running windows are identified, the corresponding multiple window frames are obtained, and the images of the window frames are displayed in the corresponding target placement areas in real time based on the target window layout, so that the multiple running windows can be displayed on the target virtual display screen at the same time, the user can see the contents in the multiple running windows at the same time, the multiple running windows do not need to be opened repeatedly or a new display screen needs to be added, the task processing efficiency of the multiple running windows is improved, the user is facilitated, and the user experience is improved.

[0042] In addition, in the embodiments of the present disclosure, before the display images of the multiple running windows are displayed on the target virtual display screen based on the target window layout, the method can further include the following steps: In step 1041, the display image of the running window is enlarged to obtain an enlarged display image.

[0043] In the embodiments of the present disclosure, the display image of the running window is enlarged to obtain an enlarged display image, so that the user can see the enlarged display image, and the contents in the multiple running windows can be read clearly at the same time, and the reading efficiency of the multiple windows is improved.

[0044] In the embodiments of the present disclosure, when the display image of the running window is enlarged, the enlargement degree of the display image can be determined according to the area of the display image of the running window and the area of the corresponding target placement area, so that the enlarged display image does not exceed the target placement area too much. For example, the ratio of the image area of the enlarged display image to the area of the corresponding target placement area is a preset value (such as 1.2).

[0045] In step 1042, the real-time distance between the user and the current screen is determined.

[0046] In the embodiments of the present disclosure, the distance between the virtual device camera and the current screen can be determined as the real-time distance between the user and the current screen.

[0047] In step 1043, if the real-time distance exceeds the distance threshold, the enlarged display image is image-enhanced to obtain a target display image.

[0048] In the embodiments of the present disclosure, if the real-time distance exceeds the distance threshold, it indicates that the distance between the user and the current screen is far, and the problem of unclear text in the enlarged display image can occur. At this time, the user can distinguish the text in the corresponding enlarged display image, but the reading efficiency can be reduced, and the problem of eye fatigue can occur. Based on this, the picture enhancement neural network or the text repair neural network can be used to image-enhance the enlarged display image to obtain a target display image with higher clarity, so that the user can better improve the reading efficiency and relieve the eye fatigue, and the user experience is improved.

[0049] In the embodiments of the present disclosure, if the real-time distance does not exceed the distance threshold, it indicates that the distance between the user and the current screen is close, and the image enhancement processing on the zoomed display image is not needed, and then the zoomed display image can be determined as the target display image.

[0050] In step 1044, the target display image is displayed on the target virtual display screen based on the target window layout.

[0051] In the embodiments of the present disclosure, after the target display image is obtained through the above steps, the target display image can be displayed in the corresponding target placement area based on the target window layout, so that the target display images of the multiple running windows can be displayed on the target virtual display screen at the same time.

[0052] In the embodiments of the present disclosure, the window frame can be displayed on the edge of each running window picture, so as to facilitate the user to adjust the placement area of each running window.

[0053] The present disclosure provides a multi-window display method, which comprises the following steps: in response to receiving a display operation, obtaining display information of a current screen, wherein the display information comprises display images of multiple running windows and a first height of a center of a display picture of the current screen, and the current screen is a screen on a display device corresponding to a user; determining a target virtual display screen corresponding to the current screen based on the first height; determining a target window layout corresponding to the display images of the multiple running windows based on the target virtual display screen; and displaying the display images of the multiple running windows on the target virtual display screen based on the target window layout. Thus, the present disclosure can display the multiple running windows on the target virtual display screen at the same time, so that the user can see the contents in the multiple running windows at the same time, without the need to repeatedly open the multiple running windows or additionally increase a new display screen, thereby improving the task processing efficiency of the multiple running windows, facilitating the user to use, and improving the user experience.

[0054] In the embodiments of the present disclosure, as a refinement of step 102, as shown in Figure 2 The method can further comprise the following steps: In step 1021, a second height of a center of a shooting picture of the virtual device corresponding to the user in the sight-levelling state is determined.

[0055] In an embodiment of the present disclosure, whether the user is in the sight-levelling state can be identified through calculation of an angle between an optical axis of a camera of the virtual device and a display plane of the current screen or through optical eye tracking. In the embodiments of the present disclosure, when the angle between the optical axis of the camera of the virtual device and the display plane of the current screen is less than a preset angle (for example, 15°), it is determined that the user is in the sight-levelling state.

[0056] In another embodiment of the present disclosure, the looking-up state can be a state set by the user. In an embodiment of the present disclosure, a certain body posture maintained by the user for more than a preset time (e.g., 10 minutes) can set the body posture as the looking-up state.

[0057] Step 1022, determining a height difference between the first height and the second height.

[0058] In an embodiment of the present disclosure, the height difference between the first height and the second height can be a height difference between a center point of a photographed picture of the current virtual device in the looking-up state and a center point of a current screen display picture, so that a virtual display screen suitable for the user's line of sight can be determined according to the height difference.

[0059] Step 1023, determining a first height threshold value and a second height threshold value corresponding to the first height.

[0060] In an embodiment of the present disclosure, the first height threshold value and the second height threshold value are used to determine a display condition corresponding to the height difference.

[0061] In an embodiment of the present disclosure, the first height threshold value can be 1 / 2 x the first height, and the second height threshold value can be the first height.

[0062] For example, in an embodiment of the present disclosure, assuming that the first height is h, the first height threshold value is 0.5h, and the second height threshold value is h.

[0063] Step 1024, determining a target virtual display screen corresponding to the current screen based on the height difference, the first height threshold value, and the second height threshold value.

[0064] In an embodiment of the present disclosure, after the height difference, the first height threshold value, and the second height threshold value are obtained through the above steps, a target virtual display screen corresponding to the current screen can be determined based on the height difference, the first height threshold value, and the second height threshold value.

[0065] In an embodiment of the present disclosure, when the display conditions satisfied by the height difference, the first height threshold value, and the second height threshold value are different, the corresponding target virtual display screen is also different.

[0066] Specifically, in an embodiment of the present disclosure, if the height difference, the first height threshold value, and the second height threshold value satisfy a first display condition, a virtual display screen corresponding to the first display condition is determined as the target virtual display screen corresponding to the current screen, where the first display condition is that the height difference is greater than the first height threshold value and less than the second height threshold value.

[0067] In an embodiment of the present disclosure, Figure 3 A schematic diagram of a target virtual display screen is provided for an embodiment of the present disclosure. As shown in FIG. 6, a virtual display screen corresponding to a current screen is determined as a target virtual display screen. Figure 3As shown, the target virtual display screen includes a center virtual display screen, a first virtual display screen located on the left side of the center virtual display screen, a second virtual display screen located on the right side of the center virtual display screen, a third virtual display screen located above the center virtual display screen, and a fourth virtual display screen located below the center virtual display screen. The center virtual display screen is located at a preset distance in front of the current screen, and the first virtual display screen, the second virtual display screen, the third virtual display screen, and the fourth virtual display screen are at a preset inclination angle with the center virtual display screen.

[0068] In the embodiment of the present disclosure, the preset distance can be (1cm, 3cm), and the center virtual display screen and the display screen of the current screen are parallel to each other. In the embodiment of the present disclosure, if the virtual display screens around the center virtual display screen are not inclined, the user needs to look obliquely to watch the virtual display screen, and the content at the edge of the virtual display screen may not be clear, which can easily cause eye fatigue. Therefore, the first virtual display screen, the second virtual display screen, the third virtual display screen, and the fourth virtual display screen are at a preset inclination angle with the center virtual display screen, and the preset inclination angle can be 15°.

[0069] In the embodiment of the present disclosure, after obtaining the target virtual display screen through the above steps, an empty plane entity object can be created, and a default material component and a picture texture can be attached to the object. The size of the plane entity object is set to be the same as the size of the display screen of the current screen, the position of the plane entity object is the center virtual display screen, and the plane entity object is determined as the center plane entity object. The center plane entity object and the display screen of the current screen are parallel to each other. Based on the above steps, the corresponding surrounding plane entity objects are obtained, and the side of the surrounding plane entity objects close to the center plane entity object is aligned with the side of the center entity object by moving the anchor point of the plane entity object.

[0070] In another embodiment of the present disclosure, if the height difference, the first height threshold, and the second height threshold satisfy the second display condition, the virtual display screen corresponding to the second display condition is determined as the target virtual display screen corresponding to the current screen, wherein the second display condition is that the height difference is greater than the first height threshold and less than the second height threshold.

[0071] In the embodiment of the present disclosure, Figure 4 Another schematic diagram of a target virtual display screen proposed in the embodiment of the present disclosure is shown in FIG. 6. As shown in FIG. 6, the target virtual display screen includes a center virtual display screen, a first virtual display screen located on the left side of the center virtual display screen, a second virtual display screen located on the right side of the center virtual display screen, a third virtual display screen located above the center virtual display screen, and a fourth virtual display screen located below the center virtual display screen. The center virtual display screen is located at a preset distance in front of the current screen, and the first virtual display screen, the second virtual display screen, the third virtual display screen, and the fourth virtual display screen are at a preset inclination angle with the center virtual display screen. Figure 4As shown, the target virtual display screen includes a center virtual display screen, a fifth virtual display screen located on the left side of the center virtual display screen, and a sixth virtual display screen located on the right side of the center virtual display screen. The center virtual display screen is located above the current screen and is aligned with the current screen or is at a preset distance in front of the current screen. The fifth virtual display screen and the sixth virtual display screen have a preset inclination angle with the center virtual display screen.

[0072] In the embodiments of the present disclosure, the preset distance and the preset inclination angle are the same as the above description, and the embodiments of the present disclosure will not be repeated here.

[0073] In another embodiment of the present disclosure, if the height difference, the first height threshold and the second height threshold satisfy a third display condition, a virtual display screen corresponding to the third display condition is determined as the target virtual display screen corresponding to the current screen, wherein the third display condition is that the height difference is greater than the first height threshold and less than the second height threshold.

[0074] In the embodiments of the present disclosure, Figure 5 Another schematic diagram of a target virtual display screen proposed in an embodiment of the present disclosure is shown in FIG. 6. As shown, Figure 5 As shown, the target virtual display screen includes a center virtual display screen, a seventh virtual display screen located on the left side of the center virtual display screen, and an eighth virtual display screen located on the right side of the center virtual display screen. The center virtual display screen is located below the current screen and is aligned with the current screen or is at a preset distance in front of the current screen. The seventh virtual display screen and the eighth virtual display screen have a preset inclination angle with the center virtual display screen.

[0075] In the embodiments of the present disclosure, the preset distance and the preset inclination angle are the same as the above description, and the embodiments of the present disclosure will not be repeated here.

[0076] In the embodiments of the present disclosure, after the target virtual display screen is determined through the above steps, if the spatial position of the target virtual display screen is blocked by the position of the display device, the dots of all virtual display screens in the target virtual display screen are moved towards the direction close to the virtual device camera, so that the target virtual display screen does not interfere with the objects in reality, or the depth value of the target virtual display screen is set to be smaller than the actual value in the blocking process, so that the target virtual display screen is not blocked by the objects in reality, and the display quality of the target virtual display screen is ensured.

[0077] Through the above steps, the height difference between the center point of the shooting picture of the virtual device and the first height can be determined based on the first height, and the target virtual display screen meeting the user's head-up state can be determined based on the height difference, so as to facilitate the user to use and improve the user experience.

[0078] In the embodiments of the present disclosure, as a refinement of step 103, as shown in Figure 6 , the method can further include: Step 1031, obtaining an initial window layout corresponding to the target virtual display screen, the initial window layout including preset placement areas of the running windows on the target virtual display screen.

[0079] In the embodiments of the present disclosure, each virtual display screen in the target virtual display screen can be divided into a left area and a right area, so that each virtual display screen can display two windows at the same time. Based on this, in the embodiments of the present disclosure, different target virtual display screens correspond to different initial window layouts.

[0080] Specifically, in the embodiments of the present disclosure, when the target virtual display screen is a virtual display screen corresponding to a first display condition (for example, Figure 3 ), the corresponding initial window layout is as shown in Figure 7 and Figure 8 , each virtual display screen has a left area and a right area, each area can be arranged, and each area is sequentially numbered, so that, as shown in Figure 8 , the target virtual display screen can have 1, 2, 3, …, 10 preset placement areas.

[0081] In the embodiments of the present disclosure, when the target virtual display screen is a virtual display screen corresponding to a second display condition (for example, Figure 4 ), the corresponding initial window layout is as shown in Figure 9 and Figure 10 , each virtual display screen has a left area and a right area, each area can be arranged, and each area is sequentially numbered, so that, as shown in Figure 10 , the target virtual display screen can have 1, 2, 3, …, 6 preset placement areas.

[0082] In the embodiments of the present disclosure, when the target virtual display screen is a virtual display screen corresponding to a third display condition (for example, Figure 5 ), the corresponding initial window layout is as shown in Figure 11 and Figure 12 , each virtual display screen has a left area and a right area, each area can be arranged, and each area is sequentially numbered, so that, as shown in Figure 12 , the target virtual display screen can have 1, 2, 3, …, 6 preset placement areas.

[0083] In an embodiment of the present disclosure, a plurality of running windows can be numbered according to the opening order, and based on this, the corresponding preset placement area can be obtained based on the number.

[0084] In another embodiment of the present disclosure, the arrangement model can be trained by collecting the data set of the arrangement mode of each placement area, and the preset placement area corresponding to each running window is identified by the trained arrangement model.

[0085] Step 1032, determining the coincidence area rate of the running window and the preset placement area.

[0086] In the embodiment of the present disclosure, after determining the preset placement area corresponding to the running window through the above steps, the coincidence area rate of the running window and the preset placement area can be determined, so that the placement area of the running window can be adjusted according to the coincidence area rate subsequently.

[0087] In the embodiment of the present disclosure, the coincidence area rate A of the running window and the preset placement area is determined by the coincidence area rate calculation formula, wherein the coincidence area rate calculation formula is:

[0088] wherein, is the area of the window in the preset placement area, is the area of the entire running window.

[0089] Step 1033, if the coincidence area rate is greater than or equal to a preset threshold, the preset placement area is determined as the target placement area of the running window; otherwise, a user manual adjustment prompt is triggered to determine the target placement area of the running window.

[0090] In the embodiment of the present disclosure, after determining the coincidence area rate through the above steps, whether to adjust the placement area of the running window can be determined according to the coincidence area rate.

[0091] In the embodiment of the present disclosure, if the coincidence area rate is greater than or equal to a preset threshold, it indicates that the running window can be placed in the preset placement area, and the preset placement area is determined as the target placement area of the running window; otherwise, it indicates that the coincidence area rate of the running window is small, and the running window is not suitable for being placed in the preset placement area. At this time, a user manual adjustment prompt can be triggered, and the running window is moved by the user. The placement area with the coincidence area rate greater than the preset threshold between the running window and the placement area is determined as the target placement area of the running window. In the embodiment of the present disclosure, the above-mentioned preset threshold can be set as needed.

[0092] Step 1034, the target placement areas corresponding to the plurality of running windows are determined as the target window layout corresponding to the display image of the plurality of running windows.

[0093] In the embodiments of the present disclosure, after the target placement area corresponding to the plurality of running windows is determined through the above steps, the target window layout corresponding to the display image of the plurality of running windows is determined according to the target placement area corresponding to the plurality of running windows, so that the plurality of running windows can be displayed on the corresponding target placement area at the same time, and the user can see the corresponding content of the plurality of running windows through the target virtual display screen at the same time, without the need to repeatedly open the plurality of running windows or additionally increase a new display screen, thereby improving the task processing efficiency of the plurality of running windows, facilitating user use, and improving user experience.

[0094] In the embodiments of the present disclosure, as a refinement of step 102, as shown in Figure 13 may further include: Step S1, generating an auxiliary virtual display screen connected with the center virtual display screen.

[0095] In the embodiments of the present disclosure, Figure 14 a schematic diagram of an auxiliary virtual display screen proposed in the embodiments of the present disclosure is shown in Figure 14 The auxiliary virtual display screen is connected with one corner point of the center virtual screen, is located at the lower left side of the center virtual screen, and the screen size of the auxiliary virtual display screen can be set according to needs.

[0096] In the embodiments of the present disclosure, through the above auxiliary virtual reality screen, the display image in the current screen can be synchronously displayed.

[0097] Step S2, acquiring the display image of the current screen in real time, and identifying the mouse position coordinates in the display image.

[0098] In the embodiments of the present disclosure, the display image of the current screen can be acquired in real time, and the mouse position coordinates in the display image can be identified, so that a corresponding enhanced display image can be generated according to the mouse position coordinates subsequently.

[0099] Step S3, generating an enhanced display image in the auxiliary virtual display screen based on the mouse position coordinates.

[0100] In the embodiments of the present disclosure, after the mouse position coordinates are obtained through the above steps, an enhanced display image can be generated in the auxiliary virtual display screen based on the mouse position coordinates, so that the user can view the position of the mouse through the auxiliary virtual display screen, and the situation that the user does not know the position of the mouse when the mouse does not move into the window image can be avoided.

[0101] In the embodiments of the present disclosure, the method for generating the enhanced display picture in the auxiliary virtual display screen based on the mouse position coordinates can include: rendering and displaying the mouse pointer in the display picture through a highlighting effect, determining a corresponding zoom-in area centered on the mouse position coordinates, and locally zooming in and displaying the picture in the zoom-in area. The zoom-in area can be set according to the user's needs.

[0102] In the embodiments of the present disclosure, when it is detected that the mouse moves into the window picture of the target virtual display screen, at this time the user can view the position of the mouse through the target virtual display screen, and the enhanced display picture is automatically closed, so that the user can view the position of the mouse in real time, the situation that the user does not know the position of the mouse when the mouse does not move into the window picture is avoided, and energy consumption is saved.

[0103] Figure 15 A multi-window display device is shown according to some embodiments of the present disclosure, as shown in FIG. 1, Figure 15 The device can include: The acquisition module 1501 is configured to acquire display information of a current screen in response to receiving a display operation, wherein the display information includes display images of a plurality of running windows and a first height of a current screen display picture, and the current screen is a screen on a display device corresponding to a user. The first determination module 1502 is configured to determine a target virtual display screen corresponding to the current screen based on the first height. The second determination module 1503 is configured to determine a target window layout corresponding to the display images of the plurality of running windows based on the target virtual display screen. The display module 1504 is configured to display the display images of the plurality of running windows on the target virtual display screen based on the target window layout.

[0104] In the embodiments of the present disclosure, the first determination module 1502 is specifically configured to: determine a second height of a center of a shooting picture of a virtual device corresponding to the user in a heads-up state; determine a height difference between the first height and the second height; determine a first height threshold value and a second height threshold value corresponding to the first height, wherein the first height threshold value and the second height threshold value are used to determine a display condition corresponding to the height difference; determine the target virtual display screen corresponding to the current screen based on the height difference, the first height threshold value, and the second height threshold value.

[0105] Optionally, in the embodiments of the present disclosure, the first determination module 1502 is further configured to: If the height difference, the first height threshold and the second height threshold satisfy the first display condition, a virtual display screen corresponding to the first display condition is determined as the target virtual display screen corresponding to the current screen; The first display condition is that the height difference is greater than -the first height threshold and less than the first height threshold, the target virtual display screen includes a center virtual display screen, a first virtual display screen located on the left side of the center virtual display screen, a second virtual display screen located on the right side of the center virtual display screen, a third virtual display screen located above the center virtual display screen, and a fourth virtual display screen located below the center virtual display screen. The center virtual display screen is located at a preset distance in front of the current screen, and the first virtual display screen, the second virtual display screen, the third virtual display screen and the fourth virtual display screen have a preset inclination angle with the center virtual display screen.

[0106] Optionally, in the embodiments of the present disclosure, the first determination module 1502 is further configured to: If the height difference, the first height threshold and the second height threshold satisfy the second display condition, a virtual display screen corresponding to the second display condition is determined as the target virtual display screen corresponding to the current screen. The second display condition is that the height difference is greater than the first height threshold and less than the second height threshold, the target virtual display screen includes a center virtual display screen, a fifth virtual display screen located on the left side of the center virtual display screen, and a sixth virtual display screen located on the right side of the center virtual display screen. The center virtual display screen is located above the current screen and is aligned with the current screen or is located at a preset distance in front of the current screen, and the fifth virtual display screen and the sixth virtual display screen have a preset inclination angle with the center virtual display screen.

[0107] Optionally, in the embodiments of the present disclosure, the first determination module 1502 is further configured to: If the height difference, the first height threshold and the second height threshold satisfy the third display condition, a virtual display screen corresponding to the third display condition is determined as the target virtual display screen corresponding to the current screen. The third display condition is that the height difference is greater than -the second height threshold and less than -the first height threshold, the target virtual display screen includes a center virtual display screen, a seventh virtual display screen located on the left side of the center virtual display screen, and an eighth virtual display screen located on the right side of the center virtual display screen. The center virtual display screen is located below the current screen and is aligned with the current screen or is located at a preset distance in front of the current screen, and the seventh virtual display screen and the eighth virtual display screen have a preset inclination angle with the center virtual display screen.

[0108] Optionally, in the embodiments of the present disclosure, the second determination module 1503 is specifically configured to: obtain an initial window layout corresponding to the target virtual display screen, the initial window layout comprising preset placement regions of running windows on the target virtual display screen; determine an overlapping area rate of the running window and the preset placement region; if the overlapping area rate is greater than or equal to a preset threshold, determine the preset placement region as a target placement region of the running window; otherwise, trigger a user manual adjustment prompt to determine the target placement region of the running window; determine target placement regions corresponding to the plurality of running windows as a target window layout corresponding to display images of the plurality of running windows.

[0109] Optionally, in the embodiments of the present disclosure, the apparatus is further used for: performing magnification processing on the display image of the running window to obtain a magnified display image; determining a real-time distance between the user and the current screen; if the real-time distance exceeds a distance threshold, performing image enhancement processing on the magnified display image to obtain a target display image; displaying the target display image on the target virtual display screen based on the target window layout.

[0110] Optionally, in the embodiments of the present disclosure, the apparatus is further used for: generating an auxiliary virtual display screen connected to the center virtual display screen; real-time obtaining a display picture of the current screen, and identifying a mouse position coordinate in the display picture; generating an enhanced display picture in the auxiliary virtual display screen based on the mouse position coordinate.

[0111] Optionally, in the embodiments of the present disclosure, the apparatus is further used for: rendering a mouse pointer in the display picture through a highlight effect; determining a corresponding magnification region centered on the mouse position coordinate, and performing local magnification display on the picture in the magnification region.

[0112] Optionally, in the embodiments of the present disclosure, the apparatus is further used for: when detecting that the mouse moves into a window picture of the target virtual display screen, automatically closing the enhanced display picture.

[0113] As Figure 16As shown, the electronic device 1600 includes a computing unit 1601 that can perform various appropriate actions and processes in accordance with a computer program stored in a read-only memory (ROM) 1602 or a computer program loaded into a random access memory (RAM) 1603 from a storage unit 1608. Various programs and data required for the operation of the electronic device 1600 can also be stored in the RAM 1603. The computing unit 1601, the ROM 1602, and the RAM 1603 are connected to each other through a bus 1604. An input / output (I / O) interface 1605 is also connected to the bus 1604.

[0114] A plurality of components in the electronic device 1600 are connected to the I / O interface 1605, including an input unit 1606 such as a keyboard, a mouse, etc., an output unit 1607 such as various types of displays, a speaker, etc., a storage unit 1608 such as a magnetic disk, an optical disk, etc., and a communication unit 1609 such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 1609 allows the electronic device 1600 to exchange information / data with other electronic devices through a computer network such as the Internet and / or various telecommunication networks.

[0115] The computing unit 1601 can be various general and / or special purpose processing components having processing and computing capabilities. Some examples of the computing unit 1601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 1601 performs various methods and processes described above, such as the multi-window display method. For example, in some embodiments, the multi-window display method can be implemented as a computer software program that is tangibly embodied in a machine-readable medium, such as the storage unit 1608. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 1600 via the ROM 1602 and / or the communication unit 1609. When the computer program is loaded into the RAM 1603 and executed by the computing unit 1601, one or more steps of the multi-window display method described above can be performed. Alternatively, in other embodiments, the computing unit 1601 can be configured to perform the multi-window display method by any other appropriate means, such as by means of firmware.

[0116] Various implementations of the above described apparatus and techniques of this document can be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) computer hardware, firmware, software, and / or combinations thereof. These various implementations can include implementation in one or more computer programs that are executable and / or interpretable on a programmable computing device comprising at least one programmable processor, which can be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, at least one input device, and at least one output device.

[0117] Program code for carrying out methods of the present disclosure can be written in any combination of one or more programming languages. The program code can be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the program code, when executed by the processor or controller, produces a means for implementing the functions / acts specified in the flowcharts and / or block diagrams. The program code can be executed entirely on a machine, partially on a machine, partially on a machine and partially on a remote machine or entirely on a remote machine or server.

[0118] In the context of this disclosure, a machine-readable medium can be a tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or electronic device. The machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include but is not limited to an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or electronic device, or any suitable combination of the foregoing. More specific examples of the machine-readable storage medium will include one or more lines of electrical connections, portable computer disks, hard disk drives, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or Flash memory), optical fibers, portable compact disc read-only memories (CD-ROMs), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0119] To provide for interaction with a user, the devices and techniques described here can be implemented on a computer having a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can be used to provide for interaction with a user as well; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form, including acoustic, speech, or tactile input.

[0120] The devices and techniques described here can be implemented in a computing device that includes a back end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front end component (e.g., a user computer having a graphical user interface or a Web browser through which a user can interact with an implementation of the devices and techniques described here), or any combination of such back end, middleware, or front end components. The components of the device can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), the Internet, and a blockchain network.

[0121] The computer device can include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. A server can be a cloud server, also known as cloud computing server or cloud host, which is a host product in the cloud computing service system, to solve the defects of large management difficulty and weak business scalability in traditional physical host and VPS service ("Virtual Private Server", or simply "VPS"). The server can also be a server of a distributed device, or a server combined with a blockchain.

[0122] It should be understood that various forms of flow shown above can be used with orders of steps reordered, added to, or removed. For example, the steps recited in the present disclosure can be performed in parallel, in series, or in a different order, as long as the desired results of the technical solutions of the present disclosure are achieved, which are not limited herein.

[0123] The above detailed description does not limit the scope of the disclosure. Various modifications, combinations, sub-combinations and alternatives can be made to the detailed description. Any modification, equivalent replacement and improvement etc. made within the spirit and principle of the disclosure shall be included in the scope of the disclosure.

Claims

1. A multi-window display method, characterized by, The method comprises: in response to receiving a display operation, obtaining display information of a current screen, wherein the display information comprises display images of a plurality of running windows and a first height of a center of a current screen display picture, the current screen being a screen on a display device corresponding to a user; based on the first height, determining a target virtual display screen corresponding to the current screen; based on the target virtual display screen, determining a target window layout corresponding to the display images of the plurality of running windows; displaying the display images of the plurality of running windows on the target virtual display screen based on the target window layout.

2. The method of claim 1, wherein, The method comprises: determining a second height of a center of a shooting picture of a virtual device corresponding to the user in a heads-up state; determining a height difference between the first height and the second height; based on the first height, determining a first height threshold value and a second height threshold value corresponding to the first height, wherein the first height threshold value and the second height threshold value are used to determine a display condition corresponding to the height difference; based on the height difference, the first height threshold value and the second height threshold value, determining a target virtual display screen corresponding to the current screen.

3. The method of claim 2, wherein, The method comprises: if the height difference, the first height threshold value and the second height threshold value satisfy a first display condition, determining a virtual display screen corresponding to the first display condition as the target virtual display screen corresponding to the current screen; wherein the first display condition is that the height difference is greater than the first height threshold value and less than the first height threshold value, the target virtual display screen comprises a center virtual display screen, a first virtual display screen located on the left side of the center virtual display screen, a second virtual display screen located on the right side of the center virtual display screen, a third virtual display screen located above the center virtual display screen, and a fourth virtual display screen located below the center virtual display screen, the center virtual display screen being located at a preset distance in front of the current screen, the first virtual display screen, the second virtual display screen, the third virtual display screen and the fourth virtual display screen having a preset inclination angle with the center virtual display screen.

4. The method of claim 2, wherein, The method comprises: if the height difference, the first height threshold value and the second height threshold value satisfy a second display condition, determining a virtual display screen corresponding to the second display condition as the target virtual display screen corresponding to the current screen; The second display condition is that the height difference is greater than a first height threshold and less than a second height threshold, the target virtual display screen includes a center virtual display screen, a fifth virtual display screen located on the left side of the center virtual display screen, and a sixth virtual display screen located on the right side of the center virtual display screen, the center virtual display screen is located above the current screen and is aligned with the current screen or is at a preset distance in front of the current screen, and the fifth virtual display screen and the sixth virtual display screen have a preset inclination angle with the center virtual display screen.

5. The method of claim 2, wherein, The target virtual display screen corresponding to the current screen is determined based on the height difference, the first height threshold, and the second height threshold, including: If the height difference, the first height threshold, and the second height threshold satisfy a third display condition, a virtual display screen corresponding to the third display condition is determined as the target virtual display screen corresponding to the current screen. The third display condition is that the height difference is greater than -the second height threshold and less than -the first height threshold, the target virtual display screen includes a center virtual display screen, a seventh virtual display screen located on the left side of the center virtual display screen, and an eighth virtual display screen located on the right side of the center virtual display screen, the center virtual display screen is located below the current screen and is aligned with the current screen or is at a preset distance in front of the current screen, and the seventh virtual display screen and the eighth virtual display screen have a preset inclination angle with the center virtual display screen.

6. The method of claim 1, wherein, The target window layout corresponding to the display images of the plurality of running windows is determined based on the target virtual display screen, including: An initial window layout corresponding to the target virtual display screen is obtained, and the initial window layout includes a preset placement area of a running window on the target virtual display screen; A coincidence area rate of the running window and the preset placement area is determined; If the coincidence area rate is greater than or equal to a preset threshold, the preset placement area is determined as a target placement area of the running window; otherwise, a user manual adjustment prompt is triggered, and the target placement area of the running window is determined; The target placement areas of the plurality of running windows are determined as the target window layout corresponding to the display images of the plurality of running windows.

7. The method of claim 1, wherein, Before the display images of the plurality of running windows are displayed on the target virtual display screen based on the target window layout, the method further includes: The display image of the running window is enlarged to obtain an enlarged display image; A real-time distance between the user and the current screen is determined; If the real-time distance exceeds a distance threshold, the enlarged display image is subjected to image enhancement processing to obtain a target display image; The target display image is displayed on the target virtual display screen based on the target window layout.

8. The method of any one of claims 3 to 5, wherein, The method further includes: An auxiliary virtual display screen connected with the center virtual display screen is generated; A display screen of the current screen is obtained in real time, and a mouse position coordinate in the display screen is identified; Generate an augmented display picture in the auxiliary virtual display screen based on the mouse position coordinates.

9. The method of claim 8, wherein, The generating of the augmented display picture in the auxiliary virtual display screen based on the mouse position coordinates comprises: rendering the mouse pointer in the display picture by a highlight effect; determining a corresponding zoom-in area centered on the mouse position coordinates and performing local zoom-in display on the picture in the zoom-in area.

10. The method of claim 8, wherein, The method further comprises: automatically closing the augmented display picture when detecting that the mouse moves into the window picture of the target virtual display screen.

11. A multi-window display device, characterized by comprising: The apparatus comprises: an acquisition module configured to acquire display information of a current screen in response to receiving a display operation, wherein the display information comprises display images of a plurality of running windows and a first height of a display picture of the current screen, and the current screen is a screen on a display device corresponding to a user; a first determination module configured to determine a target virtual display screen corresponding to the current screen based on the first height; a second determination module configured to determine a target window layout corresponding to the display images of the plurality of running windows based on the target virtual display screen; a display module configured to display the display images of the plurality of running windows on the target virtual display screen based on the target window layout.

12. An electronic device, comprising: comprise: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the steps of the method of any one of claims 1-10.

13. A virtual appliance, comprising: comprise the electronic device of claim 12 or be connected to the electronic device of claim 12. 14.A non-transitory computer-readable storage medium, the computer storage medium storing computer-executable instructions; when the computer-executable instructions are executed by a processor, the method of any one of claims 1-10 can be implemented. 15.A computer program product comprising a computer program, when the computer program is executed by a processor, the method of any one of claims 1-10 can be implemented.

Images