Method and system for realizing extended screen

Abstract

The invention provides a method and a system for realizing an expansion screen, and relates to the technical field of computer remote control and audio and video streaming. The method comprises the following steps: first electronic equipment captures display content on a virtual display screen of the first electronic equipment; the virtual display screen is regarded as a second display screen coexisting with a physical display screen of the first electronic equipment; the first electronic equipment and the second electronic equipment are connected in series; the first electronic equipment performs video coding on the captured display content to obtain coded data; the first electronic equipment pushes the coded data to the second electronic equipment; and the second electronic equipment displays the display content in the coded data through a physical display screen of the second electronic equipment. According to the invention, the seamless expansion screen function between the two electronic devices can be realized, and meanwhile, the hardware cost is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of computer remote control and audio and video streaming, and in particular to a method and system for implementing screen expansion. Background Art

[0002] The multi-screen expansion technology widely used in the market is mainly implemented through hardware or software. Hardware expansion methods include using external connection devices such as HDMI (High Definition Multimedia Interface), DisplayPort or USB docking station to connect the display output of one computer to another display screen to achieve physical multi-screen expansion. Software expansion methods include using remote desktop software, such as the remote desktop that comes with Windows or third-party applications (such as TeamViewer, Anydesk), which can realize the screen operation of another computer through the network.

[0003] However, the hardware expansion method requires additional hardware support, and the hardware cost is high. The remote desktop software method is not actually multi-screen expansion, but a copy of the screen content, which cannot allow the display content between two electronic devices to be seamlessly expanded.

[0004] Based on this, how to achieve seamless screen expansion function between two electronic devices while reducing hardware costs has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] In view of this, in order to solve the above technical problems, the present invention provides a method and system for implementing an extended screen.

[0006] The present invention adopts the following technical solution:

[0007] In a first aspect, the present invention provides a method for implementing an extended screen, comprising:

[0008] The first electronic device captures the display content on its virtual display screen; the virtual display screen is regarded as a second display screen coexisting with the physical display screen of the first electronic device; the first electronic device and the second electronic device are connected by streaming;

[0009] The first electronic device performs video encoding on the captured display content to obtain encoded data;

[0010] The first electronic device pushes the encoded data to the second electronic device;

[0011] The second electronic device displays the display content in the encoded data through its physical display screen.

[0012] Optionally, before the first electronic device captures the display content on its virtual display screen, the method for implementing screen extension of the present invention further includes:

[0013] Creating the virtual display screen on the first electronic device;

[0014] The first electronic device establishes a streaming connection with the second electronic device.

[0015] Optionally, creating the virtual display screen on the first electronic device specifically includes:

[0016] The virtual display screen is created on the first electronic device using an indirect display driver technology.

[0017] Optionally, enabling the first electronic device to establish a streaming connection with the second electronic device specifically includes:

[0018] enabling the first electronic device to establish a network connection with the second electronic device;

[0019] A data communication channel is established between the first electronic device and the second electronic device using streaming technology.

[0020] Optionally, the first electronic device captures display content on its virtual display screen, specifically including:

[0021] The first electronic device uses DirectX graphics infrastructure technology to capture display content on its virtual display screen.

[0022] Optionally, the first electronic device performs video encoding on the captured display content to obtain encoded data, specifically including:

[0023] The first electronic device performs video encoding on the captured display content based on the H.264 video encoding standard to obtain encoded data.

[0024] Optionally, the first electronic device performs video encoding on the captured display content to obtain encoded data, specifically including:

[0025] The first electronic device performs video encoding on the captured display content based on the H.265 video encoding standard to obtain encoded data.

[0026] In a second aspect, the present invention further provides a system for implementing an extended screen, comprising: a first electronic device and a second electronic device;

[0027] The first electronic device and the second electronic device are used to implement the method for implementing the extended screen as described above.

[0028] The present invention adopts the above technical solution, a method for realizing extended screen, including: a first electronic device captures display content on its virtual display screen; the virtual display screen is regarded as a second display screen coexisting with the physical display screen of the first electronic device; a streaming connection is established between the first electronic device and the second electronic device; the first electronic device performs video encoding on the captured display content to obtain encoded data; the first electronic device pushes the encoded data to the second electronic device; the second electronic device displays the display content in the encoded data through its physical display screen.

[0029] Based on this, the present invention truly realizes the extended screen effect through virtual display technology, rather than just mirroring or controlling another screen. At the same time, the present invention can realize multi-screen expansion without physical interfaces such as HDMI and DisplayPort, thereby reducing hardware costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0031] Figure 1 is a flow chart of a method for implementing screen expansion provided by an embodiment of the present invention;

[0032] Figure 2 It is a structural schematic diagram of a system for implementing screen expansion provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0033] To make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other implementation methods obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0034] Example

[0035] Figure 1 FIG. 1 is a flow chart of a method for implementing screen expansion provided by an embodiment of the present invention. Figure 1 As shown, this process includes:

[0036] Step 101: A first electronic device captures display content on its virtual display screen; the virtual display screen is regarded as a second display screen coexisting with a physical display screen of the first electronic device; and a streaming connection is established between the first electronic device and the second electronic device.

[0037] Specifically, the first electronic device and the second electronic device can both be computers, and the Windows system used by the computers is preferably Windows 10 19H1 version or above.

[0038] The first electronic device can specifically use DirectX Graphics Infrastructure (DXGI) technology to capture the display content on its virtual display screen. When the first electronic device captures the display content on its virtual display screen, it specifically captures the screen of its virtual display screen desktop in real time.

[0039] Step 102: The first electronic device performs video encoding on the captured display content to obtain encoded data.

[0040] Specifically, the first electronic device can perform video encoding on the captured display content based on the H.264 video coding standard or the H.265 video coding standard to obtain encoded data. Among them, H.264 and H.265 are two widely used video coding standards, H.264 is also called Advanced Video Coding (AVC). H.265 is also called High Efficiency Video Coding (HEVC).

[0041] Step 103: The first electronic device pushes the encoded data to the second electronic device.

[0042] Specifically, the first electronic device pushes the encoded data to the second electronic device through streaming technology.

[0043] Step 104: The second electronic device displays the display content in the encoded data through its physical display screen.

[0044] Specifically, after receiving the coded data, the second electronic device decodes the coded data to obtain corresponding display content, and then displays the display content on its physical display screen. In this way, the display content on the virtual display screen of the first electronic device is presented on the physical display screen of the second electronic device, so that the present invention achieves the effect of extending the screen.

[0045] In actual application, the method of the present invention can be used to achieve interaction and synchronization between a first electronic device and a second electronic device. Specifically, the physical display screen and the virtual display screen of the first electronic device can seamlessly switch display content. The user can switch relevant content from the physical display screen of the first electronic device to its virtual display screen by dragging a window, etc., so that the relevant content is displayed on the physical display screen of the second electronic device, thereby achieving multi-screen interaction across devices.

[0046] In the embodiment of the present invention, before the first electronic device captures the display content on its virtual display screen, the method for implementing the extended screen of the present invention may further include:

[0047] (1) Creating a virtual display screen on a first electronic device.

[0048] Specifically, on the first electronic device, a virtual display screen is created using an indirect display driver (IDD) technology.

[0049] (2) Establishing a streaming connection between the first electronic device and the second electronic device.

[0050] Specifically, enabling the first electronic device to establish a streaming connection with the second electronic device may include:

[0051] (2.1) Establishing a network connection between the first electronic device and the second electronic device.

[0052] Specifically, the first electronic device and the second electronic device may establish a network connection via a wired or wireless method, which is not specifically limited in the present invention.

[0053] (2.2) Using streaming technology, a data communication channel is established between the first electronic device and the second electronic device.

[0054] The present invention adopts the above technical solution and truly realizes the extended screen effect through virtual display technology, rather than just mirroring or controlling another screen. At the same time, the present invention can realize multi-screen expansion without physical interfaces such as HDMI and DisplayPort, so that the present invention does not rely on additional hardware and reduces hardware costs. In addition, through IDD and DXGI technology, the existing computing resources are fully utilized, the demand for computing power and bandwidth is reduced, and a good user experience is guaranteed.

[0055] In addition, the present invention has cross-platform applicability. Specifically, the present invention can adapt between different operating systems through streaming technology to achieve screen expansion between platforms such as Windows, Linux, and macOS.

[0056] In addition, the present invention is also flexible and extensible. Specifically, the present invention can flexibly adjust the streaming image quality according to network bandwidth and display requirements, and support different screen resolutions to adapt to different usage scenarios.

[0057] Based on a general inventive concept, the present invention also provides a system for implementing an extended screen.

[0058] Figure 2 FIG. 1 is a schematic diagram of a system for implementing an extended screen according to an embodiment of the present invention. Figure 2 As shown, the system includes:

[0059] A first electronic device 21 and a second electronic device 22 .

[0060] The first electronic device 21 and the second electronic device 22 are used to implement the method for implementing the extended screen as described above.

[0061] It should be noted that the hardware structure of the first electronic device 21 and the second electronic device 22 can be the same as that of the computer in the prior art. The specific method for the first electronic device 21 and the second electronic device 22 to implement the above-mentioned method of extending the screen can be found in the above content and will not be repeated here.

[0062] It can be understood that the same or similar parts of the above embodiments can be referenced to each other, and the contents not described in detail in some embodiments can refer to the same or similar contents in other embodiments.

[0063] It should be noted that, in the description of the present invention, the terms "first", "second", etc. are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In addition, in the description of the present invention, unless otherwise specified, the meaning of "plurality" refers to at least two.

[0064] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present invention belong.

[0065] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0066] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0067] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0068] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0069] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0070] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for implementing an extended screen, characterized in that: include: The first electronic device captures display content on its virtual display screen; The virtual display screen is regarded as a second display screen coexisting with the physical display screen of the first electronic device; the first electronic device and the second electronic device are connected by streaming; The first electronic device performs video encoding on the captured display content to obtain encoded data; The first electronic device pushes the encoded data to the second electronic device; The second electronic device displays the display content in the encoded data through its physical display screen.

2. The method for implementing screen expansion according to claim 1, characterized in that: Before the first electronic device captures the display content on its virtual display screen, the method further includes: Creating the virtual display screen on the first electronic device; The first electronic device establishes a streaming connection with the second electronic device.

3. The method for implementing screen expansion according to claim 2, characterized in that: Creating the virtual display screen on the first electronic device specifically includes: The virtual display screen is created on the first electronic device using an indirect display driver technology.

4. The method for implementing screen expansion according to claim 2, characterized in that: Enabling the first electronic device to establish a streaming connection with the second electronic device specifically includes: enabling the first electronic device to establish a network connection with the second electronic device; A data communication channel is established between the first electronic device and the second electronic device using streaming technology.

5. The method for implementing screen expansion according to claim 1, characterized in that: The first electronic device captures display content on its virtual display screen, specifically including: The first electronic device uses DirectX graphics infrastructure technology to capture display content on its virtual display screen.

6. The method for implementing screen expansion according to claim 1, characterized in that: The first electronic device performs video encoding on the captured display content to obtain encoded data, specifically including: The first electronic device performs video encoding on the captured display content based on the H.264 video encoding standard to obtain encoded data.

7. The method for implementing screen expansion according to claim 1, characterized in that: The first electronic device performs video encoding on the captured display content to obtain encoded data, specifically including: The first electronic device performs video encoding on the captured display content based on the H.265 video encoding standard to obtain encoded data.

8. A system for implementing an extended screen, characterized in that: include: a first electronic device and a second electronic device; The first electronic device and the second electronic device are used to implement the method for implementing an extended screen according to any one of claims 1 to 7.

Images