Display method and system

Abstract

The invention provides a display method and system, and is applied to the technical field of display. The display method is applied to a first device and comprises the steps that when the first device is used for extended display of a second device, the first device responds to a first instruction, the content of a third device is displayed, and the first instruction is used for indicating the third device to serve as an input source displayed by the first device; the first signal is sent to the second device so that the second device and / or the fourth device can at least display the content of the first device, and the fourth device and the second device are used for extended display of the second device at the same time.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of display, and in particular, to a display method and system. BACKGROUND

[0002] Electronic devices (e.g., computers, etc.) can support multi-display screen display. Taking a computer supporting two display screens as an example, if multiple computers use one display screen at the same time, the display content will be missing in the switching process of the same display screen between multiple computers, affecting the user experience. SUMMARY

[0003] Therefore, the present disclosure provides a display method and system.

[0004] According to a first aspect of the present disclosure, a display method is provided, applied to a first device, comprising: when the first device is used for extended display of a second device, in response to a first instruction, displaying content of a third device, the first instruction being used to indicate that the third device is an input source for display of the first device; and sending a first signal to the second device, so that the second device and / or a fourth device can at least display content of the first device, the fourth device being used for extended display of the second device at the same time as the second device.

[0005] According to an embodiment of the present disclosure, the method further comprises: when the first device is used for extended display of the second device again, in response to a second instruction, displaying content of the second device; sending a second signal to the third device, so that the third device and / or a fifth device can at least display content of the third device, the fifth device being used for extended display of the third device at the same time as the third device; or when the first device is used for extended display of the second device again, in response to the second instruction, displaying content of the second device, and the third device resumes single-screen display; wherein the second instruction is used to indicate that the second device is an input source for display of the first device.

[0006] According to an embodiment of the present disclosure, the method further comprises: generating the first instruction in a case that the third device establishes a communication connection with the first device and serves as an input source for display of the first device.

[0007] A second aspect of the present disclosure provides a display system, comprising: a first device; a second device; a fourth device in communication connection with the second device, the fourth device being used for extended display of the second device; when the first device is used for extended display of the second device, the first device is used to display content of a third device in response to a first instruction, the first instruction being used to indicate that the third device is an input source for display of the first device; and sending a first signal to the second device, so that the second device and / or the fourth device can at least display content of the first device, the fourth device being used for extended display of the second device at the same time as the second device.

[0008] According to an embodiment of the present disclosure, when the first device is used for extended display of the second device, the first device is configured to display content of the second device in response to a second instruction; send a second signal to the third device, so that the third device and / or the fifth device can display content of the third device, and the fifth device is used for extended display of the third device at the same time as the third device; or when the first device is used for extended display of the second device, the first device is configured to display content of the second device in response to a second instruction, and the third device restores single-screen display; wherein the second instruction is used to indicate that the second device is an input source displayed by the first device.

[0009] According to an embodiment of the present disclosure, the first device is configured to generate a first instruction when the third device establishes a communication connection with the first device and serves as an input source displayed by the first device; or generate a second instruction when the third device disconnects the communication connection with the first device and the second device serves as an input source displayed by the first device.

[0010] According to an embodiment of the present disclosure, the second device is configured to switch the second device to the first display mode to display content of the second device on the second device and / or the fourth device in response to detection of the first signal; or switch the second device to the second display mode in response to detection of the second signal, and the first device is used for extended display of the second device at the same time as the fourth device.

[0011] According to an embodiment of the present disclosure, the second device is configured to obtain an available resource value of the second device; determine a target display strategy according to the available resource value, the target display strategy representing a display form of content of the first device and content of the fourth device; and display the content of the first device and the content of the fourth device in a display area of the fourth device according to the target display strategy.

[0012] According to an embodiment of the present disclosure, the second device is configured to, when the available resource value of the second device is less than a first threshold value, divide the display area of the fourth device into a first display area and a second display area, display content of the fourth device in the first display area, and display content of the first device in the second display area; or when the available resource value of the second device is greater than the first threshold value and less than a second threshold value, create a target window in the display area of the fourth device, display content of the first device in the target window, and the target window is displayed floatingly in the display area of the fourth device; or when the available resource value of the second device is greater than the second threshold value, create a virtual desktop in the fourth device, and display content of the first device in the virtual desktop.

[0013] According to an embodiment of the present disclosure, the second device is in communication connection with the first interface of the first device, and the signal is sent by a hot plug detection pin of the interface, and the level of the signal is different in different connection states of the second device and the first device.

[0014] It is to be understood that the details set forth herein do not limit the scope of the embodiments of the present disclosure. Other objectives, features, and advantages of the present disclosure will be apparent from the following detailed description, taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0015] The above and other objects, features and advantages of the present disclosure will become more apparent from the following description when taken in conjunction with the accompanying drawings, in which:

[0016] Figure 1 A diagram illustrating an application scenario of a display method in the related art is schematically shown;

[0017] Figure 2 A diagram illustrating an application scenario of a display method according to an embodiment of the present disclosure is schematically shown;

[0018] Figure 3A One of diagrams schematically showing display of a fourth device in a display system according to an embodiment of the present disclosure is schematically shown;

[0019] Figure 3B Another of diagrams schematically showing display of a fourth device in a display system according to an embodiment of the present disclosure is schematically shown;

[0020] Figure 4 A diagram schematically showing an interface type according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0021] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It is to be understood, however, that the description is merely illustrative of the embodiments of the present disclosure, but is not intended to limit the scope of the present disclosure. In the following detailed description of the embodiments of the present disclosure, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present disclosure. It will be apparent, however, to one skilled in the art that the embodiments of the present disclosure can be practiced without these specific details. In other instances, well-known structures and functions have been omitted or simply referenced in order not to obscure the concept of the present disclosure.

[0022] The terms used herein are merely used to describe specific embodiments, and are not intended to limit the present disclosure. The terms "include" and "have" and the like used herein indicate the presence of the features, steps, operations and / or components, but do not exclude the presence or addition of one or more other features, steps, operations or components.

[0023] All terms used herein, including technical and scientific terms, have the same meanings as those generally understood by those skilled in the art, unless otherwise defined. It should be noted that the terms used herein should be interpreted as having meanings consistent with the context of the present description, and should not be interpreted in an idealized or excessively formal manner.

[0024] In the case of using expressions similar to "at least one of A, B, and C, etc.", it is generally intended to include any of A, B, and C alone, or a combination of A, B, and C, etc.

[0025] The display method and system are provided. Before introducing the technical solutions provided by the embodiments of the present disclosure, the related technologies involved in the present disclosure are described.

[0026] Electronic devices (e.g., computers, etc.) can support multi-display screens. Taking a computer supporting two display screens as an example, if multiple computers use one display screen at the same time, the display content will be missing during the switching of the same display screen between multiple computers, affecting the user experience.

[0027] Exemplarily, referring to Figure 1 , computer A is in communication connection with display screen A and display screen B for multi-screen display. The first part of the content of computer A is displayed on display screen A, and the second part is displayed on display screen B. If computer B wants to use display screen B, after display screen B is connected with computer B, the content of computer B is displayed on display screen B, and display screen B is being used by computer B. The second part of the content of computer A in display screen B cannot be seen by the user. Even if display screen B is switched back to computer A, the second part of the content cannot be seen. If display screen B is the main display screen (the system default main screen) of computer A, since the content popped up by the right mouse button is displayed on the main display screen, the user cannot set the mirror mode or the extended mode through the "display settings" in the right mouse button menu.

[0028] To solve the above problems, the user can manually unplug the video line (e.g., HDMI) of the display screen and connect it to the computer that needs to be switched, which causes troublesome operation. Alternatively, multiple computers and multiple display screens can be connected through a multi-input and output device (e.g., a docking station) to allocate the display screens to different computers for use. However, when using the multi-input and output device, all display screens can only be switched to computer A or computer B at the same time, and cannot be individually specified as "only display screen A to computer A, and display screen B remains for computer B. The above problems still exist.

[0029] Embodiments of the present disclosure provide a display method applied to a first device, comprising:

[0030] When the first device is used for the second device for extended display, the third device is displayed in response to a first instruction, the first instruction is used to indicate the third device as an input source for the first device to display; a first signal is sent to the second device to enable the second device and / or the fourth device to display at least the content of the first device, and the fourth device is used for the second device for extended display at the same time as the second device.

[0031] The following will be described in detail by Figure 2 The display method of the embodiment of the present disclosure will be described in detail.

[0032] The display method of the embodiment includes: when the first device is used for the second device for extended display, the third device is displayed in response to a first instruction, the first instruction is used to indicate the third device as an input source for the first device to display; a first signal is sent to the second device to enable the second device and / or the fourth device to display at least the content of the first device, and the fourth device is used for the second device for extended display at the same time as the second device.

[0033] The first device and the fourth device can be electronic devices with output display function and communication function. The second device and the third device can be electronic devices with communication function.

[0034] The electronic device can be a portable device such as a mobile phone, a tablet computer, a wearable device (e.g., a watch, a bracelet, a helmet, a headset, etc.) with wireless communication function, a vehicle terminal device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), etc. The electronic device can also be a smart home device (e.g., a smart TV, a smart speaker, etc.), a smart car, a smart robot, a plant device, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, or a wireless terminal in smart home, a flight device (e.g., a smart robot, a hot air balloon, a drone, an airplane), etc.

[0035] In some embodiments of the present disclosure, the electronic device can also be a portable terminal device that further includes other functions such as a personal digital assistant and / or a music player function. Exemplary embodiments of the portable terminal device include, but are not limited to, a portable terminal device with an Android® or iOS® operating system. The portable terminal device described above can also be other portable terminal devices, such as a laptop computer having a touch-sensitive surface (e.g., a touch panel), and the like. It should also be understood that in some other embodiments of the present disclosure, the electronic device described above can also not be a portable terminal device, but rather a desktop computer having a touch-sensitive surface (e.g., a touch panel).

[0036] In some embodiments of the present disclosure, the first device and the fourth device can be electronic devices with one or more display screens that are used independently. For example, the first device / the fourth device can be a display, a tablet computer with a folding screen, and the like. In some other embodiments of the present disclosure, the first device and the fourth device can also be devices with imaging functions that are not used independently. For example, the first device / the fourth device can be a projector and a projection screen.

[0037] Exemplarily, the first device and the fourth device can be devices with at least one display area. The first device and the fourth device can be of the same type or not. For example, when the first device and the fourth device are of the same type, both the first device and the fourth device can be displays. When the first device and the fourth device are not of the same type, the first device can be a display and the fourth device can be a tablet computer. Embodiments of the present disclosure do not specifically limit the types of the first device and the fourth device.

[0038] In some embodiments of the present disclosure, the second device and the third device can be electronic devices with at least one display screen, such as a mobile phone, and the like. In some other embodiments of the present disclosure, the second device and the third device can also be electronic devices without a display screen, such as a computer host, and the like.

[0039] Exemplarily, the second device and the third device can be devices capable of outputting display data. The second device and the third device can be of the same type or not. For example, when the second device and the third device are of the same type, both the second device and the third device can be computer hosts. When the second device and the third device are not of the same type, the second device can be a computer host and the third device can be a notebook computer, and the like, and embodiments of the present disclosure do not specifically limit the types of the first device and the fourth device.

[0040] The extended display can be a continuous display area of multiple display devices for the same device to realize a virtual display area. It should be noted that the display area of multiple display devices is physically separated, that is, the display area of multiple display devices has a physical distance. However, the display area of multiple display devices is continuous in the display sense, that is, the display area of multiple display devices has a display continuity. When a window is partially located in the display area space of the first display device and the other part is located in the display area space of the second display device which is continuous with the display area of the first display device, the content of the part of the window is displayed in the display area of the first display device, the content of the other part of the window is displayed in the display area of the second display device, and the content of the window is continuously displayed in the display area of the first display device and the display area of the second display device.

[0041] The first device is used for the extended display of the second device: in the case that the second device itself does not have a display area, if the fourth device is an external display area of the second device, the first device can be a continuation of the display area of the fourth device. In the case that the second device itself has a display area, if the fourth device is a continuation of the display area of the second device, the first device can be a further continuation of the display area of the fourth device.

[0042] The first instruction can be used to indicate that the content of the third device is used as the input source of the display content of the first device. In other words, in the process that the first device is used by the second device, if the first instruction is received, the first device can receive the content of the third device and display the content of the third device in the display area of the first device; at the same time, the first device cannot receive the content of the second device, and the content of the second device cannot be displayed in the display area of the first device.

[0043] The first signal can represent that the first device is currently used to display the content of the third device, and the first device cannot be used to display the content of the second device at the current time. For example, the first signal can represent that the first device is currently disconnected from the communication connection with the second device, or the second device is not the input source of the content displayed by the first device at the current time.

[0044] The fourth device is used for the extended display of the second device at the same time as the second device. In the case that the second device itself does not have a display area, the fourth device can be an external display area of the second device content; in the case that the second device itself has a display area, the fourth device can be a continuation of the display area of the second device.

[0045] The second device receives the first signal and transfers the display content of the first device to the display area of the second device. Here, the display area of the second device can be the display area of the second device itself, or can be the display area (the display area of the fourth device itself) extended by the second device. The content originally displayed by the second device on the first device can be all transferred to the display area of the second device itself, or can be all transferred to the display area of the fourth device itself, or can be partially transferred to the display area of the second device itself and partially transferred to the display area of the fourth device itself.

[0046] It can be understood that, by program design, the switching of the content of different devices in the same display device can be realized in the environment that the same display device is used by different devices, so that the content of each device can be completely displayed in the process of switching display, thereby improving the efficiency of display switching of multi-screen devices and improving the flexibility of display switching of multi-devices.

[0047] Figure 2 An application scenario diagram of a display method according to an embodiment of the present disclosure is schematically shown, and the display method is applied to a first device.

[0048] In one example, with reference to Figure 2 For example, the first device is a display, the second device is a computer host, the third device is a notebook computer, and the fourth device is a display.

[0049] The first device and the fourth device are used for the extended display of the second device, that is, the content output by the second device can be displayed on the first device and the fourth device. In the case where the first device receives the first instruction, it is indicated that a new device (the third device) is used as the input source of the display of the first device, the first device receives the content of the third device, and displays the content of the third device on the display area of the first device. At the same time, the first device cannot receive the content of the second device, and the content of the second device cannot be displayed on the display area of the first device. Then, the first signal is sent to the second device, indicating that the first device is currently used to display the content of the third device, and the first device cannot be used to display the content of the second device at the current time. Then, the display content of the second device originally displayed on the first device is transferred to the display area of the fourth device.

[0050] In some embodiments, the display method of the embodiment further includes: when the first device is used for the extended display of the second device again, displaying the content of the second device in response to a second instruction; and sending a second signal to the third device, so that the third device and / or a fifth device can at least display the content of the third device, and the fifth device is used for the extended display of the third device at the same time as the third device. The second instruction is used to indicate that the second device is used as the input source of the display of the first device.

[0051] Exemplarily, the second instruction can be used to instruct the content of the second device as the input source of the display content of the first device. In other words, the first device can receive the content of the second device and display the content of the second device on the display area of the first device; meanwhile, the first device cannot receive the content of the third device, and the content of the third device cannot be displayed on the display area of the first device.

[0052] The second signal can represent that the first device is currently used to display the content of the second device, and the first device cannot be used to display the content of the third device at the current time. For example, the first signal can represent that the first device is currently disconnected from the third device, or the third device is not the input source of the content displayed by the first device at the current time.

[0053] The third device and the fifth device are used to expand the display of the third device. In the case that the third device itself does not have a display area, the fifth device can be used as an external display area of the content of the third device; in the case that the third device itself has a display area, the fifth device can be used as a continuation of the display area of the second device.

[0054] After receiving the second signal, the third device transfers the display content of the first device to the display area of the third device. Here, the display area of the third device can be the display area of the third device itself, or the display area continued by the third device (the display area of the fifth device itself). The content originally displayed by the third device on the first device can be all transferred to the display area of the third device itself, or all transferred to the display area of the fifth device itself, or part of the content originally displayed on the first device is transferred to the display area of the third device itself, and the other part of the content is transferred to the display area of the fifth device itself.

[0055] In one example, at a first time, the first device and the fourth device are used for the extended display of the second device at the same time, i.e. the content output by the second device can be displayed in the first device and the fourth device. In the case that the first device receives a first instruction indicating that there is a new device (the third device) as the input source of the display of the first device, the first device receives the content of the third device and displays the content of the third device in the display area of the first device and the display area of the fifth device at the same time, the fifth device being the external display area of the third device, and the display area of the first device can be a continuation of the display area of the fifth device. At this time, the first device cannot be used for the extended display of the second device; at the same time, the first device cannot receive the content of the second device, and the content of the second device cannot be displayed in the display area of the first device. Then a first signal is sent to the second device, indicating that the first device is currently used for displaying the content of the third device, and the first device cannot be used for displaying the content of the second device at the current time. Then the display content of the second device in the first device is transferred to the display area of the fourth device.

[0056] At a second time, the second time is later than the first time, the third device is disconnected from the first device, and the second device is normally connected to the first device, so that the first device continues to be used for the extended display of the second device. In the case that the first device receives a second instruction indicating that the second device is the input source of the display of the first device, the first device receives the content of the second device and displays the content of the second device in the fourth device and the display area of the first device for extended display. At this time, the first device cannot be used for the extended display of the third device. At the same time, the content of the third device cannot be displayed in the display area of the first device, so that a second signal is sent to the third device, indicating that the first device is currently used for the extended display of the second device, and the first device cannot be used for displaying the content of the third device at the current time. Then part of the display content of the third device in the first device is transferred to the display area of the third device itself, and the other part is transferred to the display area of the fifth device itself.

[0057] In other embodiments, the display method further includes: when the first device is used for the extended display of the second device again, in response to the second instruction, displaying the content of the second device, and the third device resumes the single-screen display. Wherein, the second instruction is used to indicate that the second device is the input source of the display of the first device.

[0058] In one example, continuing to refer to the above Figure 2At the second time, the second time is later than the first time, the third device is disconnected with the first device, and the second device is normally connected with the first device, so that the first device continues to display as an extension of the second device. In the case that the first device receives the second instruction, indicating that the second device is an input source of the first device display, the first device receives the content of the second device, and the content of the second device is displayed on the fourth device and the display area of the first device. At this time, the first device cannot be displayed as an extension of the third device. At the same time, the content of the third device cannot be displayed on the display area of the first device, so that the second signal does not need to be sent to the third device, indicating that the first device is currently used as an extension of the second device, and the first device cannot be used to display the content of the third device at the current time. The third device has its own display area, so that the display content of the third device on the first device is completely transferred to the display area of the third device.

[0059] In other embodiments, in the case that the third device has a plurality of extension display devices (including the fifth device), if the first device is used as an extension of the second device again, the second signal needs to be sent to the third device to make the third device and the fifth device simultaneously display as an extension of the third device. In the case that the third device does not have a plurality of extension display devices (its own display), if the first device is used as an extension of the second device again, the second signal does not need to be sent to the third device, and the third device is directly switched to single-screen display.

[0060] In some embodiments, the display method further comprises: generating the first instruction in the case that the third device establishes a communication connection with the first device and displays as an input source of the first device.

[0061] For example, the third device establishes a communication connection with the first device in a wired manner, such as HDMI line, DP (Display Port) line, Type-C line, etc.

[0062] The third device establishes a communication connection with the first device in a wireless manner, such as Bluetooth connection, Miracast protocol, etc.

[0063] In one example, the first device is communicatively connected to the second device through a DP line, and the fourth device is communicatively connected to the second device through an HDMI line. The first device and the fourth device simultaneously serve as an extended display of the first device, that is, the content of the second device can be simultaneously displayed on the first device and the fourth device.

[0064] In some other embodiments, the display method of the embodiments further includes: in a case where the third device is disconnected from the first device and the second device is determined as the input source for the first device to display, generating a second instruction.

[0065] In one example, the first device is communicatively connected to the second device through a DP line, and the fourth device is communicatively connected to the second device through an HDMI line. The first device and the fourth device simultaneously serve as an extended display of the first device, that is, the content of the second device can be simultaneously displayed on the first device and the fourth device.

[0066] If the third device is successfully connected to the first device through a Type-C line, and the third device is selected as the input source for the first device to display according to the display setting of the first device, a first instruction is generated, indicating that the first device receives the content of the third device and displays the content of the third device on the display area of the first device. At this time, the first device cannot receive the content of the second device, and the content of the second device cannot be displayed on the display area of the first device.

[0067] If the Type-C line connected between the third device and the first device is pulled out, the first device is disconnected from the third device, and the second device is selected as the input source for the first device to display according to the display setting of the first device. A second instruction is generated, indicating that the first device receives the content of the second device and displays the content of the second device on the display area of the first device. At this time, the first device cannot receive the content of the third device, and the content of the third device cannot be displayed on the display area of the first device.

[0068] The display system of the embodiments of the present disclosure will be described in detail below. Figures 3A-4 The display system of the embodiments of the present disclosure will be described in detail below.

[0069] The display system of the embodiments of the present disclosure will be described in detail below.

[0070] The fourth device is in communication connection with the second device, and the fourth device is used for extended display of the second device; when the first device is used for extended display of the second device, the first device is used for displaying the content of the third device in response to a first instruction, and the first instruction is used for indicating that the third device is an input source of the first device; a first signal is sent to the second device, so that the second device and / or the fourth device can at least display the content of the first device, and the fourth device is used for extended display of the second device at the same time as the second device.

[0071] The understanding of the first device, the second device, the third device and the fourth device can refer to the description of the first device, the second device, the third device and the fourth device in the display method described above, and will not be repeated here.

[0072] In an example, the first device is a display, the second device is a computer host, the third device is a notebook computer, and the fourth device is a display. The second device (computer host) is in communication connection with the first device (display 2) and the fourth device (display 1) respectively, the fourth device (display 1) is used as an external display area of the second device (computer host), and the display area of the first device (display 2) is used as a continuation of the display area of the fourth device (display 1). The first device (display 2) and the fourth device (display 1) are used for extended display of the second device (computer host). In the case that the first device (display 2) receives a first instruction, it indicates that there is a new device (third device: notebook computer) as an input source of the first device (display 2), the first device (display 2) receives the content of the third device (notebook computer) and displays the content of the third device (notebook computer) on the display area of the first device (display 2); at the same time, the first device (display 2) cannot receive the content of the second device (computer host), and the content of the second device (computer host) cannot be displayed on the display area of the first device (display 2). Then a first signal is sent to the second device (computer host), indicating that the first device (display 2) is currently used for displaying the content of the third device (notebook computer), and the first device (display 2) cannot be used for displaying the content of the second device (computer host) at the current time. Then the display content of the second device (computer host) originally displayed on the first device (display 2) is transferred to the display area of the fourth device.

[0073] In some embodiments, when the first device is used for extended display of the second device again, the first device is used for displaying the content of the second device in response to a second instruction; a second signal is sent to the third device, so that the third device and / or the fifth device can at least display the content of the third device, and the fifth device is used for extended display of the third device at the same time as the third device; wherein the second instruction is used for indicating that the second device is an input source of the first device.

[0074] Exemplarily, for the fifth device, the second instruction and the second signal, reference can be made to the above description of the display method for the second instruction and the second signal, which will not be repeated here.

[0075] At the first time, the second device (computer host) is in communication connection with the first device (display 2) and the fourth device (display 1) respectively, the fourth device (display 1) is an external display area of the second device (computer host), and the display area of the first device (display 2) is a continuation of the display area of the fourth device (display 1). The first device (display 2) and the fourth device (display 1) are the extended display of the second device (computer host).

[0076] In the case that the first device (display 2) receives the first instruction, it indicates that there is a new device (third device: notebook computer) as the input source of the first device (display 2) display, the first device (display 2) receives the content of the third device (notebook computer) and displays it as the extended display of the third device (notebook computer). If the third device (notebook computer) is originally in communication connection with the fifth device (display 3, not shown in the figure), the fifth device (display 3) is a continuation of the display area of the third device (notebook computer), and the first device (display 2) is a continuation of the display area of the fifth device (display 3), then the third device (notebook computer), the fifth device (display 3) and the first device (display 2) simultaneously display the content of the third device as the extended display. If the third device (notebook computer) is originally not in communication connection with the fifth device (display 3), the first device (display 2) is a continuation of the display area of the third device (notebook computer), and the content of the third device (notebook computer) is displayed on the display area of the first device (display 2) and the display area of the third device (notebook computer). At the same time, the first device (display 2) cannot receive the content of the second device (computer host), and the content of the second device (computer host) cannot be displayed on the display area of the first device (display 2). Then a first signal is sent to the second device (computer host), indicating that the first device (display 2) is currently used to display the content of the third device (notebook computer), and the first device (display 2) cannot be used to display the content of the second device (computer host) at the current time. Then the display content of the second device (computer host) on the first device (display 2) is transferred to the display area of the fourth device.

[0077] In the second time, the second time is later than the first time, the third device (the notebook computer) is disconnected with the first device (the display 2), the second device (the computer host) is normally connected with the first device (the display 2), and then the first device (the display 2) continues to be the extended display of the second device (the computer host). In the case that the first device (the display 2) receives the second instruction, indicating that the second device (the computer host) is the input source of the first device (the display 2), the first device (the display 2) receives the content of the second device (the computer host) and displays the content of the second device (the computer host) on the display area of the fourth device (the display). At this time, the first device (the display 2) cannot be the extended display of the third device (the notebook computer). At the same time, the content of the third device (the notebook computer) cannot be displayed on the display area of the first device (the display 2), and then a second signal is sent to the third device (the notebook computer), indicating that the first device (the display 2) is currently used as the extended display of the second device (the computer host), and the first device (the display 2) cannot be used to display the content of the third device (the notebook computer) at the current time. If the third device (the notebook computer) is originally connected with the fifth device (the display 3), a part of the display content of the third device (the notebook computer) on the first device (the display 2) can be transferred to the display area of the third device (the notebook computer) itself, and the other part can be transferred to the display area of the fifth device itself. If the third device (the notebook computer) is originally connected with the fifth device (the display 3), all of the display content of the third device (the notebook computer) on the first device (the display 2) can be transferred to the display area of the third device (the notebook computer) itself, or all of the display content can be transferred to the display area of the fifth device itself. If the third device (the notebook computer) is originally not connected with the fifth device (the display 3), all of the display content of the third device (the notebook computer) on the first device (the display 2) can be transferred to the display area of the third device (the notebook computer) itself.

[0078] In some other embodiments, when the first device is used for the extended display of the second device again, the first device is used for displaying the content of the second device in response to the second instruction, and the third device resumes the single screen display; wherein the second instruction is used for indicating that the second device is the input source of the first device.

[0079] In one example, the third device (laptop) is disconnected from the first device (display 2), the second device (computer host) is normally connected with the first device (display 2), and the first device (display 2) continues to be an extended display of the second device (computer host). In the case that the first device (display 2) receives a second instruction indicating that the second device (computer host) is an input source of the first device (display 2), the first device (display 2) receives the content of the second device (computer host) and displays the content of the second device (computer host) on the display area of the fourth device (display). At this time, the first device (display 2) cannot be an extended display of the third device (laptop). At the same time, the content of the third device (laptop) cannot be displayed on the display area of the first device (display 2), indicating that the first device (display 2) is currently an extended display of the second device (computer host), and the first device (display 2) cannot be used to display the content of the third device (laptop) at the current time. If the third device (laptop) is originally not connected to other displays, the third device (laptop) returns to single-screen display. The content originally displayed by the third device (laptop) on the first device (display 2) is all transferred to the display area of the third device (laptop) itself.

[0080] In some embodiments, the first device is configured to generate a first instruction in the case that the third device establishes a communication connection with the first device and serves as an input source of the first device.

[0081] The third device establishing a communication connection with the first device can be that the third device is connected to the first device in a wired manner, for example, an HDMI (High-Definition Multimedia Interface) line, a DP (Display Port) line, a Type-C (Universal Serial Bus C-type interface) line, etc.

[0082] The third device establishing a communication connection with the first device can also be that the third device is connected to the first device in a wireless manner. For example, Bluetooth connection, Miracast protocol, etc.

[0083] In one example, the first device is communicatively connected to the second device through a DP line, and the fourth device is communicatively connected to the second device through an HDMI line. The first device and the fourth device simultaneously serve as an extended display of the first device, i.e., the content of the second device can be simultaneously displayed on the first device and the fourth device. If the third device is successfully connected to the first device through a Type-C line, and the third device is selected as the input source of the first device display according to the "display setting" of the first device, a first instruction is generated, indicating that the first device receives the content of the third device and displays the content of the third device on the display area of the first device. At this time, the first device cannot receive the content of the second device, and the content of the second device cannot be displayed on the display area of the first device.

[0084] In some other embodiments, the first device is configured to generate a second instruction in a case that the third device is disconnected from the first device and the second device is selected as the input source of the first device display.

[0085] In one example, the first device is communicatively connected to the second device through a DP line, and the fourth device is communicatively connected to the second device through an HDMI line. The first device and the fourth device simultaneously serve as an extended display of the first device, i.e., the content of the second device can be simultaneously displayed on the first device and the fourth device.

[0086] If the third device is successfully connected to the first device through a Type-C line, and the third device is selected as the input source of the first device display according to the "display setting" of the first device, a first instruction is generated, indicating that the first device receives the content of the third device and displays the content of the third device on the display area of the first device. At this time, the first device cannot receive the content of the second device, and the content of the second device cannot be displayed on the display area of the first device.

[0087] After the Type-C line connected between the third device and the first device is pulled out, the first device is disconnected from the third device, and the second device is selected as the input source of the first device display according to the "display setting" of the first device. A second instruction is generated, indicating that the first device receives the content of the second device and displays the content of the second device on the display area of the first device. At this time, the first device cannot receive the content of the third device, and the content of the third device cannot be displayed on the display area of the first device.

[0088] In some embodiments, the second device is configured to switch the second device to the first display mode to display the content of the second device on the second device and / or the fourth device in response to detecting the first signal.

[0089] Exemplarily, the first display mode can be an extended display of the content of the second device in the reduced extended display device connected with the second device. For example, the first display mode can be a single-screen display mode.

[0090] In one example, when the second device (computer host) detects the first signal indicating that the first device (display 2) is disconnected from the third device (laptop computer) and the first device (display 2) is reconnected with the second device (computer host), the content output mode of the third device (laptop computer) is switched to the first display mode, and the third device (laptop computer) displays the content originally displayed in the first device (display 2) in the display area of the third device (laptop computer) itself, i.e., the third device (laptop computer) restores the single-screen display mode. The content output mode of the second device (computer host) is switched to the second display mode, and the content of the second device (computer host) is extended and displayed in the first device (display 2) and the fourth device (display 1), i.e., the multi-screen display mode is restored.

[0091] In some other embodiments, the second device is configured to switch to the second display mode in response to detecting the second signal, and the first device and the fourth device are simultaneously configured to extend the display of the second device.

[0092] Exemplarily, the second display mode can be an extended display of the content of the second device in the increased extended display device connected with the second device. For example, the second display mode can be a multi-screen display mode.

[0093] In one example, when the second device (computer host) detects the second signal indicating that the first device (display 2) is disconnected from the third device (laptop computer) and the first device (display 2) is reconnected with the second device (computer host), the content output mode of the third device (laptop computer) is switched to the first display mode, and the third device (laptop computer) displays the content originally displayed in the first device (display 2) in the display area of the third device (laptop computer) itself, i.e., the third device (laptop computer) restores the single-screen display mode. The content output mode of the second device (computer host) is switched to the second display mode, and the content of the second device (computer host) is extended and displayed in the first device (display 2) and the fourth device (display 1), i.e., the multi-screen display mode is restored.

[0094] In some embodiments, the second device is configured to obtain an available resource value of the second device; determine a target display strategy according to the available resource value, the target display strategy representing a display form of the content of the first device and the content of the fourth device; and display the content of the first device and the content of the fourth device in the display area of the fourth device according to the target display strategy.

[0095] Exemplarily, the available resource value can be a battery level, a memory occupation, a network bandwidth, a GPU computing power, etc. of the second device. For example, a load rate of the second device.

[0096] The target display strategy can be a display manner of the second device content in the at least one extended display for different types of available resource value settings when the second device is in the first display mode, and a display manner of the second device content in the at least one extended display for the same type of available resource value size settings. For example, in the process of switching the multi-screen display to the single-screen display, the content in the multiple display screens can be displayed in the single screen in the split-screen mode, and the content in the display screen that cannot be displayed can be displayed in the single screen in the form of the floating window.

[0097] In one example, when the second device is switched from the second display mode to the first display mode, the CPU availability of the second device is obtained, a preset single-screen display strategy is matched according to the size of the CPU availability, and the content of the first device is displayed in the fourth device according to the matched single-screen display strategy.

[0098] For the target display strategy, the following will be described in detail in combination with Figures 3A-3B .

[0099] Figure 3A One of the schematic diagrams of the display of the fourth device in the display system according to the embodiments of the present disclosure is schematically shown.

[0100] In one implementable manner, the second device is configured to, when the available resource value of the second device is less than a first threshold value, divide the display area of the fourth device into a first display area and a second display area, display the display content of the fourth device in the first display area, and display the content of the first device in the second display area.

[0101] Exemplarily, the first threshold value can be a critical value for adopting different target display strategies for the available resource value. The embodiments of the present disclosure do not make specific limitation on the size of the first threshold value, and the size of the first threshold value can be adjusted according to different types of available resources.

[0102] In one example, referring to Figure 3A , when the second device is switched from the second display mode to the first display mode, the CPU availability of the second device is obtained, if the CPU availability of the second device is less than 50%, the content displayed by the second device in the first device is transferred to the fourth device for display, and the content displayed in the first device and the display content in the fourth device are displayed in the display area of the fourth device in the form of the split screen, that is, the display area of the fourth device is divided into a first display area D1 and a second display area D2, the content displayed in the first device is displayed in the first display area D1, and the display content in the fourth device is displayed in the second display area D2.

[0103] The first display area D1 and the second display area D2 can be arranged in a window form left and right or up and down, and the embodiments of the present disclosure do not limit this.

[0104] The embodiments of the present disclosure do not specifically limit the number of the fourth device display area division, and when the second device has multiple (more than two) extended display devices that cannot display the content of the second device, the number of the fourth device display area division can be determined according to the number of the current extended display devices and the number of the current non-extended display devices, and the content of different extended display devices can be displayed in different division areas.

[0105] Figure 3B Fig. 2 schematically shows a second diagram of the fourth device display in the display system according to the embodiments of the present disclosure.

[0106] In another implementable manner, when the available resource value of the second device is greater than the first threshold value and less than the second threshold value, a target window D3 is created in the display area of the fourth device, and the content of the first device is displayed in the target window, and the target window is displayed in the display area of the fourth device in a floating manner.

[0107] In one example, referring to Figure 3B When the second device is switched from the second display mode to the first display mode, the CPU availability of the second device is obtained, and if the CPU availability of the second device is greater than 50% and less than 80%, the content displayed by the second device in the first device is transferred to the fourth device for display, and the content displayed in the first device is displayed in the display area of the fourth device in the form of a floating window, that is, the content of the fourth device display area is taken as a main window, and the content of the first device display area is displayed in a small window (target window D3) in a floating manner (the position and size of the small window in the display area of the fourth device can be adjusted).

[0108] In another implementable manner, when the available resource value of the second device is greater than the second threshold value, a virtual desktop is created in the fourth device, and the content of the first device is displayed in the virtual desktop.

[0109] In one example, in the case that the second device is switched from the second display mode to the first display mode, the CPU availability of the second device is obtained, if the CPU availability of the second device is greater than 80%, the content displayed by the second device in the first device is transferred to the fourth device for display, and the content displayed in the first device is displayed in the fourth device in the form of a virtual desktop, that is, a virtual desktop is created in the fourth device, and the content displayed by the first device is transferred to the virtual desktop. It should be noted that the fourth device has its own desktop to display the content of the second device displayed in the fourth device, the virtual desktop displays the content of the second device displayed in the first device, and the virtual desktop and the own desktop cannot exist at the same time. When the user needs to view the content in the virtual desktop, the virtual desktop is switched, and when the user needs to view the content in the own desktop, the own desktop is switched. The virtual desktop can be displayed in the fourth device in the form of a window.

[0110] It can be understood that the intelligent display adjustment can be realized for different situations of the devices, and the display efficiency and the smoothness of operation are taken into account.

[0111] Figure 4 A schematic diagram of an interface type according to an embodiment of the present disclosure is schematically shown.

[0112] In some embodiments, the second device is in communication connection with the first interface of the first device, the third device is in communication connection with the second interface of the first device, and the signal is sent by the hot plug detection pin of the interface. In the case that the second device and the first device / third device are in different connection states, the level of the signal is different.

[0113] Exemplarily, the first device can be in communication connection with the second device through a DP line. The DP line interface (first interface) in the first device can transmit a hot plug detection signal (HotPlug Detect, HPD), that is, a first signal and a second signal, through a 16th pin (hot plug detection pin). The first signal is high level, indicating that the first device is connected with the second device; the second signal is low level, indicating that the first device is disconnected with the second device. When the HPD signal is high level, the second device reads the EDID or DPCD (DisplayPort configuration data) information of the first device to configure the resolution and refresh rate of the first device and other parameters to display the content of the second device. When the HPD signal is low level, the third device reads the EDID or DPCD (DisplayPort configuration data) information of the first device to configure the resolution and refresh rate of the first device and other parameters to display the content of the third device.

[0114] The fourth device can be communicatively connected with the second device through an HDMI cable. The HDMI interface (third interface) in the fourth device can transmit a hot plug detection signal (HPD), i.e., the first signal and the second signal, through a 19th pin (hot plug detection pin), where the first signal is at a high level, indicating that the fourth device is connected with the second device; and the second signal is at a low level, indicating that the fourth device is disconnected with the second device. When the HPD signal is at the high level, the second device reads EDID or DPCD information of the fourth device to configure resolution and refresh rate of the fourth device, so as to display content of the second device. When the HPD signal is at the low level, the fourth device is disconnected with the second device, and the fourth device cannot display the content of the second device.

[0115] The third device can be communicatively connected with the first device through a Type-C cable. The Type-C interface (second interface) in the fourth device can transmit a hot plug detection signal (HPD), i.e., the first signal and the second signal, through a CC (Configuration Channel) pin and a SBU (Sideband Use) pin, where the first signal is at a high level, indicating that the third device is connected with the first device; and the second signal is at a low level, indicating that the third device is disconnected with the first device. When the HPD signal is at the high level, the third device reads EDID or DPCD information of the first device to configure resolution and refresh rate of the first device, so as to display content of the third device. When the HPD signal is at the low level, the third device is disconnected with the first device, and the first device cannot display the content of the third device.

[0116] The EDID information can be transmitted through a transmission EDID information pin in the interface.

[0117] The HPD signal of the Type-C interface is different from that of the DP or HDMI, because the Type-C interface is a multifunctional interface supporting multiple protocols (such as USB, DisplayPort Alt Mode, Thunderbolt, etc.), and when the Type-C interface is used for video output (through the DisplayPort Alt Mode), the function of the HPD signal is realized by a CC (Configuration Channel) pin and a SBU (Sideband Use) pin, and is transmitted by the SBU pin.

[0118] The hot plug function has been considered in the design of the DP interface, and most displays support automatic detection and adjustment of signals when connected or disconnected. Through the DP protocol, the display can communicate with the host to realize automatic adjustment of resolution, refresh rate, etc.

[0119] HDMI interface also supports hot plug, usually can automatically detect and adjust the signal when connecting or disconnecting. HDMI protocol supports EDID (Extended Display Identification Data), allowing the display to communicate with the host and automatically configure the display settings.

[0120] Type-C interface supports hot plug, especially for video output (such as USB-C Alt Mode). Type-C interface supports DP or HDMI signal through Alt Mode, has similar signal control function as DP and HDMI. In addition, Type-C can also transmit power and data, supporting more complex control.

[0121] In other embodiments, the display device (e.g., the first device / the fourth device, etc.) can also be connected through a DVI (Digital Visual Interface) connection. The DVI can transmit a hot plug detection signal (HPD) through 16 pins.

[0122] In other embodiments, a key can also be added to the display device (the first device / the fourth device), and pressing the key can send a hot plug detection signal (HPD) to the non-input source device.

[0123] In one example, the second device (computer host) is connected to the fourth device (display 1) and the first device (display 2), and the second device (computer host) simultaneously extends the display of the fourth device (display 1) and the first device (display 2). When the third device (laptop) is connected to the first device (display 2) for communication, it is necessary to switch the display output mode of the second device. Through "display settings", it is determined that the third device (laptop) is the input source of the display content of the first device (display 2), at this time, a hot plug detection signal (HPD) disconnection signal is sent to the non-input source (second device), and the second device (computer host) detects the disconnection signal of the first device (display 2), and switches the display output of the second device (computer host) to single-screen display (first display mode). The content originally displayed in the first device (display 2) of the second device (computer host) is displayed on the fourth device (display 1), so that the content of the first device (display 2) cannot be displayed on the second device (computer host) in the case that the first device (display 2) is occupied by other devices.

[0124] The connection line between the third device (notebook computer) and the first device (display 2) is unplugged, and the third device (notebook computer) no longer uses the first device (display 2). According to the "display settings" of the first device, the second device (computer host) is selected as the input source of the first device (display 2) to display the content, at this time, the non-input source (third device (notebook computer)) is sent again to disconnect the hot plug detection signal (HPD) signal, and the third device (notebook computer) detects the signal of the first device (display 2) disconnection, the third device (notebook computer) switches the single screen display, and sends the hot plug detection signal (HPD) to the second device (computer host), and the second device (computer host) detects the first device (display 2) access and automatically expands to double screen display, that is, the second device (computer host) content is expanded and displayed on the fourth device (display 1) and the first device (display 2).

[0125] Those skilled in the art can understand that the features described in various embodiments and / or claims of the present disclosure can be combined or / and integrated in various combinations, even if such combinations are not explicitly described in the present disclosure. In particular, the features described in various embodiments and / or claims of the present disclosure can be combined and / or integrated in various combinations without departing from the spirit and teachings of the present disclosure. All these combinations and / or integrations fall within the scope of the present disclosure.

[0126] The above describes embodiments of the present disclosure. However, these embodiments are only for illustrative purposes, and are not intended to limit the scope of the present disclosure. Although each embodiment is described above separately, this does not mean that the measures in each embodiment cannot be used advantageously in combination. The scope of the present disclosure is defined by the appended claims and their equivalents. Without departing from the scope of the present disclosure, those skilled in the art can make various substitutions and modifications, which should all fall within the scope of the present disclosure.

Claims

1.A display method applied to a first device, comprising: displaying content of a third device in response to a first instruction when the first device is used for extended display of a second device, the first instruction being used to indicate the third device as an input source displayed by the first device; sending a first signal to the second device to enable the second device and / or a fourth device to display at least content of the first device, the fourth device being used for extended display of the second device simultaneously with the second device. 2.The method of claim 1, further comprising: displaying content of the second device in response to a second instruction when the first device is used for extended display of the second device again; sending a second signal to the third device to enable the third device and / or a fifth device to display at least content of the third device, the fifth device being used for extended display of the third device simultaneously with the third device; or displaying content of the second device in response to a second instruction when the first device is used for extended display of the second device again, the third device resuming single screen display; wherein the second instruction is used to indicate the second device as an input source displayed by the first device. 3.The method of claim 1, further comprising: generating the first instruction when the third device establishes a communication connection with the first device and is used as an input source displayed by the first device. 4.A display system, comprising: a first device; a second device; a fourth device in communication connection with the second device, the fourth device being used for extended display of the second device; the first device being used to display content of a third device in response to a first instruction when the first device is used for extended display of the second device, the first instruction being used to indicate the third device as an input source displayed by the first device; sending a first signal to the second device to enable the second device and / or a fourth device to display at least content of the first device, the fourth device being used for extended display of the second device simultaneously with the second device. 5.The display system of claim 4, the first device being used to display content of the second device in response to a second instruction when the first device is used for extended display of the second device again; sending a second signal to the third device to enable the third device and / or a fifth device to display at least content of the third device, the fifth device being used for extended display of the third device simultaneously with the third device; or the first device being used to display content of the second device in response to a second instruction when the first device is used for extended display of the second device again, the third device resuming single screen display; the second instruction being used to indicate the second device as an input source displayed by the first device. wherein 6.The display system of claim 5, the first device being used to generate the first instruction when the third device establishes a communication connection with the first device and is used as an input source displayed by the first device; or ​ The first device is configured to generate a second instruction in a case where the third device is disconnected from the first device in communication and the second device is used as an input source displayed by the first device. 7.The display system of claim 5, wherein the second device is configured to switch the second device to a first display mode in response to detecting the first signal, so as to display content of the second device on the second device and / or the fourth device. 8.The display system of claim 7, wherein the second device is configured to acquire a value of available resources of the second device, determine a target display strategy according to the value of available resources, the target display strategy representing a display form of content of the first device and content of the fourth device, and display the content of the first device and the content of the fourth device on a display area of the fourth device according to the target display strategy. 9.The display system of claim 8, wherein the second device is configured to divide the display area of the fourth device into a first display area and a second display area in a case where the value of available resources of the second device is less than a first threshold, display display content of the fourth device on the first display area, and display content of the first device on the second display area. 10.The display system of claim 4, wherein the second device is connected to the first device through a first interface, the signal is sent by a hot plug detection pin of the interface, and a level of the signal is different in a case where the second device and the first device are in different connection states. ​ ​ ​ ​

Images